In a recent team retrospective we expressed some frustration with random CI failures that make the PR process a bit harder. We decided to start tracking these failures in order to better judge how often they happen, when they happen, and potentially work towards solving them. The current failures we see are a combination of katello test stability and seemingly infrastructure issues.
So for katello developers (and any others that want to start tracking failures), feel free to add them here:
https://projects.theforeman.org/projects/katello/wiki/Katello_CI_Failures
We will likely review the results in a few weeks.
Justin