With the addition of functional tests to Katello’s react tests, we have seen quite a few timeout errors in Jenkins. We have expanded the timeouts, but will still see the occasional timeout issue. There is a non-blocking GH actions workflow that has been running the same tests and we haven’t seen those timeout issues. The GH actions test also allows for quicker feedback (it doesn’t have to wait on rails setup) and runs faster in general.
I’m proposing we remove Katello’s react-ui tests from the jenkins PR job and rely on GH actions. The tests would be kept in the release/nightly job
We can do this in the following way:
- Move react-ui tests out of parallel steps so they aren’t competing for resources. https://github.com/theforeman/foreman-infra/pull/1400
- Let the tests run for a few days and make sure we don’t see timeout issues
- Remove the react-ui test and foreman npm install step from the PR job in Jenkins, but keep in release/nightly
- Make the GH action running react tests in Katello a blocking test
This will also reduce the amount of time that the jenkins job will take on Katello PR’s, which can now take up to an hour and a half
Any objections to this change?