Problem: Upgrading from Katello 3.1.8 to Katello 4.3 caused many many problems with repos / repo syncs are broken
Expected outcome: Repos are working fine
Foreman and Proxy versions: 2.3.5 / 2.3.5
Foreman and Proxy plugin versions:
Distribution and version: CentOS 7
Other relevant data:
After a very long struggle, I managed to upgrade our Katello 3.1.8 including 5 Linux Proxies to 4.3 yesterday. I did the pulp2 to pulp3 upgrade a while ago. This was also a struggle. To check I ran:
foreman-maintain health check
on all nodes (Katello server and proxies) and there are no errors reported. However we have the issue that repo syncing is broken for all the repos. The errors we see during sync are:
undefined method `repository_href’ for nil:NilClass
The reason why we have to stick with Katello 4.3 is because we need the Foreman SCC Plugin (SUSE) content. And according to the github repo https://github.com/ATIX-AG/foreman_scc_manager/tree/v1.8.18 it only works Katello up to 4.3. What is strange is that the github page refers to version 1.18.20 while the latest version that we see on our katello server is tfm-rubygem-foreman_scc_manager-1.8.17-1.fm3_1.el7.noarch. Is there a repo where i can grab the new version?
I did a fresh install of Katello 4.3 to see if the SCC plugin works fine here, but the sync is also not working here.
404, message=‘Not Found’, url=URL(‘https://updates.suse.com/SUSE/Updates/SLE-Product-SLES/15-SP1/x86_64/update_debug/?AdwOPWCkarPHiYPZ_-_za9zbI2Fjvd3EDfB1uh-LNx-XfC8aXKSkjvgzNMl71TQz2wnL4zYrmU4si1AUQWIz9RR-VKyaCR6josojt5VxUVR3SDFIQPc7XwYXY1CZORp1zL8Plys39Fkur1qCB1DVyupa69Qct4U’)
I see a lot of these in /var/log/mesages:
Jun 23 11:08:43 katello systemd: pulp_celerybeat.service holdoff time over, scheduling restart.
Jun 23 11:08:43 katello systemd: Stopped Pulp’s Celerybeat.
Jun 23 11:08:43 katello systemd: Failed to load environment files: No such file or directory
Jun 23 11:08:43 katello systemd: pulp_celerybeat.service failed to run ‘start’ task: No such file or directory
Jun 23 11:08:43 katello systemd: Failed to start Pulp’s Celerybeat.
Jun 23 11:08:43 katello systemd: Unit pulp_celerybeat.service entered failed state.
Jun 23 11:08:43 katello systemd: pulp_celerybeat.service failed.
Any help would be highly appreciated.