Just upgraded from Foreman 3.7.1/Katello 4.9 to Foreman 3.8/Katello 4.10 without any errors and noticed when syncing the new newly created Foreman repos for the proxies, it was very slow. Looking at the production.log I see the error “There was an issue with the backend service pulp3: Timed out connecting to server (RuntimeError)” for every sync job even if they eventually finish importing the packages to the new repos.
# foreman-maintain health check
Running ForemanMaintain::Scenario::FilteredScenario
================================================================================
Check number of fact names in database: [OK]
--------------------------------------------------------------------------------
Check whether all services are running: [OK]
--------------------------------------------------------------------------------
Check whether all services are running using the ping call: [OK]
--------------------------------------------------------------------------------
Check for paused tasks: [OK]
--------------------------------------------------------------------------------
Full log from one of the sync jobs:
sync_timeout.log (100.1 KB)
Installed Packages
- ansible-collection-theforeman-foreman-3.14.0-1.el8.noarch
- ansiblerole-foreman_scap_client-0.2.0-2.el8.noarch
- candlepin-4.3.1-1.el8.noarch
- candlepin-selinux-4.3.1-1.el8.noarch
- foreman-3.8.0-1.el8.noarch
- foreman-cli-3.8.0-1.el8.noarch
- foreman-debug-3.8.0-1.el8.noarch
- foreman-dynflow-sidekiq-3.8.0-1.el8.noarch
- foreman-installer-3.8.0-2.el8.noarch
- foreman-installer-katello-3.8.0-2.el8.noarch
- foreman-obsolete-packages-1.5-1.el8.noarch
- foreman-postgresql-3.8.0-1.el8.noarch
- foreman-proxy-3.8.0-1.el8.noarch
- foreman-release-3.8.0-1.el8.noarch
- foreman-selinux-3.8.0-1.el8.noarch
- foreman-service-3.8.0-1.el8.noarch
- katello-4.10.0-1.el8.noarch
- katello-certs-tools-2.9.0-2.el8.noarch
- katello-client-bootstrap-1.7.9-2.el8.noarch
- katello-common-4.10.0-1.el8.noarch
- katello-debug-4.10.0-1.el8.noarch
- katello-repos-4.10.0-1.el8.noarch
- katello-selinux-5.0.2-1.el8.noarch
- pulpcore-obsolete-packages-1.0-2.el8.noarch
- pulpcore-selinux-1.3.3-1.el8.x86_64
- python39-pulp-ansible-0.18.1-1.el8.noarch
- python39-pulp-certguard-1.6.5-1.el8.noarch
- python39-pulp-cli-0.21.2-1.el8.noarch
- python39-pulp-container-2.15.2-1.el8.noarch
- python39-pulp-deb-3.0.0-1.el8.noarch
- python39-pulp-file-1.14.3-1.el8.noarch
- python39-pulp-glue-0.21.2-1.el8.noarch
- python39-pulp-python-3.10.0-1.el8.noarch
- python39-pulp-rpm-3.22.6-1.el8.noarch
- python39-pulpcore-3.28.19-1.el8.noarch
- rubygem-foreman-tasks-8.2.0-1.fm3_8.el8.noarch
- rubygem-foreman_ansible-12.0.7-1.fm3_8.el8.noarch
- rubygem-foreman_maintain-1.3.5-1.el8.noarch
- rubygem-foreman_openscap-7.0.0-2.fm3_8.el8.noarch
- rubygem-foreman_remote_execution-11.1.0-1.fm3_8.el8.noarch
- rubygem-hammer_cli-3.8.0-1.el8.noarch
- rubygem-hammer_cli_foreman-3.8.0-1.el8.noarch
- rubygem-hammer_cli_foreman_ansible-0.5.0-1.fm3_7.el8.noarch
- rubygem-hammer_cli_foreman_openscap-0.1.13-2.fm3_5.el8.noarch
- rubygem-hammer_cli_foreman_remote_execution-0.2.3-1.fm3_7.el8.noarch
- rubygem-hammer_cli_foreman_tasks-0.0.19-1.fm3_7.el8.noarch
- rubygem-hammer_cli_katello-1.11.0-0.1.pre.master.20230905173948git1fa5f0c.el8.noarch
- rubygem-katello-4.10.0-1.el8.noarch
- rubygem-pulp_ansible_client-0.18.0-1.el8.noarch
- rubygem-pulp_certguard_client-1.6.5-1.el8.noarch
- rubygem-pulp_container_client-2.15.2-1.el8.noarch
- rubygem-pulp_deb_client-3.0.0-1.el8.noarch
- rubygem-pulp_file_client-1.14.3-1.el8.noarch
- rubygem-pulp_ostree_client-2.1.1-1.el8.noarch
- rubygem-pulp_python_client-3.10.0-1.el8.noarch
- rubygem-pulp_rpm_client-3.22.3-1.el8.noarch
- rubygem-pulpcore_client-3.28.11-1.el8.noarch
- rubygem-smart_proxy_pulp-3.2.0-3.fm3_3.el8.noarch