Undefined method pulp3_skip_publication error after upgrade

Problem: After upgrading Foreman from 2.5.3 → 3.0.0 and Katello from 4.1.4 → 4.2.0.1.rc3, syncing an repo gives me error:
undefined method 'pulp3_skip_publication' for nil:NilClassundefined method 'pulp3_skip_publication' for nil:NilClassundefined method 'pulp3_skip_publication' for nil:NilClass
Publishing a repo gives me error:
Cannot find repository type yum, is it enabled?

Expected outcome: Syncing and publishing working

Foreman and Proxy versions: 3.0.0

Foreman and Proxy plugin versions:
foreman-tasks 5.1.0
foreman_puppet 1.0.3
foreman_remote_execution 4.7.0
katello 4.2.0.1.rc3

Distribution and version:
CentOS Linux release 7.9.2009

Other relevant data:

This is indeed strange. The repository types follow a registration mechanism which runs when the server is started. It also needs relevant pulp packages installed.

Could you try restarting the server and also check rpm -qa | grep pulp

Hi @sajha ,

pulp-deb-plugins-1.10.2-1.el7.noarch
python3-pulp-container-2.8.1-0.1.el7.noarch
tfm-rubygem-pulp_rpm_client-3.13.3-1.el7.noarch
pulp-puppet-tools-2.21.5-1.el7.noarch
python-pulp-streamer-2.21.5-1.el7.noarch
python3-pulp-ansible-0.9.0-1.el7.noarch
tfm-rubygem-pulp_python_client-3.4.0-1.el7.noarch
python-pulp-common-2.21.5-1.el7.noarch
python-pulp-rpm-common-2.21.5-1.el7.noarch
python-pulp-oid_validation-2.21.5-1.el7.noarch
python-pulp-docker-common-3.2.9-1.el7.noarch
pulp-server-2.21.5-1.el7.noarch
pulp-puppet-plugins-2.21.5-1.el7.noarch
tfm-rubygem-pulpcore_client-3.14.1-1.el7.noarch
tfm-rubygem-pulp_ansible_client-0.8.0-1.el7.noarch
python3-pulpcore-3.14.7-1.el7.noarch
python3-pulp-certguard-1.4.0-1.el7.noarch
python-pulp-repoauth-2.21.5-1.el7.noarch
pulp-docker-plugins-3.2.9-1.el7.noarch
tfm-rubygem-pulp_certguard_client-1.4.0-1.el7.noarch
tfm-rubygem-pulp_deb_client-2.13.0-1.el7.noarch
python-pulp-deb-common-1.10.2-1.el7.noarch
python3-pulp-deb-2.14.1-1.el7.noarch
python3-pulp-2to3-migration-0.12.0-1.el7.noarch
tfm-rubygem-smart_proxy_pulp-3.1.0-1.fm2_6.el7.noarch
tfm-rubygem-pulp_container_client-2.7.0-1.el7.noarch
python-pulp-puppet-common-2.21.5-1.el7.noarch
python3-pulp-rpm-3.14.5-1.el7.noarch
pulp-selinux-2.21.5-1.el7.noarch
pulp-katello-1.0.3-1.el7.noarch
pulp-client-1.0-1.noarch
tfm-rubygem-pulp_file_client-1.8.1-1.el7.noarch
python3-pulp-file-1.8.2-1.el7.noarch
pulp-rpm-plugins-2.21.5-1.el7.noarch

I took a look at the upgrade logs:

2021-10-14 14:01:16 [DEBUG ] [root] Executing: foreman-rake upgrade:run
2021-10-14 14:01:25 [DEBUG ] [root] =============================================
2021-10-14 14:01:25 [DEBUG ] [root] Upgrade Step 1/2: katello:correct_repositories. This may take a long while.
2021-10-14 14:01:25 [DEBUG ] [root] Processing Repository 1/160: CentOS 7 Sofico (1)
2021-10-14 14:01:25 [DEBUG ] [root] Failed upgrade task: katello:correct_repositories, see logs for more information.
2021-10-14 14:01:25 [DEBUG ] [root] =============================================
2021-10-14 14:01:25 [DEBUG ] [root] Upgrade Step 2/2: katello:clean_backend_objects. This may take a long while.
2021-10-14 14:01:25 [DEBUG ] [root] 0 orphaned consumer id(s) found in candlepin.
2021-10-14 14:01:25 [DEBUG ] [root] Candlepin orphaned consumers: []
2021-10-14 14:01:25 [DEBUG ] [post] Hook /usr/share/foreman-installer/hooks/post/30-upgrade.rb returned nil
2021-10-14 14:01:25 [DEBUG ] [post] Hook /usr/share/foreman-installer/hooks/post/34-pulpcore_directory_layout.rb returned nil
2021-10-14 14:01:25 [DEBUG ] [post] Hook /usr/share/foreman-installer/hooks/post/99-post_install_message.rb returned nil
2021-10-14 14:01:25 [DEBUG ] [post] Hook /usr/share/foreman-installer/hooks/post/99-version_locking.rb returned nil
2021-10-14 14:01:25 [INFO  ] [post] All hooks in group post finished
2021-10-14 14:01:25 [DEBUG ] [root] Exit with status code: 2 (signal was 2)

katello:correct_repositories failed.

Oh…seems like it failed on the very first repo…Could you also post the logs in /var/log/foreman-installer/ for this upgrade…

Hi @sajha

See the attachment:
katello.20211014-143721.log (2.6 MB)

Kind regards

Damn, i have the same issue.
katello-4.2.0.1-1.el7.noarch

Is there are any fix / workaround for this?

Seems like i have all relevant packages installed

[root@katello]# rpm -qa | grep pulp
tfm-rubygem-pulp_deb_client-2.13.0-1.el7.noarch
tfm-rubygem-pulp_docker_client-4.0.0b6.dev01562331743-1.el7.noarch
tfm-rubygem-pulpcore_client-3.14.1-1.el7.noarch
tfm-rubygem-pulp_file_client-1.8.1-1.el7.noarch
python3-pulpcore-3.14.7-1.el7.noarch
python3-pulp-certguard-1.4.0-1.el7.noarch
python3-pulp-file-1.8.2-1.el7.noarch
pulp-client-1.0-5.noarch
tfm-rubygem-pulp_ansible_client-0.8.0-1.el7.noarch
tfm-rubygem-smart_proxy_pulp-3.1.0-1.fm2_6.el7.noarch
pulpcore-selinux-1.2.6-1.el7.x86_64
tfm-rubygem-pulp_container_client-2.7.0-1.el7.noarch
python3-pulp-rpm-3.14.5-1.el7.noarch
python3-pulp-deb-2.14.1-1.el7.noarch
python3-pulp-ansible-0.9.0-1.el7.noarch
tfm-rubygem-pulp_rpm_client-3.13.3-1.el7.noarch
python3-pulp-container-2.8.1-0.1.el7.noarch
tfm-rubygem-pulp_certguard_client-1.4.0-1.el7.noarch
tfm-rubygem-pulp_python_client-3.4.0-1.el7.noarch

@cave , @sasskinn12 : Could you check the enabled content types for your server at Infrastructure> server > Services tab.

Also, could you provide the log for the sync failure. At a glance it looks like the option pulp3_skip_publication is not defined for yum repos but that has worked in the past so I am not sure if that’s the issue.

I have filed this : Bug #33705: After Katello upgrade 4.1 to 4.2 Repo Syncs/ Publish are no longer working - Katello - Foreman cause it seems like the setting is not being set for a few content types but is being checked regardless. I didn’t see any errors in the installer log.

Could you also check sudo systemctl status pulp*

There are no any content type Unter infrastructure → smart proxies → smart proxy → Services. It is also impossible to choose them when creating repo from scratch.

The logs for sync says the same eg.

2021-10-18T15:59:26 [E|bac|59662014] undefined method `pulp3_skip_publication' for nil:NilClass (NoMethodError)
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/orchestration/repository/generate_metadata.rb:8:in `plan'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:515:in `block (3 levels) in execute_plan'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/backend_services_check.rb:23:in `plan'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:9:in `plan'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:36:in `plan'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:36:in `plan'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/load_setting_values.rb:15:in `plan'
 59662014 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'

Is seems like pulpcore and its plugins are not supported or Katello does not include them …

Regarding that pulp is working fine.

[root@katello sass]# systemctl status pulp*
● pulpcore-worker@7.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:10 EEST; 1h 3min ago
 Main PID: 11511 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@7.service
           └─11511 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:10 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:16 katello.srv.big.local pulpcore-worker-7[11511]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:16 katello.srv.big.local pulpcore-worker-7[11511]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11511@katello.srv.big.local' discovered

● pulpcore-worker@6.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:09 EEST; 1h 3min ago
 Main PID: 11492 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@6.service
           └─11492 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:09 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:17 katello.srv.big.local pulpcore-worker-6[11492]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:17 katello.srv.big.local pulpcore-worker-6[11492]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11492@katello.srv.big.local' discovered

● pulpcore-worker@3.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:09 EEST; 1h 3min ago
 Main PID: 11434 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@3.service
           └─11434 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:09 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:15 katello.srv.big.local pulpcore-worker-3[11434]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:15 katello.srv.big.local pulpcore-worker-3[11434]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11434@katello.srv.big.local' discovered

● pulpcore-worker@8.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:10 EEST; 1h 3min ago
 Main PID: 11530 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@8.service
           └─11530 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:10 katello.srv.big.local systemd[1]: Stopped Pulp Worker.
Oct 18 14:58:10 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:17 katello.srv.big.local pulpcore-worker-8[11530]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:17 katello.srv.big.local pulpcore-worker-8[11530]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11530@katello.srv.big.local' discovered

● pulpcore-content.service - Pulp Content App
   Loaded: loaded (/etc/systemd/system/pulpcore-content.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:13 EEST; 1h 3min ago
 Main PID: 11615 (gunicorn)
   Status: "Gunicorn arbiter booted"
   CGroup: /system.slice/pulpcore-content.service
           ├─11615 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11652 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11656 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11657 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11665 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11666 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11667 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11668 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11669 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11670 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11671 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11672 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11673 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11676 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11679 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11680 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           ├─11681 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
           └─11688 /usr/bin/python3 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -

Oct 18 15:32:03 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:03 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/DBaaS/Postgres-13/repodata/repomd.xml HTTP/1.1" 200 2527 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:03 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:03 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/Elastic_stack/Elastic_7_-_x86_64/repodata/repomd.xml HTTP/1.1" 200 2230 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:03 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:03 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/Elastic_stack/Elastic_curator/repodata/repomd.xml HTTP/1.1" 200 2219 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:03 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:03 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/Elastic_stack/Elastic_stack/repodata/repomd.xml HTTP/1.1" 200 2230 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:03 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:03 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/Elastic_stack/Elastic_tools1/repodata/repomd.xml HTTP/1.1" 200 2211 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:03 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:03 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/Katello_Agent/client_RHEL_7Server_x86_64/repodata/repomd.xml HTTP/1.1" 200 2523 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:04 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:04 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/OVirt/oVirt_Guest_Agents_6/repodata/repomd.xml HTTP/1.1" 200 2211 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:04 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:04 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/OVirt/oVirt_Guest_Agents_7/repodata/repomd.xml HTTP/1.1" 200 2214 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:04 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:04 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/Puppet_6_Agent/Puppet_6_EL7/repodata/repomd.xml HTTP/1.1" 200 2228 "-" "urlgrabber/3.10 yum/3.4.3"
Oct 18 15:32:04 katello.srv.big.local pulpcore-content[11615]: [18/Oct/2021:12:32:04 +0000] "GET /pulp/content/BB/Production/CENTOS-7-SOE/custom/ZABBIX/Zabbix_7_x86_64/repodata/repomd.xml HTTP/1.1" 200 2225 "-" "urlgrabber/3.10 yum/3.4.3"

● pulpcore-api.service - Pulp API Server
   Loaded: loaded (/etc/systemd/system/pulpcore-api.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:11 EEST; 1h 3min ago
 Main PID: 11554 (gunicorn)
   Status: "Gunicorn arbiter booted"
   CGroup: /system.slice/pulpcore-api.service
           ├─11554 /usr/bin/python3 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 1 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s"
           └─11588 /usr/bin/python3 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 1 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s"

Oct 18 14:58:11 katello.srv.big.local systemd[1]: Started Pulp API Server.
Oct 18 14:58:11 katello.srv.big.local pulpcore-api[11554]: [2021-10-18 14:58:11 +0300] [11588] [INFO] Booting worker with pid: 11588
Oct 18 15:24:11 katello.srv.big.local pulpcore-api[11554]: pulp [eb3d7dcd-f952-417b-a50d-a32b5f0cbd7f]:  - - [18/Oct/2021:12:24:11 +0000] "GET /pulp/api/v3/status HTTP/1.1" 301 0 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"
Oct 18 15:24:12 katello.srv.big.local pulpcore-api[11554]: pulp [eb3d7dcd-f952-417b-a50d-a32b5f0cbd7f]:  - - [18/Oct/2021:12:24:12 +0000] "GET /pulp/api/v3/status/ HTTP/1.1" 200 3590 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"
Oct 18 15:50:42 katello.srv.big.local pulpcore-api[11554]: pulp [e3d9261a-2570-478a-b874-272ad9ef9bba]:  - - [18/Oct/2021:12:50:42 +0000] "GET /pulp/api/v3/status HTTP/1.1" 301 0 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"
Oct 18 15:50:42 katello.srv.big.local pulpcore-api[11554]: pulp [e3d9261a-2570-478a-b874-272ad9ef9bba]:  - - [18/Oct/2021:12:50:42 +0000] "GET /pulp/api/v3/status/ HTTP/1.1" 200 3590 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"
Oct 18 15:55:20 katello.srv.big.local pulpcore-api[11554]: pulp [03525bce-f85e-4cd1-9329-f4e6cf2909d4]:  - - [18/Oct/2021:12:55:20 +0000] "GET /pulp/api/v3/status HTTP/1.1" 301 0 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"
Oct 18 15:55:20 katello.srv.big.local pulpcore-api[11554]: pulp [03525bce-f85e-4cd1-9329-f4e6cf2909d4]:  - - [18/Oct/2021:12:55:20 +0000] "GET /pulp/api/v3/status/ HTTP/1.1" 200 3590 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"
Oct 18 15:59:26 katello.srv.big.local pulpcore-api[11554]: pulp [59662014-e2f1-492c-a216-230e42ac4f5a]:  - - [18/Oct/2021:12:59:26 +0000] "GET /pulp/api/v3/status HTTP/1.1" 301 0 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"
Oct 18 15:59:26 katello.srv.big.local pulpcore-api[11554]: pulp [59662014-e2f1-492c-a216-230e42ac4f5a]:  - - [18/Oct/2021:12:59:26 +0000] "GET /pulp/api/v3/status/ HTTP/1.1" 200 3590 "-" "rest-client/2.0.2 (linux x86_64) ruby/2.7.3p183"

● pulpcore-worker@2.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:08 EEST; 1h 3min ago
 Main PID: 11413 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@2.service
           └─11413 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:08 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:13 katello.srv.big.local pulpcore-worker-2[11413]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:13 katello.srv.big.local pulpcore-worker-2[11413]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11413@katello.srv.big.local' discovered

● pulpcore-worker@1.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:08 EEST; 1h 3min ago
 Main PID: 11395 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@1.service
           └─11395 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:08 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:13 katello.srv.big.local pulpcore-worker-1[11395]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:13 katello.srv.big.local pulpcore-worker-1[11395]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11395@katello.srv.big.local' discovered

● pulpcore-worker@5.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:09 EEST; 1h 3min ago
 Main PID: 11473 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@5.service
           └─11473 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:09 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:16 katello.srv.big.local pulpcore-worker-5[11473]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:16 katello.srv.big.local pulpcore-worker-5[11473]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11473@katello.srv.big.local' discovered

● pulpcore-worker@4.service - Pulp Worker
   Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2021-10-18 14:58:09 EEST; 1h 3min ago
 Main PID: 11453 (pulpcore-worker)
   CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@4.service
           └─11453 /usr/bin/python3 /usr/bin/pulpcore-worker

Oct 18 14:58:09 katello.srv.big.local systemd[1]: Started Pulp Worker.
Oct 18 14:58:15 katello.srv.big.local pulpcore-worker-4[11453]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Oct 18 14:58:15 katello.srv.big.local pulpcore-worker-4[11453]: pulp [None]: pulpcore.tasking.worker_watcher:INFO: New worker '11453@katello.srv.big.local' discovered

Indeed it is the same issue i have i think. :frowning:

@sajha

image

Sync log attached:
sync.log (183.6 KB)

If refreshing the smart proxy doesn’t fix it, what does curling the /features endpoint on your smart proxies show?

Could you:

curl https://`hostname`/pulp/api/v3/status/

running on the katello server itself

@Justin_Sherrill

The result is:

{
  "versions": [
    {
      "component": "core",
      "version": "3.14.7"
    },
    {
      "component": "pulp_2to3_migration",
      "version": "0.12.0"
    },
    {
      "component": "rpm",
      "version": "3.14.5"
    },
    {
      "component": "file",
      "version": "1.8.2"
    },
    {
      "component": "deb",
      "version": "2.14.1"
    },
    {
      "component": "container",
      "version": "2.8.1"
    },
    {
      "component": "certguard",
      "version": "1.4.0"
    },
    {
      "component": "ansible",
      "version": "0.9.0"
    }
  ],
  "online_workers": [
    {
      "pulp_href": "/pulp/api/v3/workers/10b068da-a510-4722-97ad-2b73a9ec10de/",
      "pulp_created": "2021-10-19T05:56:35.613666Z",
      "name": "907@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:31.489761Z"
    },
    {
      "pulp_href": "/pulp/api/v3/workers/692ee393-7ddb-4f25-8f40-aa8a753081e4/",
      "pulp_created": "2021-10-19T05:56:35.197160Z",
      "name": "881@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:31.493526Z"
    },
    {
      "pulp_href": "/pulp/api/v3/workers/cf296cfb-57c4-42b3-aa5f-1d4f5b2e88ee/",
      "pulp_created": "2021-10-19T05:56:31.774738Z",
      "name": "943@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.085649Z"
    },
    {
      "pulp_href": "/pulp/api/v3/workers/6863a1fc-2949-4eb3-b66c-dc3eb2c6ac3b/",
      "pulp_created": "2021-10-19T05:56:31.701422Z",
      "name": "914@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.089609Z"
    },
    {
      "pulp_href": "/pulp/api/v3/workers/431ffa06-1e4f-492c-8e92-54967b504022/",
      "pulp_created": "2021-10-19T05:56:31.481336Z",
      "name": "887@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.090444Z"
    },
    {
      "pulp_href": "/pulp/api/v3/workers/a5aa44d9-cda8-4ad9-906e-ab57fb6f6030/",
      "pulp_created": "2021-10-19T05:56:32.671967Z",
      "name": "915@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.441459Z"
    },
    {
      "pulp_href": "/pulp/api/v3/workers/3b137d32-99fb-42c7-a05b-3265b400bfc5/",
      "pulp_created": "2021-10-19T05:56:32.744217Z",
      "name": "942@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.441654Z"
    },
    {
      "pulp_href": "/pulp/api/v3/workers/c62c60d7-9617-40db-8c19-53c44655f760/",
      "pulp_created": "2021-10-19T05:56:34.393166Z",
      "name": "936@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:36.225341Z"
    }
  ],
  "online_content_apps": [
    {
      "name": "1231@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.496084Z"
    },
    {
      "name": "1277@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.490838Z"
    },
    {
      "name": "1245@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.491417Z"
    },
    {
      "name": "1276@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.485988Z"
    },
    {
      "name": "1225@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.486005Z"
    },
    {
      "name": "1229@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.489665Z"
    },
    {
      "name": "1226@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.493742Z"
    },
    {
      "name": "1223@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.492529Z"
    },
    {
      "name": "1281@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.495373Z"
    },
    {
      "name": "1227@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.496339Z"
    },
    {
      "name": "1286@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.496729Z"
    },
    {
      "name": "1236@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.486525Z"
    },
    {
      "name": "1278@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.490729Z"
    },
    {
      "name": "1220@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.492645Z"
    },
    {
      "name": "1263@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.487165Z"
    },
    {
      "name": "1274@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.491257Z"
    },
    {
      "name": "1230@c7foreman.example.com",
      "last_heartbeat": "2021-10-19T06:00:33.493902Z"
    }
  ],
  "database_connection": {
    "connected": true
  },
  "redis_connection": null,
  "storage": {
    "total": 501389189120,
    "used": 178342518784,
    "free": 297506086912
  }
}

Kind regards

Hi all,

Please show me the following Foreman console command outputs:

Katello::RepositoryTypeManager.enabled_repository_types

and

Katello::RepositoryTypeManager.defined_repository_types

This is the result of the consol commands:

foreman-rake console
Loading production environment (Rails 6.0.3.7)
irb(main):001:0> Katello::RepositoryTypeManager.enabled_repository_types => {}

irb(main):002:0> Katello::RepositoryTypeManager.defined_repository_types
=> {"ansible_collection"=>#<Katello::RepositoryType:0x000000000a3356a8 @id=:ansible_collection, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000d740da8 @model_class=Katello::AnsibleCollection(id: integer, pulp_id: string, checksum: string, name: string, namespace: string, version: string, created_at: datetime, updated_at: datetime, description: text), @priority=99, @pulp2_service_class=nil, @pulp3_service_class=Katello::Pulp3::AnsibleCollection, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>], @generic_remote_options=[], @pulp3_skip_publication=true, @pulp3_service_class=Katello::Pulp3::Repository::AnsibleCollection, @pulp3_api_class=Katello::Pulp3::Api::AnsibleCollection, @pulp3_plugin="ansible">, "deb"=>#<Katello::RepositoryType:0x000000000d77dc58 @id=:deb, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000ba3c3d8 @model_class=Katello::Deb(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, architecture: string, filename: string, checksum: string, version_sortable: string, description: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean, migrated_pulp3_href: string), @priority=99, @pulp2_service_class=Katello::Pulp::Deb, @pulp3_service_class=Katello::Pulp3::Deb, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>], @generic_remote_options=[], @pulp3_service_class=Katello::Pulp3::Repository::Apt, @pulp3_api_class=Katello::Pulp3::Api::Apt, @pulp3_plugin="deb", @service_class=Katello::Pulp::Repository::Deb, @metadata_publish_matching_check=true, @default_managed_content_type_class=Katello::Deb(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, architecture: string, filename: string, checksum: string, version_sortable: string, description: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean, migrated_pulp3_href: string)>, "docker"=>#<Katello::RepositoryType:0x000000000bec3cd0 @id=:docker, @allow_creation_by_user=true, @unique_content_per_repo=true, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000da4d6b8 @model_class=Katello::DockerManifest(id: integer, schema_version: integer, pulp_id: string, digest: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=1, @pulp2_service_class=Katello::Pulp::DockerManifest, @pulp3_service_class=Katello::Pulp3::DockerManifest, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>, #<Katello::RepositoryType::ContentType:0x000000000d8cf4a8 @model_class=Katello::DockerManifestList(id: integer, schema_version: integer, pulp_id: string, digest: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=2, @pulp2_service_class=Katello::Pulp::DockerManifestList, @pulp3_service_class=Katello::Pulp3::DockerManifestList, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000d7b60f8 @model_class=Katello::DockerTag(id: integer, name: string, created_at: datetime, updated_at: datetime, pulp_id: string, docker_taggable_id: integer, docker_taggable_type: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=3, @pulp2_service_class=Katello::Pulp::DockerTag, @pulp3_service_class=Katello::Pulp3::DockerTag, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000d76e6b8 @model_class=Katello::DockerBlob, @priority=4, @pulp2_service_class=Katello::Pulp::DockerBlob, @pulp3_service_class=Katello::Pulp3::DockerBlob, @index=false, @index_on_pulp3=true, @uploadable=false, @removable=false>], @generic_remote_options=[], @pulp3_skip_publication=true, @pulp3_service_class=Katello::Pulp3::Repository::Docker, @pulp3_api_class=Katello::Pulp3::Api::Docker, @pulp3_plugin="container", @service_class=Katello::Pulp::Repository::Docker, @default_managed_content_type_class=Katello::DockerManifest(id: integer, schema_version: integer, pulp_id: string, digest: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean)>, "file"=>#<Katello::RepositoryType:0x000000000d6d6188 @id=:file, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000cabcff0 @model_class=Katello::FileUnit(id: integer, created_at: datetime, updated_at: datetime, pulp_id: string, name: string, checksum: string, path: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::FileUnit, @pulp3_service_class=Katello::Pulp3::FileUnit, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>], @generic_remote_options=[], @pulp3_service_class=Katello::Pulp3::Repository::File, @pulp3_api_class=Katello::Pulp3::Api::File, @pulp3_plugin="file", @service_class=Katello::Pulp::Repository::File, @default_managed_content_type_class=Katello::FileUnit(id: integer, created_at: datetime, updated_at: datetime, pulp_id: string, name: string, checksum: string, path: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean)>, "ostree"=>#<Katello::RepositoryType:0x000000000ca30d20 @id=:ostree, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000c815fe0 @model_class=Katello::OstreeBranch(id: integer, version: string, name: string, pulp_id: string, commit: string, created_at: datetime, updated_at: datetime), @priority=99, @pulp2_service_class=Katello::Pulp::OstreeBranch, @pulp3_service_class=nil, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>], @generic_remote_options=[], @service_class=Katello::Pulp::Repository::Ostree, @default_managed_content_type_class=Katello::OstreeBranch(id: integer, version: string, name: string, pulp_id: string, commit: string, created_at: datetime, updated_at: datetime)>, "python"=>#<Katello::RepositoryType:0x000000000ad2fa00 @id=:python, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::GenericContentType:0x000000000aa95060 @model_class=Katello::GenericContentUnit(id: integer, name: string, version: string, pulp_id: string, content_type: string, created_at: datetime, updated_at: datetime), @priority=99, @pulp3_service_class=Katello::Pulp3::GenericContentUnit, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true, @pulp3_api=PulpPythonClient::ContentPackagesApi, @pulp3_model=PulpPythonClient::PythonPythonPackageContent, @content_type="python_package">], @generic_remote_options=[#<Katello::RepositoryType::GenericRemoteOption:0x000000000acacb78 @name=:includes, @type=Array, @description="A list containing project specifiers for Python packages to include.">, #<Katello::RepositoryType::GenericRemoteOption:0x000000000acac998 @name=:excludes, @type=Array, @description="A list containing project specifiers for Python packages to exclude.">, #<Katello::RepositoryType::GenericRemoteOption:0x000000000acac8d0 @name=:package_types, @type=Array, @description="A list of package types to sync for Python content. Leave blank to get every package type.">], @pulp3_service_class=Katello::Pulp3::Repository::Generic, @pulp3_api_class=Katello::Pulp3::Api::Generic, @pulp3_plugin="python", @partial_repo_path="", @repositories_api_class=PulpPythonClient::RepositoriesPythonApi, @api_class=PulpPythonClient::ApiClient, @configuration_class=PulpPythonClient::Configuration, @remotes_api_class=PulpPythonClient::RemotesPythonApi, @distributions_api_class=PulpPythonClient::DistributionsPypiApi, @repository_versions_api_class=PulpPythonClient::RepositoriesPythonVersionsApi, @remote_class=PulpPythonClient::PythonPythonRemote, @repo_sync_url_class=PulpPythonClient::RepositorySyncURL, @client_module_class=PulpPythonClient, @distribution_class=PulpPythonClient::PythonPythonDistribution, @publication_class=PulpPythonClient::PythonPythonPublication, @publications_api_class=PulpPythonClient::PublicationsPypiApi, @model_name=#<Proc:0x000000000acac7e0 /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/lib/katello/repository_types/python.rb:27 (lambda)>, @model_version=#<Proc:0x000000000acac718 /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/lib/katello/repository_types/python.rb:28 (lambda)>>, "yum"=>#<Katello::RepositoryType:0x000000000a8da770 @id=:yum, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000a78b0e0 @model_class=Katello::Rpm(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, release: string, arch: string, epoch: string, filename: string, sourcerpm: string, checksum: string, version_sortable: string, release_sortable: string, summary: string, nvra: string, modular: boolean, migrated_pulp3_href: string, evr: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=1, @pulp2_service_class=Katello::Pulp::Rpm, @pulp3_service_class=Katello::Pulp3::Rpm, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>, #<Katello::RepositoryType::ContentType:0x000000000a763e78 @model_class=Katello::ModuleStream(id: integer, name: string, pulp_id: string, version: string, context: string, stream: string, arch: string, created_at: datetime, updated_at: datetime, description: text, summary: text, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=2, @pulp2_service_class=Katello::Pulp::ModuleStream, @pulp3_service_class=Katello::Pulp3::ModuleStream, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000a721758 @model_class=Katello::Erratum(id: integer, pulp_id: string, errata_id: string, created_at: datetime, updated_at: datetime, issued: date, updated: date, errata_type: string, severity: string, title: string, solution: text, description: text, summary: text, reboot_suggested: boolean, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=3, @pulp2_service_class=Katello::Pulp::Erratum, @pulp3_service_class=Katello::Pulp3::Erratum, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000a44e6c0 @model_class=Katello::PackageGroup(id: integer, name: string, pulp_id: string, description: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::PackageGroup, @pulp3_service_class=Katello::Pulp3::PackageGroup, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000a38b4e0 @model_class=Katello::YumMetadataFile(id: integer, pulp_id: string, checksum: string, name: string, repository_id: integer, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::YumMetadataFile, @pulp3_service_class=Katello::Pulp3::YumMetadataFile, @index=true, @index_on_pulp3=false, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000a2f1ae8 @model_class=Katello::Srpm(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, release: string, arch: string, epoch: string, filename: string, checksum: string, version_sortable: string, release_sortable: string, summary: string, nvra: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::Srpm, @pulp3_service_class=Katello::Pulp3::Srpm, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>, #<Katello::RepositoryType::ContentType:0x000000000a2d9178 @model_class=Katello::Distribution, @priority=4, @pulp2_service_class=Katello::Pulp::Distribution, @pulp3_service_class=Katello::Pulp3::Distribution, @index=false, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x0000000009d60160 @model_class=Katello::PackageCategory, @priority=4, @pulp2_service_class=Katello::Pulp::PackageCategory, @pulp3_service_class=nil, @index=false, @index_on_pulp3=true, @uploadable=false, @removable=false>], @generic_remote_options=[], @pulp3_service_class=Katello::Pulp3::Repository::Yum, @pulp3_api_class=Katello::Pulp3::Api::Yum, @pulp3_plugin="rpm", @service_class=Katello::Pulp::Repository::Yum, @metadata_publish_matching_check=true, @default_managed_content_type_class=Katello::Rpm(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, release: string, arch: string, epoch: string, filename: string, sourcerpm: string, checksum: string, version_sortable: string, release_sortable: string, summary: string, nvra: string, modular: boolean, migrated_pulp3_href: string, evr: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @index_additional_data_proc=#<Proc:0x0000000009d600e8 /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/lib/katello/repository_types/yum.rb:39>>}

Hi @iballou

Loading production environment (Rails 6.0.3.7)
irb(main):001:0> Katello::RepositoryTypeManager.enabled_repository_types
=> {}
irb(main):002:0> Katello::RepositoryTypeManager.defined_repository_types
=> {"deb"=>#<Katello::RepositoryType:0x0000000009db6b28 @id=:deb, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000c61bb68 @model_class=Katello::Deb(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, architecture: string, filename: string, checksum: string, version_sortable: string, description: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean, migrated_pulp3_href: string), @priority=99, @pulp2_service_class=Katello::Pulp::Deb, @pulp3_service_class=Katello::Pulp3::Deb, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>], @generic_remote_options=[], @service_class=Katello::Pulp::Repository::Deb, @pulp3_service_class=Katello::Pulp3::Repository::Apt, @pulp3_api_class=Katello::Pulp3::Api::Apt, @pulp3_plugin="deb", @metadata_publish_matching_check=true, @default_managed_content_type_class=Katello::Deb(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, architecture: string, filename: string, checksum: string, version_sortable: string, description: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean, migrated_pulp3_href: string)>, "file"=>#<Katello::RepositoryType:0x000000000c4fe000 @id=:file, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000c66d828 @model_class=Katello::FileUnit(id: integer, created_at: datetime, updated_at: datetime, pulp_id: string, name: string, checksum: string, path: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::FileUnit, @pulp3_service_class=Katello::Pulp3::FileUnit, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>], @generic_remote_options=[], @service_class=Katello::Pulp::Repository::File, @pulp3_service_class=Katello::Pulp3::Repository::File, @pulp3_api_class=Katello::Pulp3::Api::File, @pulp3_plugin="file", @default_managed_content_type_class=Katello::FileUnit(id: integer, created_at: datetime, updated_at: datetime, pulp_id: string, name: string, checksum: string, path: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean)>, "ansible_collection"=>#<Katello::RepositoryType:0x000000000c676ec8 @id=:ansible_collection, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000c0bf958 @model_class=Katello::AnsibleCollection(id: integer, pulp_id: string, checksum: string, name: string, namespace: string, version: string, created_at: datetime, updated_at: datetime, description: text), @priority=99, @pulp2_service_class=nil, @pulp3_service_class=Katello::Pulp3::AnsibleCollection, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>], @generic_remote_options=[], @pulp3_service_class=Katello::Pulp3::Repository::AnsibleCollection, @pulp3_api_class=Katello::Pulp3::Api::AnsibleCollection, @pulp3_plugin="ansible", @pulp3_skip_publication=true>, "docker"=>#<Katello::RepositoryType:0x000000000cc01b40 @id=:docker, @allow_creation_by_user=true, @unique_content_per_repo=true, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000bae5320 @model_class=Katello::DockerManifest(id: integer, schema_version: integer, pulp_id: string, digest: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=1, @pulp2_service_class=Katello::Pulp::DockerManifest, @pulp3_service_class=Katello::Pulp3::DockerManifest, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>, #<Katello::RepositoryType::ContentType:0x000000000d057b68 @model_class=Katello::DockerManifestList(id: integer, schema_version: integer, pulp_id: string, digest: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=2, @pulp2_service_class=Katello::Pulp::DockerManifestList, @pulp3_service_class=Katello::Pulp3::DockerManifestList, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000d0ca000 @model_class=Katello::DockerTag(id: integer, name: string, created_at: datetime, updated_at: datetime, pulp_id: string, docker_taggable_id: integer, docker_taggable_type: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=3, @pulp2_service_class=Katello::Pulp::DockerTag, @pulp3_service_class=Katello::Pulp3::DockerTag, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000d0ce1f0 @model_class=Katello::DockerBlob, @priority=4, @pulp2_service_class=Katello::Pulp::DockerBlob, @pulp3_service_class=Katello::Pulp3::DockerBlob, @index=false, @index_on_pulp3=true, @uploadable=false, @removable=false>], @generic_remote_options=[], @service_class=Katello::Pulp::Repository::Docker, @pulp3_service_class=Katello::Pulp3::Repository::Docker, @pulp3_api_class=Katello::Pulp3::Api::Docker, @pulp3_plugin="container", @default_managed_content_type_class=Katello::DockerManifest(id: integer, schema_version: integer, pulp_id: string, digest: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @pulp3_skip_publication=true>, "ostree"=>#<Katello::RepositoryType:0x000000000b1f0198 @id=:ostree, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000d10aad8 @model_class=Katello::OstreeBranch(id: integer, version: string, name: string, pulp_id: string, commit: string, created_at: datetime, updated_at: datetime), @priority=99, @pulp2_service_class=Katello::Pulp::OstreeBranch, @pulp3_service_class=nil, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>], @generic_remote_options=[], @service_class=Katello::Pulp::Repository::Ostree, @default_managed_content_type_class=Katello::OstreeBranch(id: integer, version: string, name: string, pulp_id: string, commit: string, created_at: datetime, updated_at: datetime)>, "python"=>#<Katello::RepositoryType:0x000000000d3daad8 @id=:python, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::GenericContentType:0x000000000d43e768 @model_class=Katello::GenericContentUnit(id: integer, name: string, version: string, pulp_id: string, content_type: string, created_at: datetime, updated_at: datetime), @priority=99, @pulp3_service_class=Katello::Pulp3::GenericContentUnit, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true, @pulp3_api=PulpPythonClient::ContentPackagesApi, @pulp3_model=PulpPythonClient::PythonPythonPackageContent, @content_type="python_package">], @generic_remote_options=[#<Katello::RepositoryType::GenericRemoteOption:0x000000000d412118 @name=:includes, @type=Array, @description="A list containing project specifiers for Python packages to include.">, #<Katello::RepositoryType::GenericRemoteOption:0x000000000d412050 @name=:excludes, @type=Array, @description="A list containing project specifiers for Python packages to exclude.">, #<Katello::RepositoryType::GenericRemoteOption:0x000000000d411f88 @name=:package_types, @type=Array, @description="A list of package types to sync for Python content. Leave blank to get every package type.">], @pulp3_service_class=Katello::Pulp3::Repository::Generic, @pulp3_api_class=Katello::Pulp3::Api::Generic, @pulp3_plugin="python", @partial_repo_path="", @repositories_api_class=PulpPythonClient::RepositoriesPythonApi, @api_class=PulpPythonClient::ApiClient, @configuration_class=PulpPythonClient::Configuration, @remotes_api_class=PulpPythonClient::RemotesPythonApi, @distributions_api_class=PulpPythonClient::DistributionsPypiApi, @repository_versions_api_class=PulpPythonClient::RepositoriesPythonVersionsApi, @remote_class=PulpPythonClient::PythonPythonRemote, @repo_sync_url_class=PulpPythonClient::RepositorySyncURL, @client_module_class=PulpPythonClient, @distribution_class=PulpPythonClient::PythonPythonDistribution, @publication_class=PulpPythonClient::PythonPythonPublication, @publications_api_class=PulpPythonClient::PublicationsPypiApi, @model_name=#<Proc:0x000000000d411f10 /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/lib/katello/repository_types/python.rb:27 (lambda)>, @model_version=#<Proc:0x000000000d411e48 /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/lib/katello/repository_types/python.rb:28 (lambda)>>, "yum"=>#<Katello::RepositoryType:0x000000000d447b60 @id=:yum, @allow_creation_by_user=true, @unique_content_per_repo=false, @content_types=[#<Katello::RepositoryType::ContentType:0x000000000a9b73c8 @model_class=Katello::Rpm(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, release: string, arch: string, epoch: string, filename: string, sourcerpm: string, checksum: string, version_sortable: string, release_sortable: string, summary: string, nvra: string, modular: boolean, migrated_pulp3_href: string, evr: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=1, @pulp2_service_class=Katello::Pulp::Rpm, @pulp3_service_class=Katello::Pulp3::Rpm, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>, #<Katello::RepositoryType::ContentType:0x000000000a99b8d0 @model_class=Katello::ModuleStream(id: integer, name: string, pulp_id: string, version: string, context: string, stream: string, arch: string, created_at: datetime, updated_at: datetime, description: text, summary: text, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=2, @pulp2_service_class=Katello::Pulp::ModuleStream, @pulp3_service_class=Katello::Pulp3::ModuleStream, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000d4b2028 @model_class=Katello::Erratum(id: integer, pulp_id: string, errata_id: string, created_at: datetime, updated_at: datetime, issued: date, updated: date, errata_type: string, severity: string, title: string, solution: text, description: text, summary: text, reboot_suggested: boolean, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=3, @pulp2_service_class=Katello::Pulp::Erratum, @pulp3_service_class=Katello::Pulp3::Erratum, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000a9374c0 @model_class=Katello::PackageGroup(id: integer, name: string, pulp_id: string, description: string, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::PackageGroup, @pulp3_service_class=Katello::Pulp3::PackageGroup, @index=true, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000d529678 @model_class=Katello::YumMetadataFile(id: integer, pulp_id: string, checksum: string, name: string, repository_id: integer, created_at: datetime, updated_at: datetime, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::YumMetadataFile, @pulp3_service_class=Katello::Pulp3::YumMetadataFile, @index=true, @index_on_pulp3=false, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000d54dd20 @model_class=Katello::Srpm(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, release: string, arch: string, epoch: string, filename: string, checksum: string, version_sortable: string, release_sortable: string, summary: string, nvra: string, migrated_pulp3_href: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @priority=99, @pulp2_service_class=Katello::Pulp::Srpm, @pulp3_service_class=Katello::Pulp3::Srpm, @index=true, @index_on_pulp3=true, @uploadable=true, @removable=true>, #<Katello::RepositoryType::ContentType:0x000000000d562888 @model_class=Katello::Distribution, @priority=4, @pulp2_service_class=Katello::Pulp::Distribution, @pulp3_service_class=Katello::Pulp3::Distribution, @index=false, @index_on_pulp3=true, @uploadable=false, @removable=false>, #<Katello::RepositoryType::ContentType:0x000000000a8d1d00 @model_class=Katello::PackageCategory, @priority=4, @pulp2_service_class=Katello::Pulp::PackageCategory, @pulp3_service_class=nil, @index=false, @index_on_pulp3=true, @uploadable=false, @removable=false>], @generic_remote_options=[], @service_class=Katello::Pulp::Repository::Yum, @pulp3_service_class=Katello::Pulp3::Repository::Yum, @pulp3_api_class=Katello::Pulp3::Api::Yum, @pulp3_plugin="rpm", @metadata_publish_matching_check=true, @default_managed_content_type_class=Katello::Rpm(id: integer, pulp_id: string, created_at: datetime, updated_at: datetime, name: string, version: string, release: string, arch: string, epoch: string, filename: string, sourcerpm: string, checksum: string, version_sortable: string, release_sortable: string, summary: string, nvra: string, modular: boolean, migrated_pulp3_href: string, evr: string, missing_from_migration: boolean, ignore_missing_from_migration: boolean), @index_additional_data_proc=#<Proc:0x000000000a8d1b98 /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/lib/katello/repository_types/yum.rb:39>>}
irb(main):003:0>

Thanks, here are some other things to try and show the output of:

::Katello::RepositoryTypeManager.find('yum')
::Katello::RepositoryTypeManager.find_defined('yum')
::Katello::RepositoryTypeManager.pulp3_plugin_installed?('yum')
::Katello::RepositoryTypeManager.instance_variable_get(:@pulp_primary)
::Katello::RepositoryTypeManager.instance_variable_get(:@pulp_primary).capabilities('Pulpcore')

Just for some context, Katello has switched from detecting repository types via the plugin configuration file to detecting which ones are installed on the main smart proxy. The commands above will give me a better idea about where the code is going wrong.