Missing required positional arguments and Could not lookup a publication_href for after migrating to 3.9.1

Problem:
Last week we upgraded to 3.9.1 and Katello 11. Now all syncs to our capsules fail with the message:
Last sync failed: synchronize() missing 4 required positional arguments: ‘remote_pk’, ‘repository_pk’, ‘mirror’, and ‘optimize’ Plus 335 more errors

When looking in the tasks the errors say:
Could not lookup a publication_href for repo 4419synchronize() missing 4 required positional arguments: ‘remote_pk’, ‘repository_pk’, ‘mirror’, and 'optimize’synchronize() missing 4 required positional arguments: ‘remote_pk’, ‘repository_pk’, ‘mirror’, and 'optimize’Could not lookup a publication_href for repo 1243 …

Expected outcome:
To have synchronization ot capsules work again

Foreman and Proxy versions:
Foreman 3.9.1
Proxy 3.9.1
Katello 4.11

Foreman and Proxy plugin versions:

Content

Version

3.2.0

Supported Content Types

  • ansible_collection
  • deb
  • docker
  • file
  • python
  • yum

Distribution and version:

Other relevant data:
Our setup is configured with deb repo’s, oracle linux repo’s and custom repo’s with no upstream, where we manually upload packages

Same Problem
Same Error

Red Hat 8.9 latest updates from 5.2.2024
Foreman 3.9.1
Katello 4.11

We try the update on 5.2.2024.
we upgraded from
Foreman 3.8
Katello 4.10
which is working fine on this repo.

Foreman “Running Setps output” on Failed sync:
(rpm sync from https://packages.grafana.com/oss/rpm)

Actions::Pulp3::Repository::Sync
Input:
{"repo_id"=>272,
 "smart_proxy_id"=>1,
 "options"=>{},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}
Output:
{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/018d7943-2080-73d3-a6db-a8a8245864cb/",
    "pulp_created"=>"2024-02-05T12:34:18.881+00:00",
    "state"=>"failed",
    "name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
    "logging_cid"=>"08810484-2294-423e-bb94-80e69b9a2988",
    "created_by"=>"/pulp/api/v3/users/2/",
    "started_at"=>"2024-02-05T12:34:18.979+00:00",
    "finished_at"=>"2024-02-05T12:34:18.984+00:00",
    "error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.9/site-packages/pulpcore/tasking/tasks.py\", line 66, in _execute_task\n",
      "description"=>
       "synchronize() missing 5 required positional arguments: 'remote_pk', 'repository_pk', 'sync_policy', 'skip_types', and 'optimize'"},
    "worker"=>"/pulp/api/v3/workers/018d78f6-1dc8-7286-af92-f698990146a4/",
    "child_tasks"=>[],
    "progress_reports"=>[],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/rpm/rpm/51ad799e-8885-48b6-92b8-91281aeae675/",
      "shared:/pulp/api/v3/remotes/rpm/rpm/662494c2-590d-4849-9f7e-4e9327fd8062/",
      "shared:/pulp/api/v3/domains/018d78f4-3432-782e-a905-142ee33384f9/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>1, "failed"=>1}}
Exception:
Katello::Errors::Pulp3Error: synchronize() missing 5 required positional arguments: 'remote_pk', 'repository_pk', 'sync_policy', 'skip_types', and 'optimize'
Backtrace:
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/pulp3/abstract_async_task.rb:108:in `block in check_for_errors'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in `each'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in `check_for_errors'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/pulp3/abstract_async_task.rb:162:in `poll_external_task'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action/polling.rb:22:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action/cancellable.rb:14:in `run'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:589:in `block (3 levels) in execute_run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:32:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/usr/share/gems/gems/katello-4.11.0/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/usr/share/gems/gems/katello-4.11.0/app/lib/actions/middleware/remote_action.rb:16:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/usr/share/gems/gems/activesupport-6.1.7.6/lib/active_support/execution_wrapper.rb:91:in `wrap'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action/progress.rb:17:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/load_setting_values.rb:20:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:32:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'
/usr/share/gems/gems/foreman-tasks-9.0.1/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/middleware/world.rb:31:in `execute'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:588:in `block (2 levels) in execute_run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:587:in `catch'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:587:in `block in execute_run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:490:in `block in with_error_handling'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:490:in `catch'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:490:in `with_error_handling'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:582:in `execute_run'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/action.rb:303:in `execute'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/director.rb:94:in `execute'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/executors.rb:18:in `run_user_code'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/usr/share/gems/gems/dynflow-1.8.2/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:202:in `execute_job'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:170:in `block (2 levels) in process'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/middleware/chain.rb:172:in `invoke'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:169:in `block in process'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:136:in `block (6 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_retry.rb:113:in `local'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:135:in `block (5 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq.rb:44:in `block in <module:Sidekiq>'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:131:in `block (4 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:263:in `stats'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:126:in `block (3 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_logger.rb:13:in `call'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:125:in `block (2 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_retry.rb:80:in `global'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:124:in `block in dispatch'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_logger.rb:39:in `prepare'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:123:in `dispatch'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:168:in `process'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:78:in `process_one'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:68:in `run'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/component.rb:8:in `watchdog'
/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/component.rb:17:in `block in safe_thread'
/usr/share/gems/gems/logging-2.3.1/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
Action:
Actions::Pulp3::Repository::Sync
Input:
{"repo_id"=>272,
 "smart_proxy_id"=>1,
 "options"=>{},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}
Output:
{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/018d7943-2080-73d3-a6db-a8a8245864cb/",
    "pulp_created"=>"2024-02-05T12:34:18.881+00:00",
    "state"=>"failed",
    "name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
    "logging_cid"=>"08810484-2294-423e-bb94-80e69b9a2988",
    "created_by"=>"/pulp/api/v3/users/2/",
    "started_at"=>"2024-02-05T12:34:18.979+00:00",
    "finished_at"=>"2024-02-05T12:34:18.984+00:00",
    "error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.9/site-packages/pulpcore/tasking/tasks.py\", line 66, in _execute_task\n",
      "description"=>
       "synchronize() missing 5 required positional arguments: 'remote_pk', 'repository_pk', 'sync_policy', 'skip_types', and 'optimize'"},
    "worker"=>"/pulp/api/v3/workers/018d78f6-1dc8-7286-af92-f698990146a4/",
    "child_tasks"=>[],
    "progress_reports"=>[],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/rpm/rpm/51ad799e-8885-48b6-92b8-91281aeae675/",
      "shared:/pulp/api/v3/remotes/rpm/rpm/662494c2-590d-4849-9f7e-4e9327fd8062/",
      "shared:/pulp/api/v3/domains/018d78f4-3432-782e-a905-142ee33384f9/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>1, "failed"=>1}}
Action:
Actions::Pulp3::Repository::SaveVersion
Input:
{"repository_id"=>272,
 "tasks"=>Step(6).output[:pulp_tasks],
 "repository_details"=>nil,
 "force_fetch_version"=>nil,
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}
Output:
{}
Action:
Actions::Pulp3::Repository::CreatePublication
Input:
{"repository_id"=>272,
 "smart_proxy_id"=>1,
 "contents_changed"=>Step(9).output[:contents_changed],
 "skip_publication_creation"=>Step(9).output[:publication_provided],
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}
Output:
{}
Action:
Actions::Pulp3::Repository::SavePublication
Input:
{"repository_id"=>272,
 "tasks"=>Step(12).output,
 "contents_changed"=>Step(9).output[:contents_changed],
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}
Output:
{}
Action:
Actions::Pulp3::Orchestration::Repository::Sync
Input:
{"subaction_output"=>Step(9).output,
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{"repository"=>{"id"=>272, "name"=>"grafana", "label"=>"grafana"},
 "product"=>
  {"id"=>75,
   "name"=>"Sonstiges",
   "label"=>"Sonstiges",
   "cp_id"=>"175846344732"},
 "provider"=>{"id"=>7, "name"=>"Anonymous"},
 "organization"=>{"id"=>6, "name"=>"WSTW", "label"=>"WSTW"},
 "services_checked"=>["pulp3"],
 "id"=>272,
 "sync_result"=>Step(19).output,
 "skip_metadata_check"=>false,
 "validate_contents"=>false,
 "contents_changed"=>Step(19).output[:contents_changed],
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{"repository"=>{"id"=>272, "name"=>"grafana", "label"=>"grafana"},
 "product"=>
  {"id"=>75,
   "name"=>"Sonstiges",
   "label"=>"Sonstiges",
   "cp_id"=>"175846344732"},
 "provider"=>{"id"=>7, "name"=>"Anonymous"},
 "organization"=>{"id"=>6, "name"=>"WSTW", "label"=>"WSTW"},
 "services_checked"=>["pulp3"],
 "id"=>272,
 "sync_result"=>Step(19).output,
 "skip_metadata_check"=>false,
 "validate_contents"=>false,
 "contents_changed"=>Step(19).output[:contents_changed],
 "current_request_id"=>"08810484-2294-423e-bb94-80e69b9a2988",
 "current_timezone"=>"Europe/Vienna",
 "current_organization_id"=>6,
 "current_location_id"=>2,
 "current_user_id"=>7}

Currently it is fixed on our foreman. It was a double issue on our side.

First, the migrate DB failed due to the fact foreman-installer tried to resolve localhost against the IPv6 entry in /etc/hosts. We removed that and the migrate DB succeeded.

Second: for some reason packages were missing from our foreman_plugins_3_9 repository. After resyncing it in our organization, a few packages were updated like rubygem-smart_proxy_pulp. It seems there is no dependency between foreman 3.9 and rubygem-smart_proxy_pulp.

==============================================.
Package Arch Version

Upgrading:
rubygem-smart_proxy_container_gateway noarch 1.1.0-1.fm3_9.el8
rubygem-smart_proxy_pulp noarch 3.2.0-3.fm3_9.el8
Installing dependencies:
rubygem-activesupport noarch 6.1.7.6-1.el8
rubygem-i18n noarch 1.14.1-1.el8
rubygem-minitest noarch 5.13.0-139.module+el8.8.0+18745+f1bef313
rubygem-tzinfo noarch 2.0.6-1.el8
rubygem-zeitwerk noarch 2.6.12-1.el8

So what we did:
on Foreman server:

  • disable Ipv6 entry localhost in /etc/hosts
  • run foreman-installer without options
  • foreman-maintain service restart

on Capsule level

  • ensure all foreman repo’s are synced again
  • dnf update
  • foreman-installer
  • foreman-maintain service restart
  • run complete sync to your capsule

Hello

2nd try and upgrade was ok.
I think we forget to dissable the pulpcore modules.