Pulp3 - ansible collection sync error

Support
,
1

Problem:
When trying to sync ansible collections from https://galaxy.ansible.com stops with warning:

AnsibleNamespaceMetadata() got unexpected keyword arguments: 'users' (Katello::Errors::Pulp3Error)

Expected outcome:
Syncing of ansible collections works

Foreman and Proxy versions:
foreman-3.8.0

Foreman and Proxy plugin versions:
katello-4.10.0

Distribution and version:
AlmaLinux release 8.8 (Sapphire Caracal)

Other relevant data:

The error from /var/log/foreman/production.log

2023-11-17T10:43:14 [I|app|ffdf542a] Started POST "/katello/api/v2/repositories/2000/sync?organization_id=1" for 1.2.3.4 at 2023-11-17 10:43:14 +0100
2023-11-17T10:43:14 [I|app|ffdf542a] Processing by Katello::Api::V2::RepositoriesController#sync as HTML
2023-11-17T10:43:14 [I|app|ffdf542a]   Parameters: {"id"=>"2000", "organization_id"=>"1", "api_version"=>"v2", "repository"=>{"id"=>"2000"}}
2023-11-17T10:43:14 [I|bac|ffdf542a] Task {label: , execution_plan_id: f7cfe57b-ec2f-4671-a861-1c031ab85327} state changed: pending 
2023-11-17T10:43:14 [I|bac|ffdf542a] Task {label: Actions::Katello::Repository::Sync, id: 6ae5785a-559d-49c0-a020-adf7c571134b, execution_plan_id: f7cfe57b-ec2f-4671-a861-1c031ab85327} state changed: planning 
2023-11-17T10:43:15 [I|bac|ffdf542a] Task {label: Actions::Katello::Repository::Sync, id: 6ae5785a-559d-49c0-a020-adf7c571134b, execution_plan_id: f7cfe57b-ec2f-4671-a861-1c031ab85327} state changed: planned 
2023-11-17T10:43:15 [I|app|ffdf542a]   Rendered /usr/share/gems/gems/katello-4.10.0/app/views/katello/api/v2/repositories/sync.json.rabl within katello/api/v2/layouts/resource (Duration: 34.4ms | Allocations: 19382)
2023-11-17T10:43:15 [I|app|ffdf542a]   Rendered layout /usr/share/gems/gems/katello-4.10.0/app/views/katello/api/v2/layouts/resource.json.erb (Duration: 37.3ms | Allocations: 21981)
2023-11-17T10:43:15 [I|app|ffdf542a] Completed 202 Accepted in 533ms (Views: 35.0ms | ActiveRecord: 59.3ms | Allocations: 112848)
2023-11-17T10:43:15 [I|bac|ffdf542a] Task {label: Actions::Katello::Repository::Sync, id: 6ae5785a-559d-49c0-a020-adf7c571134b, execution_plan_id: f7cfe57b-ec2f-4671-a861-1c031ab85327} state changed: running 
2023-11-17T10:43:43 [E|bac|ffdf542a] AnsibleNamespaceMetadata() got unexpected keyword arguments: 'users' (Katello::Errors::Pulp3Error)
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:108:in `block in check_for_errors'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in `each'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in `check_for_errors'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:162:in `poll_external_task'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/polling.rb:22:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/cancellable.rb:14:in `run'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:589:in `block (3 levels) in execute_run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:32:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
 ffdf542a | /usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:16:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
 ffdf542a | /usr/share/gems/gems/activesupport-6.1.7.6/lib/active_support/execution_wrapper.rb:91:in `wrap'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/progress.rb:17:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/load_setting_values.rb:20:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:32:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'
 ffdf542a | /usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/world.rb:31:in `execute'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:588:in `block (2 levels) in execute_run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:587:in `catch'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:587:in `block in execute_run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `block in with_error_handling'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `catch'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `with_error_handling'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:582:in `execute_run'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:303:in `execute'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/director.rb:94:in `execute'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors.rb:18:in `run_user_code'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
 ffdf542a | /usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
 ffdf542a | [ sidekiq ]
 ffdf542a | [ concurrent-ruby ]
2023-11-17T10:43:45 [I|bac|ffdf542a] Task {label: Actions::Katello::Repository::Sync, id: 6ae5785a-559d-49c0-a020-adf7c571134b, execution_plan_id: f7cfe57b-ec2f-4671-a861-1c031ab85327} state changed: stopped  result: warning

I’ve been seeing this issue since upgrading foreman 3.7 to 3.8 and katello 4.9 to 4.10, has anyone seen this before?

Thanks,
Adrian

2

Having the same issue here.

Trying to synchronize all content from galaxy.ansible.com.

How to reproduce:

  1. Install Foreman 3.8 / Katello 4.10
  2. Create product “ansible”
  3. Create repo “galaxy” with config:
    Upstream URL: https://galaxy.ansible.com/api/
    Type: ansible_collection
    Mirroring Policy: Content Only
  4. Synchronize
6: Actions::Pulp3::Repository::Sync (skipped) [ 2194.68s / 19.62s ]
Queue: default

Started at: 2023-11-21 14:16:44 UTC

Ended at: 2023-11-21 14:53:18 UTC

Real time: 2194.68s

Execution time (excluding suspended state): 19.62s

Input:

---
repo_id: 1
smart_proxy_id: 1
options: {}
remote_user: admin
remote_cp_user: admin
current_request_id: 01fcf053-e879-4a98-8eef-ff3c5aaa4b7f
current_timezone: Atlantic/Reykjavik
current_organization_id: 1
current_location_id: 2
current_user_id: 4
Output:

---
pulp_tasks:
- pulp_href: "/pulp/api/v3/tasks/018bf23d-9806-7aeb-ac10-7b536d924e7b/"
  pulp_created: '2023-11-21T14:16:44.807+00:00'
  state: failed
  name: pulp_ansible.app.tasks.collections.sync
  logging_cid: 01fcf053-e879-4a98-8eef-ff3c5aaa4b7f
  created_by: "/pulp/api/v3/users/1/"
  started_at: '2023-11-21T14:16:44.857+00:00'
  finished_at: '2023-11-21T14:53:13.038+00:00'
  error:
    traceback: |2
        File "/usr/lib/python3.9/site-packages/pulpcore/tasking/tasks.py", line 66, in _execute_task
          result = func(*args, **kwargs)
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 191, in sync
          repo_version = d_version.create()
        File "/usr/lib/python3.9/site-packages/pulpcore/plugin/stages/declarative_version.py", line 161, in create
          loop.run_until_complete(pipeline)
        File "/usr/lib64/python3.9/asyncio/base_events.py", line 647, in run_until_complete
          return future.result()
        File "/usr/lib/python3.9/site-packages/pulpcore/plugin/stages/api.py", line 220, in create_pipeline
          await asyncio.gather(*futures)
        File "/usr/lib/python3.9/site-packages/pulpcore/plugin/stages/api.py", line 41, in __call__
          await self.run()
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 1072, in run
          await asyncio.gather(*tasks)
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 1012, in _find_all_collections
          await asyncio.gather(*tasks)
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 866, in _fetch_collection_metadata
          await self._fetch_paginated_collection_metadata(
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 809, in _fetch_paginated_collection_metadata
          await asyncio.gather(*tasks)
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 598, in _fetch_collection_version_metadata
          await self._add_collection_version(api_version, collection_version_url, metadata)
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 688, in _add_collection_version
          if await self._add_namespace(namespace, namespace_sha):
        File "/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py", line 741, in _add_namespace
          namespace = AnsibleNamespaceMetadata(**namespace)
        File "/usr/lib/python3.9/site-packages/django_lifecycle/mixins.py", line 61, in __init__
          super().__init__(*args, **kwargs)
        File "/usr/lib/python3.9/site-packages/django/db/models/base.py", line 567, in __init__
          raise TypeError(
    description: 'AnsibleNamespaceMetadata() got unexpected keyword arguments: ''users'''
  worker: "/pulp/api/v3/workers/018bf221-5a40-7ec4-b038-0bcfd0086cbb/"
  child_tasks: []
  progress_reports:
  - message: Downloading Artifacts
    code: sync.downloading.artifacts
    state: canceled
    done: 4186
  - message: Downloading Artifacts
    code: sync.downloading.artifacts
    state: canceled
    done: 3583
  - message: Associating Content
    code: associating.content
    state: canceled
    done: 2991
  - message: Parsing CollectionVersion Metadata
    code: sync.parsing.metadata
    state: failed
    total: 2776
    done: 19123
  created_resources: []
  reserved_resources_record:
  - "/pulp/api/v3/repositories/ansible/ansible/018bf23d-7573-7962-b28f-67221c905997/"
  - shared:/pulp/api/v3/remotes/ansible/collection/018bf23d-737b-774e-959c-056907d1c612/
create_version: true
task_groups: []
poll_attempts:
  total: 156
  failed: 1
Chunked output:

--- []
Error:

Katello::Errors::Pulp3Error

AnsibleNamespaceMetadata() got unexpected keyword arguments: 'users'

---
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:108:in
  `block in check_for_errors'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in
  `each'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in
  `check_for_errors'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:162:in
  `poll_external_task'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/polling.rb:22:in `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/cancellable.rb:14:in `run'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:10:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:589:in `block (3 levels)
  in execute_run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:32:in `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:16:in
  `block in run'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:40:in
  `block in as_remote_user'"
- "/usr/share/gems/gems/katello-4.10.0/app/models/katello/concerns/user_extensions.rb:21:in
  `cp_config'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:27:in
  `as_cp_user'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:39:in
  `as_remote_user'"
- "/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:16:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/rails_executor_wrap.rb:14:in
  `block in run'"
- "/usr/share/gems/gems/activesupport-6.1.7.6/lib/active_support/execution_wrapper.rb:91:in
  `wrap'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/rails_executor_wrap.rb:13:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/progress.rb:17:in `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/load_setting_values.rb:20:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in
  `block in run'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_request_id.rb:52:in
  `restore_current_request_id'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in
  `block in run'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_timezone.rb:44:in
  `restore_curent_timezone'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
  `block in run'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in
  `restore_current_taxonomies'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:32:in `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_user.rb:15:in
  `block in run'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_user.rb:54:in
  `restore_curent_user'"
- "/usr/share/gems/gems/foreman-tasks-8.2.0/app/lib/actions/middleware/keep_current_user.rb:15:in
  `run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/world.rb:31:in `execute'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:588:in `block (2 levels)
  in execute_run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:587:in `catch'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:587:in `block in execute_run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `block in with_error_handling'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `catch'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `with_error_handling'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:582:in `execute_run'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:303:in `execute'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in
  `block (2 levels) in execute'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract.rb:167:in
  `with_meta_calculation'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in
  `block in execute'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in
  `open_action'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in
  `execute'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/director.rb:94:in `execute'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in
  `block (2 levels) in perform'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors.rb:18:in `run_user_code'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in
  `block in perform'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in
  `with_telemetry'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in
  `perform'"
- "/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/serialization.rb:27:in
  `perform'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:196:in `execute_job'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:164:in `block (2 levels)
  in process'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/middleware/chain.rb:133:in `invoke'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:163:in `block in process'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:136:in `block (6 levels)
  in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_retry.rb:112:in `local'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:135:in `block (5 levels)
  in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq.rb:39:in `block in <module:Sidekiq>'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:131:in `block (4 levels)
  in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:257:in `stats'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:126:in `block (3 levels)
  in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_logger.rb:13:in `call'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:125:in `block (2 levels)
  in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_retry.rb:79:in `global'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:124:in `block in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/logger.rb:11:in `with'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_logger.rb:33:in `prepare'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:123:in `dispatch'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:162:in `process'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:78:in `process_one'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:68:in `run'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/util.rb:43:in `watchdog'"
- "/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/util.rb:52:in `block in safe_thread'"
- "/usr/share/gems/gems/logging-2.3.1/lib/logging/diagnostic_context.rb:474:in `block
  in create_with_logging_context'"

Installed Packages
candlepin-4.3.1-1.el8.noarch
candlepin-selinux-4.3.1-1.el8.noarch
foreman-3.8.0-1.el8.noarch
foreman-cli-3.8.0-1.el8.noarch
foreman-debug-3.8.0-1.el8.noarch
foreman-dynflow-sidekiq-3.8.0-1.el8.noarch
foreman-installer-3.8.0-2.el8.noarch
foreman-installer-katello-3.8.0-2.el8.noarch
foreman-postgresql-3.8.0-1.el8.noarch
foreman-proxy-3.8.0-1.el8.noarch
foreman-release-3.8.0-1.el8.noarch
foreman-selinux-3.8.0-1.el8.noarch
foreman-service-3.8.0-1.el8.noarch
katello-4.10.0-1.el8.noarch
katello-certs-tools-2.9.0-2.el8.noarch
katello-client-bootstrap-1.7.9-2.el8.noarch
katello-common-4.10.0-1.el8.noarch
katello-debug-4.10.0-1.el8.noarch
katello-repos-4.10.0-1.el8.noarch
katello-selinux-5.0.2-1.el8.noarch
pulpcore-selinux-1.3.3-1.el8.x86_64
python39-pulp-ansible-0.18.1-1.el8.noarch
python39-pulp-certguard-1.6.5-1.el8.noarch
python39-pulp-cli-0.21.2-1.el8.noarch
python39-pulp-container-2.15.2-1.el8.noarch
python39-pulp-deb-3.0.0-1.el8.noarch
python39-pulp-file-1.14.3-1.el8.noarch
python39-pulp-glue-0.21.2-1.el8.noarch
python39-pulp-python-3.10.0-1.el8.noarch
python39-pulp-rpm-3.22.6-1.el8.noarch
python39-pulpcore-3.28.19-1.el8.noarch
rubygem-foreman-tasks-8.2.0-1.fm3_8.el8.noarch
rubygem-foreman_maintain-1.3.5-1.el8.noarch
rubygem-foreman_remote_execution-11.1.0-1.fm3_8.el8.noarch
rubygem-hammer_cli-3.8.0-1.el8.noarch
rubygem-hammer_cli_foreman-3.8.0-1.el8.noarch
rubygem-hammer_cli_foreman_remote_execution-0.2.3-1.fm3_7.el8.noarch
rubygem-hammer_cli_foreman_tasks-0.0.19-1.fm3_7.el8.noarch
rubygem-hammer_cli_katello-1.11.0-0.1.pre.master.20230905173948git1fa5f0c.el8.noarch
rubygem-katello-4.10.0-1.el8.noarch
rubygem-pulp_ansible_client-0.18.0-1.el8.noarch
rubygem-pulp_certguard_client-1.6.5-1.el8.noarch
rubygem-pulp_container_client-2.15.2-1.el8.noarch
rubygem-pulp_deb_client-3.0.0-1.el8.noarch
rubygem-pulp_file_client-1.14.3-1.el8.noarch
rubygem-pulp_ostree_client-2.1.1-1.el8.noarch
rubygem-pulp_python_client-3.10.0-1.el8.noarch
rubygem-pulp_rpm_client-3.22.3-1.el8.noarch
rubygem-pulpcore_client-3.28.11-1.el8.noarch
rubygem-smart_proxy_pulp-3.2.0-3.fm3_3.el8.noarch
3

I am seeing the same thing. I have Foreman 3.8 and Katello 4.10 installed.

Action:

Actions::Pulp3::Repository::Sync

Input:

{"repo_id"=>202,
 "smart_proxy_id"=>1,
 "options"=>{},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"f307c8f9-2d9e-4edc-9f7b-992aa87df60d",
 "current_timezone"=>"America/New_York",
 "current_organization_id"=>4,
 "current_location_id"=>3,
 "current_user_id"=>5}

Output:

{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/018c17e9-9638-7d31-8ca5-6625f55173c5/",
    "pulp_created"=>"2023-11-28T21:50:33.528+00:00",
    "state"=>"failed",
    "name"=>"pulp_ansible.app.tasks.collections.sync",
    "logging_cid"=>"f307c8f9-2d9e-4edc-9f7b-992aa87df60d",
    "created_by"=>"/pulp/api/v3/users/1/",
    "started_at"=>"2023-11-28T21:50:33.569+00:00",
    "finished_at"=>"2023-11-28T21:51:00.448+00:00",
    "error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.9/site-packages/pulpcore/tasking/tasks.py\", line 66, in _execute_task\n" +
       "    result = func(*args, **kwargs)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py\", line 191, in sync\n" +
       "    repo_version = d_version.create()\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulpcore/plugin/stages/declarative_version.py\", line 161, in create\n" +
       "    loop.run_until_complete(pipeline)\n" +
       "  File \"/usr/lib64/python3.9/asyncio/base_events.py\", line 647, in run_until_complete\n" +
       "    return future.result()\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulpcore/plugin/stages/api.py\", line 220, in create_pipeline\n" +
       "    await asyncio.gather(*futures)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulpcore/plugin/stages/api.py\", line 41, in __call__\n" +
       "    await self.run()\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py\", line 1072, in run\n" +
       "    await asyncio.gather(*tasks)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py\", line 866, in _fetch_collection_metadata\n" +
       "    await self._fetch_paginated_collection_metadata(\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py\", line 809, in _fetch_paginated_collection_metadata\n" +
       "    await asyncio.gather(*tasks)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py\", line 598, in _fetch_collection_version_metadata\n" +
       "    await self._add_collection_version(api_version, collection_version_url, metadata)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py\", line 688, in _add_collection_version\n" +
       "    if await self._add_namespace(namespace, namespace_sha):\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_ansible/app/tasks/collections.py\", line 741, in _add_namespace\n" +
       "    namespace = AnsibleNamespaceMetadata(**namespace)\n" +
       "  File \"/usr/lib/python3.9/site-packages/django_lifecycle/mixins.py\", line 61, in __init__\n" +
       "    super().__init__(*args, **kwargs)\n" +
       "  File \"/usr/lib/python3.9/site-packages/django/db/models/base.py\", line 567, in __init__\n" +
       "    raise TypeError(\n",
      "description"=>
       "AnsibleNamespaceMetadata() got unexpected keyword arguments: 'users'"},
    "worker"=>"/pulp/api/v3/workers/018c1397-9d60-7e66-8f8a-a5c8f3e46c53/",
    "child_tasks"=>[],
    "progress_reports"=>
     [{"message"=>"Parsing CollectionVersion Metadata",
       "code"=>"sync.parsing.metadata",
       "state"=>"failed",
       "total"=>558,
       "done"=>468},
      {"message"=>"Downloading Artifacts",
       "code"=>"sync.downloading.artifacts",
       "state"=>"canceled",
       "done"=>0},
      {"message"=>"Downloading Artifacts",
       "code"=>"sync.downloading.artifacts",
       "state"=>"canceled",
       "done"=>0},
      {"message"=>"Associating Content",
       "code"=>"associating.content",
       "state"=>"canceled",
       "done"=>0}],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/ansible/ansible/018c17e9-6b86-7e8c-8b34-c2bba7ea00c3/",
      "shared:/pulp/api/v3/remotes/ansible/collection/018c17e9-6a45-7b25-ab5e-a7c73a29097f/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>18, "failed"=>1}}

Exception:

Katello::Errors::Pulp3Error: AnsibleNamespaceMetadata() got unexpected keyword arguments: 'users'

Backtrace:

/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:108:in `block in check_for_errors'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in `each'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:106:in `check_for_errors'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:162:in `poll_external_task'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/polling.rb:22:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/cancellable.rb:14:in `run'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:589:in `block (3 levels) in execute_run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:32:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/usr/share/gems/gems/katello-4.10.0/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/usr/share/gems/gems/katello-4.10.0/app/lib/actions/middleware/remote_action.rb:16:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/usr/share/gems/gems/activesupport-6.1.7.6/lib/active_support/execution_wrapper.rb:91:in `wrap'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action/progress.rb:17:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/load_setting_values.rb:20:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:32:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'
/usr/share/gems/gems/foreman-tasks-8.3.3/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/middleware/world.rb:31:in `execute'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:588:in `block (2 levels) in execute_run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:587:in `catch'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:587:in `block in execute_run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `block in with_error_handling'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `catch'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:490:in `with_error_handling'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:582:in `execute_run'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/action.rb:303:in `execute'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/director.rb:94:in `execute'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors.rb:18:in `run_user_code'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/usr/share/gems/gems/dynflow-1.8.0/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:196:in `execute_job'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:164:in `block (2 levels) in process'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/middleware/chain.rb:133:in `invoke'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:163:in `block in process'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:136:in `block (6 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_retry.rb:112:in `local'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:135:in `block (5 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq.rb:39:in `block in <module:Sidekiq>'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:131:in `block (4 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:257:in `stats'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:126:in `block (3 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_logger.rb:13:in `call'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:125:in `block (2 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_retry.rb:79:in `global'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:124:in `block in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/logger.rb:11:in `with'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_logger.rb:33:in `prepare'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:123:in `dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:162:in `process'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:78:in `process_one'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:68:in `run'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/util.rb:43:in `watchdog'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/util.rb:52:in `block in safe_thread'
/usr/share/gems/gems/logging-2.3.1/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
4

I’ve managed to fix this issue by upgrading to foreman 3.9 and katello 4.11.
After upgrading, the ansible collections repository synced successfully, no other things required.

For reference, the documentation I’ve used: Upgrading Foreman to 3.9

1 Like