Problem:
CentOS 7 x64 repo fails to sync with a warning, “Pulp task error” is shown in the Errors field and “Katello::Errors::Pulp3Error: Pulp task error” is shown in the Exceptions field. All other repos are syncing fine. I tried recreating the repo from scratch but still the same error. If I watch the sync task progress, I can see it pick up a package count and metadata, but after it fails I am back to have 0 packages and errata in the repo.
Expected outcome:
Repo should sync
Foreman and Proxy versions:
3.0.0
Foreman and Proxy plugin versions:
| foreman-tasks | The goal of this plugin is to unify the way of showing task statuses across the Foreman instance. It defines Task model for keeping the information about the tasks and Lock for assigning the tasks to resources. The locking allows dealing with preventing multiple colliding tasks to be run on the same resource. It also optionally provides Dynflow infrastructure for using it for managing the tasks. | Ivan Nečas | 5.1.0 |
|---|---|---|---|
| foreman_ansible | Ansible integration with Foreman | Daniel Lobato Garcia | 6.4.1 |
| foreman_puppet | Allow assigning Puppet environmets and classes to the Foreman Hosts. | Ondřej Ezr and Shira Maximov | 1.0.3 |
| foreman_remote_execution | A plugin bringing remote execution to the Foreman, completing the config management functionality with remote management functionality. | Foreman Remote Execution team | 4.7.0 |
| katello | Katello adds Content and Subscription Management to Foreman. For this it relies on Candlepin and Pulp. | N/A | 4.2.0.1.rc3 |
Distribution and version:
Other relevant data:
Action:
Actions::Pulp3::Repository::Sync
Input:
{“repo_id”=>64,
“smart_proxy_id”=>1,
“options”=>{},
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{“pulp_tasks”=>
[{“pulp_href”=>"/pulp/api/v3/tasks/81375b12-d4d3-434d-ad53-7abb8d8305b9/",
“pulp_created”=>“2021-10-13T04:00:12.674+00:00”,
“state”=>“failed”,
“name”=>“pulp_rpm.app.tasks.synchronizing.synchronize”,
“logging_cid”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“started_at”=>“2021-10-13T04:00:12.756+00:00”,
“finished_at”=>“2021-10-13T04:09:56.178+00:00”,
“error”=>
{“traceback”=>
" File “/usr/lib/python3.6/site-packages/pulpcore/tasking/pulpcore_worker.py”, line 317, in _perform_task\n" +
" result = func(*args, **kwargs)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py”, line 489, in synchronize\n" +
" version = dv.create()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py”, line 151, in create\n" +
" loop.run_until_complete(pipeline)\n" +
" File “/usr/lib64/python3.6/asyncio/base_events.py”, line 484, in run_until_complete\n" +
" return future.result()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 225, in create_pipeline\n" +
" await asyncio.gather(*futures)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 43, in call\n" +
" await self.run()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 174, in run\n" +
" pb.done += task.result() # download_count\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 200, in _handle_content_unit\n" +
" await asyncio.gather(*downloaders_for_content)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/models.py”, line 89, in download\n" +
" download_result = await downloader.run(extra_data=self.extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/http.py”, line 258, in run\n" +
" return await download_wrapper()\n" +
" File “/usr/lib/python3.6/site-packages/backoff/_async.py”, line 133, in retry\n" +
" ret = await target(*args, **kwargs)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/http.py”, line 256, in download_wrapper\n" +
" return await self._run(extra_data=extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py”, line 108, in _run\n" +
" to_return = await self._handle_response(response)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/http.py”, line 210, in _handle_response\n" +
" chunk = await response.content.read(1048576) # 1 megabyte\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/streams.py”, line 380, in read\n" +
" await self._wait(“read”)\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/streams.py”, line 306, in _wait\n" +
" await waiter\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/helpers.py”, line 656, in exit\n" +
" raise asyncio.TimeoutError from None\n",
“description”=>""},
“worker”=>"/pulp/api/v3/workers/4bb3d9f6-3c79-4c43-83ed-1155b6cb5e7c/",
“child_tasks”=>,
“progress_reports”=>
[{“message”=>“Downloading Metadata Files”,
“code”=>“sync.downloading.metadata”,
“state”=>“completed”,
“done”=>10},
{“message”=>“Associating Content”,
“code”=>“associating.content”,
“state”=>“canceled”,
“done”=>3000},
{“message”=>“Parsed Packages”,
“code”=>“sync.parsing.packages”,
“state”=>“canceled”,
“done”=>6006},
{“message”=>“Downloading Artifacts”,
“code”=>“sync.downloading.artifacts”,
“state”=>“failed”,
“done”=>250}],
“created_resources”=>,
“reserved_resources_record”=>
["/pulp/api/v3/remotes/rpm/rpm/64076c78-4b1e-49f0-960c-be5fa1d2f050/",
“/pulp/api/v3/repositories/rpm/rpm/829902f9-3ba1-4846-82e8-0285fbe7f1e5/”]}],
“create_version”=>true,
“task_groups”=>,
“poll_attempts”=>{“total”=>51, “failed”=>1}}
Exception:
Katello::Errors::Pulp3Error: Pulp task error
Backtrace:
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/pulp3/abstract_async_task.rb:108:in block in check_for_errors' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/pulp3/abstract_async_task.rb:106:in each’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/pulp3/abstract_async_task.rb:106:in check_for_errors' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/pulp3/abstract_async_task.rb:139:in poll_external_task’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/polling.rb:100:in poll_external_task_with_rescue' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/polling.rb:22:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/cancellable.rb:14:in run' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/pulp3/abstract_async_task.rb:10:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:572:in block (3 levels) in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:32:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/middleware/remote_action.rb:16:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/middleware/remote_action.rb:40:in block in as_remote_user' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/models/katello/concerns/user_extensions.rb:21:in cp_config’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/middleware/remote_action.rb:27:in as_cp_user' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/middleware/remote_action.rb:39:in as_remote_user’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1.rc3/app/lib/actions/middleware/remote_action.rb:16:in run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/rails_executor_wrap.rb:14:in block in run' /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/execution_wrapper.rb:88:in wrap’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/rails_executor_wrap.rb:13:in run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/progress.rb:31:in with_progress_calculation' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/progress.rb:17:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/load_setting_values.rb:20:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:52:in restore_current_request_id' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:44:in restore_curent_timezone' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in restore_current_taxonomies' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:32:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:54:in restore_curent_user' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/world.rb:31:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:571:in block (2 levels) in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:570:in catch’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:570:in block in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in block in with_error_handling’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in catch' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in with_error_handling’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:565:in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:286:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in block (2 levels) in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract.rb:167:in with_meta_calculation’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in block in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in open_action’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/director.rb:94:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in block (2 levels) in perform' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors.rb:18:in run_user_code’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in block in perform' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in with_telemetry’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in perform' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/serialization.rb:27:in perform’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:192:in execute_job' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:165:in block (2 levels) in process’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:133:in invoke’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:164:in block in process' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:137:in block (6 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:109:in local' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:136:in block (5 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq.rb:37:in block in <module:Sidekiq>' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:132:in block (4 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:250:in stats' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:127:in block (3 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_logger.rb:8:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:126:in block (2 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:74:in global' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:125:in block in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:48:in with_context' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:42:in with_job_hash_context’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:124:in dispatch' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:163:in process’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:83:in process_one' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:71:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:16:in watchdog' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:25:in block in safe_thread’
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context’
Action:
Actions::Pulp3::Repository::Sync
Input:
{“repo_id”=>64,
“smart_proxy_id”=>1,
“options”=>{},
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{“pulp_tasks”=>
[{“pulp_href”=>"/pulp/api/v3/tasks/81375b12-d4d3-434d-ad53-7abb8d8305b9/",
“pulp_created”=>“2021-10-13T04:00:12.674+00:00”,
“state”=>“failed”,
“name”=>“pulp_rpm.app.tasks.synchronizing.synchronize”,
“logging_cid”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“started_at”=>“2021-10-13T04:00:12.756+00:00”,
“finished_at”=>“2021-10-13T04:09:56.178+00:00”,
“error”=>
{“traceback”=>
" File “/usr/lib/python3.6/site-packages/pulpcore/tasking/pulpcore_worker.py”, line 317, in _perform_task\n" +
" result = func(*args, **kwargs)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py”, line 489, in synchronize\n" +
" version = dv.create()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py”, line 151, in create\n" +
" loop.run_until_complete(pipeline)\n" +
" File “/usr/lib64/python3.6/asyncio/base_events.py”, line 484, in run_until_complete\n" +
" return future.result()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 225, in create_pipeline\n" +
" await asyncio.gather(*futures)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 43, in call\n" +
" await self.run()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 174, in run\n" +
" pb.done += task.result() # download_count\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 200, in _handle_content_unit\n" +
" await asyncio.gather(*downloaders_for_content)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/models.py”, line 89, in download\n" +
" download_result = await downloader.run(extra_data=self.extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/http.py”, line 258, in run\n" +
" return await download_wrapper()\n" +
" File “/usr/lib/python3.6/site-packages/backoff/_async.py”, line 133, in retry\n" +
" ret = await target(*args, **kwargs)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/http.py”, line 256, in download_wrapper\n" +
" return await self._run(extra_data=extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py”, line 108, in _run\n" +
" to_return = await self._handle_response(response)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/http.py”, line 210, in _handle_response\n" +
" chunk = await response.content.read(1048576) # 1 megabyte\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/streams.py”, line 380, in read\n" +
" await self._wait(“read”)\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/streams.py”, line 306, in wait\n" +
" await waiter\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/helpers.py”, line 656, in exit\n" +
" raise asyncio.TimeoutError from None\n",
“description”=>""},
“worker”=>"/pulp/api/v3/workers/4bb3d9f6-3c79-4c43-83ed-1155b6cb5e7c/",
“child_tasks”=>[],
“progress_reports”=>
[{“message”=>“Downloading Metadata Files”,
“code”=>“sync.downloading.metadata”,
“state”=>“completed”,
“done”=>10},
{“message”=>“Associating Content”,
“code”=>“associating.content”,
“state”=>“canceled”,
“done”=>3000},
{“message”=>“Parsed Packages”,
“code”=>“sync.parsing.packages”,
“state”=>“canceled”,
“done”=>6006},
{“message”=>“Downloading Artifacts”,
“code”=>“sync.downloading.artifacts”,
“state”=>“failed”,
“done”=>250}],
“created_resources”=>[],
“reserved_resources_record”=>
["/pulp/api/v3/remotes/rpm/rpm/64076c78-4b1e-49f0-960c-be5fa1d2f050/",
“/pulp/api/v3/repositories/rpm/rpm/829902f9-3ba1-4846-82e8-0285fbe7f1e5/”]}],
“create_version”=>true,
“task_groups”=>[],
“poll_attempts”=>{“total”=>51, “failed”=>1}}
Action:
Actions::Pulp3::Repository::SaveVersion
Input:
{“repository_id”=>64,
“tasks”=>Step(6).output[:pulp_tasks],
“repository_details”=>nil,
“force_fetch_version”=>nil,
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Pulp3::Repository::CreatePublication
Input:
{“repository_id”=>64,
“smart_proxy_id”=>1,
“contents_changed”=>Step(9).output[:contents_changed],
“skip_publication_creation”=>Step(9).output[:publication_provided],
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Pulp3::Repository::SavePublication
Input:
{“repository_id”=>64,
“tasks”=>Step(12).output,
“contents_changed”=>Step(9).output[:contents_changed],
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Pulp3::Repository::SaveDistributionReferences
Input:
{“repository_id”=>64,
“smart_proxy_id”=>1,
“tasks”=>Step(16).output,
“contents_changed”=>Step(9).output[:contents_changed],
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Pulp3::Orchestration::Repository::Sync
Input:
{“subaction_output”=>Step(9).output,
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Katello::Repository::IndexContent
Input:
{“id”=>64,
“contents_changed”=>Step(19).output[:contents_changed],
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{“repo”=>64,
“last_updated”=>“2021-10-13 00:00:10 -0400”,
“contents_changed”=>Step(19).output[:contents_changed],
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{“repo”=>64,
“last_updated”=>“2021-10-13 00:00:10 -0400”,
“contents_changed”=>Step(19).output[:contents_changed],
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{“repository”=>
{“id”=>64, “name”=>“CentOS 7 x64 - Base”, “label”=>"CentOS_7_x64-Base"},
“product”=>
{“id”=>7,
“name”=>“CentOS 7 x64”,
“label”=>“CentOS_7_x64”,
“cp_id”=>“804097856358”},
“provider”=>{“id”=>3, “name”=>“Anonymous”},
“organization”=>{“id”=>3, “name”=>"…", “label”=>"…"},
“services_checked”=>[“pulp3”],
“id”=>64,
“sync_result”=>Step(19).output,
“skip_metadata_check”=>false,
“validate_contents”=>false,
“contents_changed”=>Step(19).output[:contents_changed],
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{“repository”=>
{“id”=>64, “name”=>“CentOS 7 x64 - Base”, “label”=>"CentOS_7_x64-_Base"},
“product”=>
{“id”=>7,
“name”=>“CentOS 7 x64”,
“label”=>“CentOS_7_x64”,
“cp_id”=>“804097856358”},
“provider”=>{“id”=>3, “name”=>“Anonymous”},
“organization”=>{“id”=>3, “name”=>"…", “label”=>"…"},
“services_checked”=>[“pulp3”],
“id”=>64,
“sync_result”=>Step(19).output,
“skip_metadata_check”=>false,
“validate_contents”=>false,
“contents_changed”=>Step(19).output[:contents_changed],
“current_request_id”=>“ff54339a-58a7-479b-b7f4-6dcfc0e72d46”,
“current_timezone”=>“America/New_York”,
“current_organization_id”=>3,
“current_location_id”=>nil,
“current_user_id”=>1}
Output:
{}