Why the sync task always warning?

Hi,every one:

My sync task never success, every time it raises this error:

Exception:
Katello::Errors::Pulp3Error: Response payload is not completed

Why ?

any expert can help me ?
I am really distraught about it. :sob: :sob: :sob:

Can you show the Errors page? 3rd tab.

OK, please refer:

Action:
Actions::Pulp3::Repository::Sync
Input:
{“repo_id”=>13,
“smart_proxy_id”=>1,
“options”=>{“source_url”=>nil},
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{“pulp_tasks”=>
[{“pulp_href”=>"/pulp/api/v3/tasks/0f0b2d6e-c7fe-4673-be45-cce598101124/",
“pulp_created”=>“2020-12-30T11:34:10.731+00:00”,
“state”=>“failed”,
“name”=>“pulp_rpm.app.tasks.synchronizing.synchronize”,
“started_at”=>“2020-12-30T11:34:10.966+00:00”,
“finished_at”=>“2020-12-30T11:39:17.952+00:00”,
“error”=>
{“traceback”=>
" File “/usr/lib/python3.6/site-packages/rq/worker.py”, line 936, in perform_job\n" +
" rv = job.perform()\n" +
" File “/usr/lib/python3.6/site-packages/rq/job.py”, line 684, in perform\n" +
" self._result = self._execute()\n" +
" File “/usr/lib/python3.6/site-packages/rq/job.py”, line 690, in _execute\n" +
" return self.func(*self.args, **self.kwargs)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py”, line 266, in synchronize\n" +
" dv.create()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py”, line 148, in create\n" +
" loop.run_until_complete(pipeline)\n" +
" File “/usr/lib64/python3.6/asyncio/base_events.py”, line 484, in run_until_complete\n" +
" return future.result()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 225, in create_pipeline\n" +
" await asyncio.gather(*futures)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 43, in call\n" +
" await self.run()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 152, in run\n" +
" pb.done += task.result() # download_count\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 178, in _handle_content_unit\n" +
" await asyncio.gather(*downloaders_for_content)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/models.py”, line 88, in download\n" +
" download_result = await downloader.run(extra_data=self.extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/base.py”, line 227, in run\n" +
" return await self._run(extra_data=extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py”, line 88, in _run\n" +
" self.raise_for_status(response)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py”, line 68, in raise_for_status\n" +
" response.raise_for_status()\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/client_reqrep.py”, line 1005, in raise_for_status\n" +
" headers=self.headers,\n",
“description”=>
“504, message=‘Gateway Time-out’, url=URL(‘http://mirrors.163.com/fedora/releases/33/Everything/x86_64/debug/tree/Packages/s/SDL2_mixer-debugsource-2.0.4-7.fc33.x86_64.rpm’)”},
“worker”=>"/pulp/api/v3/workers/ccce425d-37be-4f65-9910-1bb31335694c/",
“child_tasks”=>,
“progress_reports”=>
[{“message”=>“Downloading Artifacts”,
“code”=>“downloading.artifacts”,
“state”=>“failed”,
“done”=>506},
{“message”=>“Parsed Packages”,
“code”=>“parsing.packages”,
“state”=>“canceled”,
“total”=>31121,
“done”=>4005},
{“message”=>“Downloading Metadata Files”,
“code”=>“downloading.metadata”,
“state”=>“canceled”,
“done”=>4},
{“message”=>“Associating Content”,
“code”=>“associating.content”,
“state”=>“canceled”,
“done”=>1000},
{“message”=>“Un-Associating Content”,
“code”=>“unassociating.content”,
“state”=>“canceled”,
“done”=>0}],
“created_resources”=>,
“reserved_resources_record”=>
["/pulp/api/v3/repositories/rpm/rpm/1d9a0b76-d1d6-4f2c-a00f-aebdec2a4b8e/",
“/pulp/api/v3/remotes/rpm/rpm/93536142-5760-4b10-9b0b-d9703f64ba9e/”]}],
“create_version”=>true,
“task_groups”=>,
“poll_attempts”=>{“total”=>37, “failed”=>1}}
Exception:
Katello::Errors::Pulp3Error: 504, message=‘Gateway Time-out’, url=URL(‘http://mirrors.163.com/fedora/releases/33/Everything/x86_64/debug/tree/Packages/s/SDL2_mixer-debugsource-2.0.4-7.fc33.x86_64.rpm’)
追蹤:
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/pulp3/abstract_async_task.rb:102:in block in check_for_errors' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/pulp3/abstract_async_task.rb:100:in each’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/pulp3/abstract_async_task.rb:100:in check_for_errors' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/pulp3/abstract_async_task.rb:133:in poll_external_task’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:100:in poll_external_task_with_rescue' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:22:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/cancellable.rb:14:in run' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/pulp3/abstract_async_task.rb:10:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:571:in block (3 levels) in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/middleware/remote_action.rb:16:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/middleware/remote_action.rb:40:in block in as_remote_user' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/models/katello/concerns/user_extensions.rb:21:in cp_config’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/middleware/remote_action.rb:27:in as_cp_user' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/middleware/remote_action.rb:39:in as_remote_user’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.18.0/app/lib/actions/middleware/remote_action.rb:16:in run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:14:in block in run' /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/execution_wrapper.rb:88:in wrap’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:13:in run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:31:in with_progress_calculation' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:17:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_request_id.rb:49:in restore_current_request_id' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_timezone.rb:44:in restore_curent_timezone' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_user.rb:44:in restore_curent_user' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in block in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in restore_current_taxonomies' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in pass’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/world.rb:31:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:570:in block (2 levels) in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in catch’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in block in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in block in with_error_handling’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in catch' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in with_error_handling’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:564:in execute_run' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:285:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in block (2 levels) in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract.rb:167:in with_meta_calculation’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in block in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in open_action’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/director.rb:93:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in block (2 levels) in perform' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors.rb:18:in run_user_code’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in block in perform' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in with_telemetry’
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in perform' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/serialization.rb:27:in perform’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:192:in execute_job' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:165:in block (2 levels) in process’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:133:in invoke’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:164:in block in process' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:137:in block (6 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:109:in local' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:136:in block (5 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq.rb:37:in block in <module:Sidekiq>' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:132:in block (4 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:250:in stats' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:127:in block (3 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_logger.rb:8:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:126:in block (2 levels) in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:74:in global' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:125:in block in dispatch’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:48:in with_context' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:42:in with_job_hash_context’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:124:in dispatch' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:163:in process’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:83:in process_one' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:71:in run’
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:16:in watchdog' /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:25:in block in safe_thread’
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context’
Action:
Actions::Pulp3::Repository::Sync
Input:
{“repo_id”=>13,
“smart_proxy_id”=>1,
“options”=>{“source_url”=>nil},
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{“pulp_tasks”=>
[{“pulp_href”=>"/pulp/api/v3/tasks/0f0b2d6e-c7fe-4673-be45-cce598101124/",
“pulp_created”=>“2020-12-30T11:34:10.731+00:00”,
“state”=>“failed”,
“name”=>“pulp_rpm.app.tasks.synchronizing.synchronize”,
“started_at”=>“2020-12-30T11:34:10.966+00:00”,
“finished_at”=>“2020-12-30T11:39:17.952+00:00”,
“error”=>
{“traceback”=>
" File “/usr/lib/python3.6/site-packages/rq/worker.py”, line 936, in perform_job\n" +
" rv = job.perform()\n" +
" File “/usr/lib/python3.6/site-packages/rq/job.py”, line 684, in perform\n" +
" self._result = self._execute()\n" +
" File “/usr/lib/python3.6/site-packages/rq/job.py”, line 690, in _execute\n" +
" return self.func(*self.args, **self.kwargs)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py”, line 266, in synchronize\n" +
" dv.create()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py”, line 148, in create\n" +
" loop.run_until_complete(pipeline)\n" +
" File “/usr/lib64/python3.6/asyncio/base_events.py”, line 484, in run_until_complete\n" +
" return future.result()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 225, in create_pipeline\n" +
" await asyncio.gather(*futures)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py”, line 43, in call\n" +
" await self.run()\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 152, in run\n" +
" pb.done += task.result() # download_count\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py”, line 178, in _handle_content_unit\n" +
" await asyncio.gather(*downloaders_for_content)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/models.py”, line 88, in download\n" +
" download_result = await downloader.run(extra_data=self.extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulpcore/download/base.py”, line 227, in run\n" +
" return await self._run(extra_data=extra_data)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py”, line 88, in _run\n" +
" self.raise_for_status(response)\n" +
" File “/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py”, line 68, in raise_for_status\n" +
" response.raise_for_status()\n" +
" File “/usr/lib64/python3.6/site-packages/aiohttp/client_reqrep.py”, line 1005, in raise_for_status\n" +
" headers=self.headers,\n",
“description”=>
“504, message=‘Gateway Time-out’, url=URL(‘http://mirrors.163.com/fedora/releases/33/Everything/x86_64/debug/tree/Packages/s/SDL2_mixer-debugsource-2.0.4-7.fc33.x86_64.rpm’)”},
“worker”=>"/pulp/api/v3/workers/ccce425d-37be-4f65-9910-1bb31335694c/",
“child_tasks”=>,
“progress_reports”=>
[{“message”=>“Downloading Artifacts”,
“code”=>“downloading.artifacts”,
“state”=>“failed”,
“done”=>506},
{“message”=>“Parsed Packages”,
“code”=>“parsing.packages”,
“state”=>“canceled”,
“total”=>31121,
“done”=>4005},
{“message”=>“Downloading Metadata Files”,
“code”=>“downloading.metadata”,
“state”=>“canceled”,
“done”=>4},
{“message”=>“Associating Content”,
“code”=>“associating.content”,
“state”=>“canceled”,
“done”=>1000},
{“message”=>“Un-Associating Content”,
“code”=>“unassociating.content”,
“state”=>“canceled”,
“done”=>0}],
“created_resources”=>,
“reserved_resources_record”=>
["/pulp/api/v3/repositories/rpm/rpm/1d9a0b76-d1d6-4f2c-a00f-aebdec2a4b8e/",
“/pulp/api/v3/remotes/rpm/rpm/93536142-5760-4b10-9b0b-d9703f64ba9e/”]}],
“create_version”=>true,
“task_groups”=>,
“poll_attempts”=>{“total”=>37, “failed”=>1}}
Action:
Actions::Pulp3::Repository::SaveVersion
Input:
{“repository_id”=>13,
“tasks”=>Step(4).output[:pulp_tasks],
“repository_details”=>nil,
“force_fetch_version”=>nil,
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Pulp3::Repository::CreatePublication
Input:
{“repository_id”=>13,
“smart_proxy_id”=>1,
“contents_changed”=>Step(7).output[:contents_changed],
“options”=>{“contents_changed”=>Step(7).output[:contents_changed]},
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Pulp3::Repository::SavePublication
Input:
{“repository_id”=>13,
“tasks”=>Step(10).output,
“contents_changed”=>Step(7).output[:contents_changed],
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Pulp3::Repository::SaveDistributionReferences
Input:
{“repository_id”=>13,
“smart_proxy_id”=>1,
“tasks”=>Step(14).output,
“contents_changed”=>Step(7).output[:contents_changed],
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Pulp3::Orchestration::Repository::Sync
Input:
{“subaction_output”=>Step(7).output,
“remote_user”=>“admin”,
“remote_cp_user”=>“admin”,
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Katello::Repository::IndexContent
Input:
{“id”=>13,
“contents_changed”=>Step(17).output[:contents_changed],
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{“repo”=>13,
“last_updated”=>“2020-12-30 19:34:10 +0800”,
“contents_changed”=>Step(17).output[:contents_changed],
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{“repo”=>13,
“last_updated”=>“2020-12-30 19:34:10 +0800”,
“contents_changed”=>Step(17).output[:contents_changed],
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Katello::Applicability::Repository::Regenerate
Input:
{“repo_id”=>13,
“contents_changed”=>Step(17).output[:contents_changed],
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{“repository”=>
{“id”=>13,
“name”=>“releases 33 Everything x86_64 debug tree”,
“label”=>“releases_33_Everything_x86_64_debug_tree”},
“product”=>
{“id”=>4, “name”=>“fedora”, “label”=>“fedora”, “cp_id”=>“420723442986”},
“provider”=>{“id”=>1, “name”=>“Anonymous”},
“organization”=>
{“id”=>1, “name”=>“Default Organization”, “label”=>“Default_Organization”},
“services_checked”=>[“pulp3”],
“id”=>13,
“sync_result”=>Step(17).output,
“skip_metadata_check”=>false,
“validate_contents”=>false,
“contents_changed”=>Step(17).output[:contents_changed],
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{“repository”=>
{“id”=>13,
“name”=>“releases 33 Everything x86_64 debug tree”,
“label”=>“releases_33_Everything_x86_64_debug_tree”},
“product”=>
{“id”=>4, “name”=>“fedora”, “label”=>“fedora”, “cp_id”=>“420723442986”},
“provider”=>{“id”=>1, “name”=>“Anonymous”},
“organization”=>
{“id”=>1, “name”=>“Default Organization”, “label”=>“Default_Organization”},
“services_checked”=>[“pulp3”],
“id”=>13,
“sync_result”=>Step(17).output,
“skip_metadata_check”=>false,
“validate_contents”=>false,
“contents_changed”=>Step(17).output[:contents_changed],
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}
Action:
Actions::Katello::Repository::ImportApplicability
Input:
{“repo_id”=>13,
“contents_changed”=>Step(17).output[:contents_changed],
“current_request_id”=>nil,
“current_timezone”=>“Asia/Shanghai”,
“current_user_id”=>4,
“current_organization_id”=>1,
“current_location_id”=>2}
Output:
{}

The repo I can use reposync to download all packages in same env as foreman server, but foreman never success.

The error message I see is “gateway timeout”. Do you have a proxy server between Foreman and the upstream repo?

No. I just instaled the katello in one server and the server can access internet.

But why time out ? The network connection is not vary slow the download speed of reposync is vary fast.

What can I do ?

Katello::Errors::Pulp3Error: Timeout on reading data from socket

Should I increase the timeout setting ? Where to set it ?

Hmm, are your sure your upstream is HTTP and not HTTPS? Normally all repos I add are coming from an encrypted SSL source. Maybe that could cause the issue? Can you try to change it to HTTPS?

HTTP and HTTPS are all tested, both failed.

The last thing I could think of is to change the URL to another mirror. Maybe they did advertise a IPv6 DNS record, which they don’t have or one of their servers is down. Its worth a try.

but why using reposync command, everything is ok ?

Well, just trying to give you a few ideas. I am not a developer.

:grinning:, anyway thank you!

Anytime. Hopefully after the weekend you get someone chiming in from the dev team.

Hi,

first, I’m not a developer, just playing around with Foreman/Katello for my company since last summer.

I had a similar problem when syncing repositories. In my case the disc was to slow. I moved the VM to an SSD disk and it went well after this. When I take a snapshot of the VM it gets slow again and problems come back.

From my point of view it seems to my that syncing runs bad in that case, but Content Views are even more sensitive, they almost every time fail when the VM is in snapshot.

When this was the case, I never got an error like “you are just to slow” or similar, just something like “Proxy timeout” or something like this.

Maybe this helps

Cheers

Marco