Katello Content via Proxy

Problem:
I have an issue with a new install where I’ve set the http proxy and then the yum importer and katello cdn proxies in the yaml files per how-to-sync-yum-repos-via-proxy/13574
but i cant get repo discovery to work (i see traffic hit the proxy) and repo sync via product fails with cannot connect to host

Expected outcome:
Repo sync

Foreman and Proxy versions:
2.2.0

Foreman and Proxy plugin versions:
pulp 2.1, katello 3.17

Distribution and version:

Other relevant data:

Hi @richardhumph ! Let me get familiar with this particular setup and get back to you.

1 Like

Great thanks
heres the back trace from a recent failed prdocut repo sync

Action:

Actions::Pulp3::Repository::Sync

Input:

{"repo_id"=>2,
 "smart_proxy_id"=>1,
 "options"=>
  {"smart_proxy_id"=>1, "repo_id"=>2, "source_url"=>nil, "options"=>{}},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/fd7d38fc-a04d-4b88-a2d2-06c59d4893bb/",
    "pulp_created"=>"2020-09-30T14:25:12.286+00:00",
    "state"=>"failed",
    "name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
    "started_at"=>"2020-09-30T14:25:12.373+00:00",
    "finished_at"=>"2020-09-30T14:25:12.566+00:00",
    "error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 883, in perform_job\n" +
       "    rv = job.perform()\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 657, in perform\n" +
       "    self._result = self._execute()\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 663, in _execute\n" +
       "    return self.func(*self.args, **self.kwargs)\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 162, in synchronize\n" +
       "    remote_url = fetch_remote_url(remote)\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 128, in fetch_remote_url\n" +
       "    downloader.fetch()\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/download/base.py\", line 160, in fetch\n" +
       "    return done.pop().result()\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/download/base.py\", line 227, in run\n" +
       "    return await self._run(extra_data=extra_data)\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py\", line 41, in _run\n" +
       "    async with self.session.get(url) as response:\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/client.py\", line 1012, in __aenter__\n" +
       "    self._resp = await self._coro\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/client.py\", line 483, in _request\n" +
       "    timeout=real_timeout\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 523, in connect\n" +
       "    proto = await self._create_connection(req, traces, timeout)\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 859, in _create_connection\n" +
       "    req, traces, timeout)\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 1004, in _create_direct_connection\n" +
       "    raise last_exc\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 986, in _create_direct_connection\n" +
       "    req=req, client_error=client_error)\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 943, in _wrap_create_connection\n" +
       "    raise client_error(req.connection_key, exc) from exc\n",
      "description"=>
       "Cannot connect to host anorien.csc.warwick.ac.uk:80 ssl:default [Connect call failed ('137.205.124.72', 80)]"},
    "worker"=>"/pulp/api/v3/workers/fe906ee4-5e86-4f9e-afc1-04388dfefafa/",
    "child_tasks"=>[],
    "progress_reports"=>[],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/rpm/rpm/86a77b16-3497-43f5-842b-e5a08c0ac151/",
      "/pulp/api/v3/remotes/rpm/rpm/d17a0db0-35f9-495f-975a-c0535774ecbe/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>1, "failed"=>1}}

Exception:

Katello::Errors::Pulp3Error: Cannot connect to host anorien.csc.warwick.ac.uk:80 ssl:default [Connect call failed ('137.205.124.72', 80)]

Backtrace:

/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/pulp3/abstract_async_task.rb:101:in `block in check_for_errors'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/pulp3/abstract_async_task.rb:99:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/pulp3/abstract_async_task.rb:99:in `check_for_errors'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/pulp3/abstract_async_task.rb:132:in `poll_external_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:22:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/cancellable.rb:14:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:571:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.17.0.rc1/app/lib/actions/middleware/remote_action.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/execution_wrapper.rb:88:in `wrap'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:17:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_request_id.rb:49:in `restore_current_request_id'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_user.rb:44:in `restore_curent_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-3.0.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/world.rb:31:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:570:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:564:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:285:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/director.rb:93:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors.rb:18:in `run_user_code'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:192:in `execute_job'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:165:in `block (2 levels) in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:128:in `block in invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:133:in `invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:164:in `block in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:137:in `block (6 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:109:in `local'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:136:in `block (5 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq.rb:37:in `block in <module:Sidekiq>'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:132:in `block (4 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:250:in `stats'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:127:in `block (3 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_logger.rb:8:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:126:in `block (2 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:74:in `global'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:125:in `block in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:48:in `with_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:42:in `with_job_hash_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:124:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:163:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:83:in `process_one'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:71:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:16:in `watchdog'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:25:in `block in safe_thread'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'

Action:

Actions::Pulp3::Repository::Sync

Input:

{"repo_id"=>2,
 "smart_proxy_id"=>1,
 "options"=>
  {"smart_proxy_id"=>1, "repo_id"=>2, "source_url"=>nil, "options"=>{}},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/fd7d38fc-a04d-4b88-a2d2-06c59d4893bb/",
    "pulp_created"=>"2020-09-30T14:25:12.286+00:00",
    "state"=>"failed",
    "name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
    "started_at"=>"2020-09-30T14:25:12.373+00:00",
    "finished_at"=>"2020-09-30T14:25:12.566+00:00",
    "error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 883, in perform_job\n" +
       "    rv = job.perform()\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 657, in perform\n" +
       "    self._result = self._execute()\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 663, in _execute\n" +
       "    return self.func(*self.args, **self.kwargs)\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 162, in synchronize\n" +
       "    remote_url = fetch_remote_url(remote)\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 128, in fetch_remote_url\n" +
       "    downloader.fetch()\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/download/base.py\", line 160, in fetch\n" +
       "    return done.pop().result()\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/download/base.py\", line 227, in run\n" +
       "    return await self._run(extra_data=extra_data)\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/downloaders.py\", line 41, in _run\n" +
       "    async with self.session.get(url) as response:\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/client.py\", line 1012, in __aenter__\n" +
       "    self._resp = await self._coro\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/client.py\", line 483, in _request\n" +
       "    timeout=real_timeout\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 523, in connect\n" +
       "    proto = await self._create_connection(req, traces, timeout)\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 859, in _create_connection\n" +
       "    req, traces, timeout)\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 1004, in _create_direct_connection\n" +
       "    raise last_exc\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 986, in _create_direct_connection\n" +
       "    req=req, client_error=client_error)\n" +
       "  File \"/usr/lib64/python3.6/site-packages/aiohttp/connector.py\", line 943, in _wrap_create_connection\n" +
       "    raise client_error(req.connection_key, exc) from exc\n",
      "description"=>
       "Cannot connect to host anorien.csc.warwick.ac.uk:80 ssl:default [Connect call failed ('137.205.124.72', 80)]"},
    "worker"=>"/pulp/api/v3/workers/fe906ee4-5e86-4f9e-afc1-04388dfefafa/",
    "child_tasks"=>[],
    "progress_reports"=>[],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/rpm/rpm/86a77b16-3497-43f5-842b-e5a08c0ac151/",
      "/pulp/api/v3/remotes/rpm/rpm/d17a0db0-35f9-495f-975a-c0535774ecbe/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>1, "failed"=>1}}

Action:

Actions::Pulp3::Repository::SaveVersion

Input:

{"repository_id"=>2,
 "tasks"=>Step(4).output[:pulp_tasks],
 "repository_details"=>nil,
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Pulp3::Repository::CreatePublication

Input:

{"repository_id"=>2,
 "smart_proxy_id"=>1,
 "contents_changed"=>Step(7).output[:contents_changed],
 "options"=>{"contents_changed"=>Step(7).output[:contents_changed]},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Pulp3::Repository::SavePublication

Input:

{"repository_id"=>2,
 "tasks"=>Step(10).output,
 "contents_changed"=>Step(7).output[:contents_changed],
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Pulp3::Orchestration::Repository::Sync

Input:

{"subaction_output"=>Step(7).output,
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Katello::Repository::IndexContent

Input:

{"id"=>2,
 "contents_changed"=>Step(17).output[:contents_changed],
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Katello::Repository::ErrataMail

Input:

{"repo"=>2,
 "last_updated"=>"2020-09-30 15:25:11 +0100",
 "contents_changed"=>Step(17).output[:contents_changed],
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Katello::Repository::ErrataMail

Input:

{"repo"=>2,
 "last_updated"=>"2020-09-30 15:25:11 +0100",
 "contents_changed"=>Step(17).output[:contents_changed],
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Katello::Applicability::Repository::Regenerate

Input:

{"repo_id"=>2,
 "contents_changed"=>Step(17).output[:contents_changed],
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Katello::Repository::Sync

Input:

{"repository"=>{"id"=>2, "name"=>"Centos7_OS", "label"=>"Centos7_OS"},
 "product"=>
  {"id"=>1,
   "name"=>"Centos7_OS",
   "label"=>"Centos7_OS",
   "cp_id"=>"373177711124"},
 "provider"=>{"id"=>1, "name"=>"Anonymous"},
 "organization"=>{"id"=>1, "name"=>"NG EMEA", "label"=>"NG_EMEA"},
 "services_checked"=>["pulp3"],
 "id"=>2,
 "sync_result"=>Step(17).output,
 "skip_metadata_check"=>false,
 "validate_contents"=>false,
 "contents_changed"=>Step(17).output[:contents_changed],
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Katello::Repository::Sync

Input:

{"repository"=>{"id"=>2, "name"=>"Centos7_OS", "label"=>"Centos7_OS"},
 "product"=>
  {"id"=>1,
   "name"=>"Centos7_OS",
   "label"=>"Centos7_OS",
   "cp_id"=>"373177711124"},
 "provider"=>{"id"=>1, "name"=>"Anonymous"},
 "organization"=>{"id"=>1, "name"=>"NG EMEA", "label"=>"NG_EMEA"},
 "services_checked"=>["pulp3"],
 "id"=>2,
 "sync_result"=>Step(17).output,
 "skip_metadata_check"=>false,
 "validate_contents"=>false,
 "contents_changed"=>Step(17).output[:contents_changed],
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

Action:

Actions::Katello::Repository::ImportApplicability

Input:

{"repo_id"=>2,
 "contents_changed"=>Step(17).output[:contents_changed],
 "current_request_id"=>nil,
 "current_timezone"=>"Europe/London",
 "current_user_id"=>5,
 "current_organization_id"=>1,
 "current_location_id"=>2}

Output:

{}

So to send another mail but I’ve just seen this community post and wondering as I see katello use the proxy but when the pulp core worker gets involved it doesn’t use the proxy could this be related?

It seems like it could be related. Are you up to trying the workaround provided in that thread? Apologies, I haven’t gotten to replicating this setup. Aiming for today though.

1 Like

I deleted my last reponse when i saw the journalctl log it said about a pulp error so checked the manual code and i added an extra :
it would seem the product sync is going via the proxy now but i get a server hangup 502 error. ill take alook at the weekend for logs etc

Odd thing is a repu sync not via the product sync area the taks shows success and outputs the channels underneath the URl but the job never returns the data on the repo discovery just spins forever

thanks for looking into this aswell

Ok so it seems the pulp change has sorted it the 502 error was because I used a http mirror with SSL verify on, changed that to the https link and that’s pulled in the packages and metadata needed

Thanks

2 Likes

Glad to hear that. Do you still see the spinning forever behavior? Sounds like that could be a bug. If you like, go ahead and report it in our Redmine under the Katello project: https://projects.theforeman.org/issues/new

I do yeah, i added a new topic to the support forum on the community but i can add it via redmine project aswell and then close this if you’d prefer?

ok! let’s see what comes of the other support topic in that case. thank you