Problem: Update task finishes with warning result all the time
Foreman and Proxy versions: 3.18.1/4.20.1
Foreman and Proxy plugin versions:
Distribution and version:RHEL 9.8
Other relevant data:
During weekend I updated Foreman to 3.18.1/4.20.1 and by chance I noticed that Update Count tasks have been finishing almost always with warning result on all of my Smart Proxies probably since upgrade to 3.17.
The error is:
5013b3f2 | HTTP status code: 502
5013b3f2 | Response headers: {"date"=>"Sat, 27 Jun 2026 23:16:42 GMT", "server"=>"Apache", "content-length"=>"341", "content-type"=>"text/html; charset=iso-8859-1"}
5013b3f2 | Response body: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
5013b3f2 | <html><head>
5013b3f2 | <title>502 Proxy Error</title>
5013b3f2 | </head><body>
5013b3f2 | <h1>Proxy Error</h1>
5013b3f2 | <p>The proxy server received an invalid
5013b3f2 | response from an upstream server.<br />
5013b3f2 | The proxy server could not handle the request<p>Reason: <strong>Error reading from remote server</strong></p></p>
5013b3f2 | </body></html>
5013b3f2 | (PulpRpmClient::ApiError)
sajha
July 1, 2026, 1:33pm
2
Can you find the dynflow task output for the step that fails on the task. Also, what is the smart proxy version for this? Are the foreman and proxy upgraded to the same versions?
Hello, sorry for the late reply, I was on holiday. The smart proxy and foreman server are on the same versions, which is 4.20.1 currently. I am not expert in dynflow console, under the Run tab I found the
Actions::Katello::CapsuleContent::UpdateContentCounts task with foolowing error:
---
- "/usr/share/gems/gems/pulp_rpm_client-3.32.9/lib/pulp_rpm_client/api_client.rb:71:in
`call_api'"
- "/usr/share/gems/gems/pulp_rpm_client-3.32.9/lib/pulp_rpm_client/api/content_packages_api.rb:303:in
`list_with_http_info'"
- "/usr/share/gems/gems/pulp_rpm_client-3.32.9/lib/pulp_rpm_client/api/content_packages_api.rb:164:in
`list'"
- "/usr/share/gems/gems/katello-4.20.1/app/services/katello/pulp3/repository_mirror.rb:210:in
`count_by_pulpcore_type'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:216:in
`block in translate_counts'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:213:in
`each'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:213:in
`translate_counts'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:198:in
`process_repository'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:181:in
`block in repos_content_count'"
- "/usr/share/gems/gems/activerecord-7.0.10/lib/active_record/relation/delegation.rb:88:in
`each'"
- "/usr/share/gems/gems/activerecord-7.0.10/lib/active_record/relation/delegation.rb:88:in
`each'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:180:in
`repos_content_count'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:238:in
`global_content_counts'"
- "/usr/share/gems/gems/katello-4.20.1/app/models/katello/concerns/smart_proxy_extensions.rb:159:in
`update_content_counts!'"
- "/usr/share/gems/gems/katello-4.20.1/app/lib/actions/katello/capsule_content/update_content_counts.rb:19:in
`run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:590:in `block (3 levels)
in execute_run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/rails_executor_wrap.rb:14:in
`block in run'"
- "/usr/share/gems/gems/activesupport-7.0.10/lib/active_support/execution_wrapper.rb:92:in
`wrap'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/rails_executor_wrap.rb:13:in
`run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action/progress.rb:29:in `with_progress_calculation'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action/progress.rb:15:in `run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/load_setting_values.rb:20:in
`run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_request_id.rb:15:in
`block in run'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_request_id.rb:52:in
`restore_current_request_id'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_request_id.rb:15:in
`run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_timezone.rb:15:in
`block in run'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_timezone.rb:44:in
`restore_curent_timezone'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_timezone.rb:15:in
`run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
`block in run'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in
`restore_current_taxonomies'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
`run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:33:in `run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:28:in `pass'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware.rb:20:in `pass'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_user.rb:15:in
`block in run'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_user.rb:54:in
`restore_curent_user'"
- "/usr/share/gems/gems/foreman-tasks-11.1.1/app/lib/actions/middleware/keep_current_user.rb:15:in
`run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/stack.rb:24:in `call'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/middleware/world.rb:31:in `execute'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:589:in `block (2 levels)
in execute_run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:588:in `catch'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:588:in `block in execute_run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:491:in `block in with_error_handling'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:491:in `catch'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:491:in `with_error_handling'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:583:in `execute_run'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/action.rb:304:in `execute'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in
`block (2 levels) in execute'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/execution_plan/steps/abstract.rb:168:in
`with_meta_calculation'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in
`block in execute'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in
`open_action'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in
`execute'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/director.rb:70:in `execute'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:12:in
`block (2 levels) in perform'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/executors.rb:18:in `run_user_code'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:10:in
`block in perform'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:26:in
`with_telemetry'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in
`perform'"
- "/usr/share/gems/gems/dynflow-2.0.0/lib/dynflow/executors/sidekiq/serialization.rb:28:in
`perform'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:202:in `execute_job'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:170:in `block (2 levels)
in process'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/middleware/chain.rb:172:in `invoke'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:169:in `block in process'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:136:in `block (6 levels)
in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_retry.rb:113:in `local'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:135:in `block (5 levels)
in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq.rb:44:in `block in <module:Sidekiq>'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:131:in `block (4 levels)
in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:263:in `stats'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:126:in `block (3 levels)
in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_logger.rb:13:in `call'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:125:in `block (2 levels)
in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_retry.rb:80:in `global'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:124:in `block in dispatch'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/job_logger.rb:39:in `prepare'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:123:in `dispatch'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:168:in `process'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:78:in `process_one'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/processor.rb:68:in `run'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/component.rb:8:in `watchdog'"
- "/usr/share/gems/gems/sidekiq-6.5.12/lib/sidekiq/component.rb:17:in `block in safe_thread'"
- "/usr/share/gems/gems/logging-2.4.0/lib/logging/diagnostic_context.rb:474:in `block
in create_with_logging_context'"
