Foreman not Sync

Problem: Foreman is not sync any repo/product

Expected outcome: I want to just sync

Foreman and Proxy versions: Foreman 3.0.0, Katello 4.2

Foreman and Proxy plugin versions:

Distribution and version:

Other relevant data:


Bulk

Centos Sync



I try to foreman-install --reset-data but it’s not work.
I’m not experience with Foreman with Katello, can you help me?

Hi there @thargalin,

How long did you try waiting for the sync? Can I see the upstream repository URL that you used? Sometimes repository syncs can take a while depending on how large the repository is. I don’t see any immediate errors from the screenshots.

1 Like

I’ve waited long enough :slight_smile:

i don’t have any access/network problems

That particular file is quite large for a repodata file, a bit less than half a gigabyte. Perhaps you should try increasing the “Sync Connection Timeout” in the settings. You’ll find it at Administer → Settings → Content tab, Sync Connection Timeout. An extra minute or two maybe? The default is 5 minutes.

1 Like

Should I change this parameter? Is 1000 good?

I change the Sync Connection Timeout to 1000 but It’s still not work.

Tasks Details
Action:
Actions::Pulp3::Repository::Sync
Input:
{"repo_id"=>2,
 "smart_proxy_id"=>1,
 "options"=>{},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/c1f3f350-bbc2-4fcd-97b8-a4013a281590/",
    "pulp_created"=>"2021-10-21T19:13:01.390+00:00",
    "state"=>"failed",
    "name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
    "logging_cid"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
    "started_at"=>"2021-10-21T19:13:01.465+00:00",
    "finished_at"=>"2021-10-21T19:21:26.936+00:00",
    "error"=>{"reason"=>"Worker has gone missing."},
    "worker"=>"/pulp/api/v3/workers/9255d988-af0e-4f47-b511-d100e9108f92/",
    "child_tasks"=>[],
    "progress_reports"=>
     [{"message"=>"Associating Content",
       "code"=>"associating.content",
       "state"=>"running",
       "done"=>2500},
      {"message"=>"Downloading Artifacts",
       "code"=>"sync.downloading.artifacts",
       "state"=>"running",
       "done"=>0},
      {"message"=>"Downloading Metadata Files",
       "code"=>"sync.downloading.metadata",
       "state"=>"completed",
       "done"=>10},
      {"message"=>"Parsed Packages",
       "code"=>"sync.parsing.packages",
       "state"=>"running",
       "done"=>5419}],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/rpm/rpm/94b70724-8951-41f5-a465-a60cc9cbbdb5/",
      "/pulp/api/v3/remotes/rpm/rpm/762bf18a-c736-4f0c-b6c7-16b70755ff45/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>52, "failed"=>1}}
Exception:
Katello::Errors::Pulp3Error: Pulp task error
Backtrace:
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/abstract_async_task.rb:108:in `block in check_for_errors'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/abstract_async_task.rb:106:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/abstract_async_task.rb:106:in `check_for_errors'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/abstract_async_task.rb:139:in `poll_external_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/polling.rb:22:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/cancellable.rb:14:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:572:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/execution_wrapper.rb:88:in `wrap'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/progress.rb:17:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/load_setting_values.rb:20:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/world.rb:31:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:571:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:570:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:570:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:565:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:286:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/director.rb:94:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors.rb:18:in `run_user_code'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:192:in `execute_job'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:165:in `block (2 levels) in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:128:in `block in invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:133:in `invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:164:in `block in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:137:in `block (6 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:109:in `local'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:136:in `block (5 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq.rb:37:in `block in <module:Sidekiq>'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:132:in `block (4 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:250:in `stats'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:127:in `block (3 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_logger.rb:8:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:126:in `block (2 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:74:in `global'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:125:in `block in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:48:in `with_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:42:in `with_job_hash_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:124:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:163:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:83:in `process_one'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:71:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:16:in `watchdog'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:25:in `block in safe_thread'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
Action:
Actions::Pulp3::Repository::Sync
Input:
{"repo_id"=>2,
 "smart_proxy_id"=>1,
 "options"=>{},
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/c1f3f350-bbc2-4fcd-97b8-a4013a281590/",
    "pulp_created"=>"2021-10-21T19:13:01.390+00:00",
    "state"=>"failed",
    "name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
    "logging_cid"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
    "started_at"=>"2021-10-21T19:13:01.465+00:00",
    "finished_at"=>"2021-10-21T19:21:26.936+00:00",
    "error"=>{"reason"=>"Worker has gone missing."},
    "worker"=>"/pulp/api/v3/workers/9255d988-af0e-4f47-b511-d100e9108f92/",
    "child_tasks"=>[],
    "progress_reports"=>
     [{"message"=>"Associating Content",
       "code"=>"associating.content",
       "state"=>"running",
       "done"=>2500},
      {"message"=>"Downloading Artifacts",
       "code"=>"sync.downloading.artifacts",
       "state"=>"running",
       "done"=>0},
      {"message"=>"Downloading Metadata Files",
       "code"=>"sync.downloading.metadata",
       "state"=>"completed",
       "done"=>10},
      {"message"=>"Parsed Packages",
       "code"=>"sync.parsing.packages",
       "state"=>"running",
       "done"=>5419}],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/rpm/rpm/94b70724-8951-41f5-a465-a60cc9cbbdb5/",
      "/pulp/api/v3/remotes/rpm/rpm/762bf18a-c736-4f0c-b6c7-16b70755ff45/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>52, "failed"=>1}}
Action:
Actions::Pulp3::Repository::SaveVersion
Input:
{"repository_id"=>2,
 "tasks"=>Step(6).output[:pulp_tasks],
 "repository_details"=>nil,
 "force_fetch_version"=>nil,
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Pulp3::Repository::CreatePublication
Input:
{"repository_id"=>2,
 "smart_proxy_id"=>1,
 "contents_changed"=>Step(9).output[:contents_changed],
 "skip_publication_creation"=>Step(9).output[:publication_provided],
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Pulp3::Repository::SavePublication
Input:
{"repository_id"=>2,
 "tasks"=>Step(12).output,
 "contents_changed"=>Step(9).output[:contents_changed],
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Pulp3::Repository::SaveDistributionReferences
Input:
{"repository_id"=>2,
 "smart_proxy_id"=>1,
 "tasks"=>Step(20).output,
 "contents_changed"=>Step(9).output[:contents_changed],
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Pulp3::Orchestration::Repository::Sync
Input:
{"subaction_output"=>Step(9).output,
 "remote_user"=>"admin",
 "remote_cp_user"=>"admin",
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Katello::Repository::IndexContent
Input:
{"id"=>2,
 "contents_changed"=>Step(23).output[:contents_changed],
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{"repo"=>2,
 "last_updated"=>"2021-10-21 22:13:00 +0300",
 "contents_changed"=>Step(23).output[:contents_changed],
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{"repo"=>2,
 "last_updated"=>"2021-10-21 22:13:00 +0300",
 "contents_changed"=>Step(23).output[:contents_changed],
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{"repository"=>
  {"id"=>2,
   "name"=>"Red Hat Enterprise Linux 8 for x86_64 - BaseOS RPMs 8",
   "label"=>"Red_Hat_Enterprise_Linux_8_for_x86_64_-_BaseOS_RPMs_8"},
 "product"=>
  {"id"=>14,
   "name"=>"Red Hat Enterprise Linux for x86_64",
   "label"=>"Red_Hat_Enterprise_Linux_for_x86_64",
   "cp_id"=>"479"},
 "provider"=>{"id"=>2, "name"=>"Red Hat"},
 "organization"=>
  {"id"=>1, "name"=>"Pandora Corp", "label"=>"Default_Organization"},
 "services_checked"=>["pulp3"],
 "id"=>2,
 "sync_result"=>Step(23).output,
 "skip_metadata_check"=>false,
 "validate_contents"=>false,
 "contents_changed"=>Step(23).output[:contents_changed],
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{"repository"=>
  {"id"=>2,
   "name"=>"Red Hat Enterprise Linux 8 for x86_64 - BaseOS RPMs 8",
   "label"=>"Red_Hat_Enterprise_Linux_8_for_x86_64_-_BaseOS_RPMs_8"},
 "product"=>
  {"id"=>14,
   "name"=>"Red Hat Enterprise Linux for x86_64",
   "label"=>"Red_Hat_Enterprise_Linux_for_x86_64",
   "cp_id"=>"479"},
 "provider"=>{"id"=>2, "name"=>"Red Hat"},
 "organization"=>
  {"id"=>1, "name"=>"Pandora Corp", "label"=>"Default_Organization"},
 "services_checked"=>["pulp3"],
 "id"=>2,
 "sync_result"=>Step(23).output,
 "skip_metadata_check"=>false,
 "validate_contents"=>false,
 "contents_changed"=>Step(23).output[:contents_changed],
 "current_request_id"=>"93faaf4e-7ec5-4d2f-862a-fb852922586c",
 "current_timezone"=>"Europe/Istanbul",
 "current_organization_id"=>1,
 "current_location_id"=>2,
 "current_user_id"=>4}
Output:
{}

I install Foreman with this paper

https://docs.theforeman.org/3.0/Quickstart_Guide/index-katello.html#_red_hat_enterprise_linux_7

I believe you’re hitting a bug rather than a configuration issue. I just reproduced the same issue on my own machine. I’ll investigate and get back to you.

Edit: I hit the issue because I ran out of RAM, oops. How much memory does your Katello server have? Do you see “Out of memory” or “oom-killer” in /var/log/messages?

1 Like

I give 8 GB ram and I see Out of memory…


Oct 21 22:50:27 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:27 +0000] "GET /pulp/api/v3/tasks/bda314f8-62d4-4f39-88c6-33a658416f64/ HTTP/1.1" 200 1159 "-" "OpenAPI-Generator/3.14.1/ruby"
Oct 21 22:50:35 foreman kernel: C3P0PooledConne invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
Oct 21 22:50:35 foreman kernel: C3P0PooledConne cpuset=/ mems_allowed=0
Oct 21 22:50:35 foreman kernel: CPU: 1 PID: 19589 Comm: C3P0PooledConne Kdump: loaded Not tainted 3.10.0-1160.45.1.el7.x86_64 #1
Oct 21 22:50:35 foreman kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
Oct 21 22:50:35 foreman kernel: Call Trace:
Oct 21 22:50:35 foreman kernel: [<ffffffff9ed83539>] dump_stack+0x19/0x1b
Oct 21 22:50:35 foreman kernel: [<ffffffff9ed7e5d8>] dump_header+0x90/0x229
Oct 21 22:50:35 foreman kernel: [<ffffffff9e90f1db>] ? cred_has_capability+0x6b/0x120
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7c254d>] oom_kill_process+0x2cd/0x490
Oct 21 22:50:35 foreman kernel: [<ffffffff9e90f2ac>] ? selinux_capable+0x1c/0x40
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7c2c3a>] out_of_memory+0x31a/0x500
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7c9854>] __alloc_pages_nodemask+0xad4/0xbe0
Oct 21 22:50:35 foreman kernel: [<ffffffff9e8193b8>] alloc_pages_current+0x98/0x110
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7be007>] __page_cache_alloc+0x97/0xb0
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7c0fa0>] filemap_fault+0x270/0x420
Oct 21 22:50:35 foreman kernel: [<ffffffffc045891e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
Oct 21 22:50:35 foreman kernel: [<ffffffffc0458b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7ee7aa>] __do_fault.isra.61+0x8a/0x100
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7eed5c>] do_read_fault.isra.63+0x4c/0x1b0
Oct 21 22:50:35 foreman kernel: [<ffffffff9e7f65a0>] handle_mm_fault+0xa20/0xfb0
Oct 21 22:50:35 foreman kernel: [<ffffffff9ed90653>] __do_page_fault+0x213/0x500
Oct 21 22:50:35 foreman kernel: [<ffffffff9ed90975>] do_page_fault+0x35/0x90
Oct 21 22:50:35 foreman kernel: [<ffffffff9ed8c778>] page_fault+0x28/0x30
Oct 21 22:50:35 foreman kernel: Mem-Info:
Oct 21 22:50:35 foreman kernel: active_anon:1569140 inactive_anon:308121 isolated_anon:0#012 active_file:843 inactive_file:950 isolated_file:14#012 unevictable:0 dirty:0 writeback:0 unstable:0#012 slab_reclaimable:12723 slab_unreclaimable:20502#012 mapped:36568 shmem:50226 pagetables:15294 bounce:0#012 free:25797 free_pcp:25 free_cma:0
Oct 21 22:50:35 foreman kernel: Node 0 DMA free:15844kB min:132kB low:164kB high:196kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15960kB managed:15876kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:32kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Oct 21 22:50:35 foreman kernel: lowmem_reserve[]: 0 2830 7784 7784
Oct 21 22:50:35 foreman kernel: Node 0 DMA32 free:44284kB min:24524kB low:30652kB high:36784kB active_anon:2206780kB inactive_anon:554120kB active_file:588kB inactive_file:588kB unevictable:0kB isolated(anon):0kB isolated(file):56kB present:3129152kB managed:2898720kB mlocked:0kB dirty:0kB writeback:0kB mapped:76240kB shmem:89356kB slab_reclaimable:16244kB slab_unreclaimable:23476kB kernel_stack:2992kB pagetables:23376kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Oct 21 22:50:35 foreman kernel: lowmem_reserve[]: 0 0 4953 4953
Oct 21 22:50:35 foreman kernel: Node 0 Normal free:42896kB min:42920kB low:53648kB high:64380kB active_anon:4069780kB inactive_anon:678364kB active_file:2784kB inactive_file:3212kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:5242880kB managed:5075424kB mlocked:0kB dirty:0kB writeback:0kB mapped:70032kB shmem:111548kB slab_reclaimable:34648kB slab_unreclaimable:58500kB kernel_stack:7760kB pagetables:37800kB unstable:0kB bounce:0kB free_pcp:124kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
Oct 21 22:50:35 foreman kernel: lowmem_reserve[]: 0 0 0 0
Oct 21 22:50:35 foreman kernel: Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15844kB
Oct 21 22:50:35 foreman kernel: Node 0 DMA32: 1482*4kB (UEM) 1104*8kB (UEM) 544*16kB (UEM) 367*32kB (UEM) 95*64kB (UEM) 16*128kB (UEM) 2*256kB (EM) 1*512kB (M) 0*1024kB 0*2048kB 0*4096kB = 44360kB
Oct 21 22:50:35 foreman kernel: Node 0 Normal: 2239*4kB (UEM) 1237*8kB (UEM) 599*16kB (UEM) 318*32kB (UEM) 65*64kB (UEM) 1*128kB (M) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42900kB
Oct 21 22:50:35 foreman kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 21 22:50:35 foreman kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 21 22:50:35 foreman kernel: 113708 total pagecache pages
Oct 21 22:50:35 foreman kernel: 61688 pages in swap cache
Oct 21 22:50:35 foreman kernel: Swap cache stats: add 1355536, delete 1293877, find 1258976/1496999
Oct 21 22:50:35 foreman kernel: Free swap  = 0kB
Oct 21 22:50:35 foreman kernel: Total swap = 2097148kB
Oct 21 22:50:35 foreman kernel: 2096998 pages RAM
Oct 21 22:50:35 foreman kernel: 0 pages HighMem/MovableOnly
Oct 21 22:50:35 foreman kernel: 99493 pages reserved
Oct 21 22:50:35 foreman kernel: [ pid ]   uid  tgid total_vm      rss nr_ptes swapents oom_score_adj name
Oct 21 22:50:35 foreman kernel: [  578]     0   578    13968      851      31       42             0 systemd-journal
Oct 21 22:50:35 foreman kernel: [  602]     0   602    31848        0      30      388             0 lvmetad
Oct 21 22:50:35 foreman kernel: [  612]     0   612    12460        1      25      878         -1000 systemd-udevd
Oct 21 22:50:35 foreman kernel: [  748]     0   748    13883       26      28       85         -1000 auditd
Oct 21 22:50:35 foreman kernel: [  773]   999   773   153256       90      62     1689             0 polkitd
Oct 21 22:50:35 foreman kernel: [  774]     0   774    42036        0      37      353             0 VGAuthService
Oct 21 22:50:35 foreman kernel: [  775]     0   775    68251       99      57      188             0 vmtoolsd
Oct 21 22:50:35 foreman kernel: [  776]     0   776     6596       43      19       34             0 systemd-logind
Oct 21 22:50:35 foreman kernel: [  777]    81   777    16643      113      33       92          -900 dbus-daemon
Oct 21 22:50:35 foreman kernel: [  788]     0   788     5422       41      16       41             0 irqbalance
Oct 21 22:50:35 foreman kernel: [  800]     0   800    31597       31      21      130             0 crond
Oct 21 22:50:35 foreman kernel: [  806]     0   806    89687      232      98     5388             0 firewalld
Oct 21 22:50:35 foreman kernel: [  844]     0   844   118571      209      87      301             0 NetworkManager
Oct 21 22:50:35 foreman kernel: [ 1137]     0  1137    79555     7800     111     4190             0 puppet
Oct 21 22:50:35 foreman kernel: [ 1140]     0  1140   146608      140     102     3221             0 tuned
Oct 21 22:50:35 foreman kernel: [ 1153]     0  1153    28246       26      57      234         -1000 sshd
Oct 21 22:50:35 foreman kernel: [ 1160]     0  1160    28952       24      14       17             0 rhsmcertd
Oct 21 22:50:35 foreman kernel: [ 1166]     0  1166    58196      287      47      382             0 rsyslogd
Oct 21 22:50:35 foreman kernel: [ 1279]     0  1279    27017       31       9        6             0 rhnsd
Oct 21 22:50:35 foreman kernel: [ 1592]     0  1592    22446       18      43      242             0 master
Oct 21 22:50:35 foreman kernel: [ 1597]    89  1597    22489       15      43      240             0 qmgr
Oct 21 22:50:35 foreman kernel: [ 2459]     0  2459    27551        0      10       32             0 agetty
Oct 21 22:50:35 foreman kernel: [ 9537]   993  9537    29452       88      30       29             0 chronyd
Oct 21 22:50:35 foreman kernel: [19137]   998 19137    39153     1197      24      314             0 redis-server
Oct 21 22:50:35 foreman kernel: [19156]  1000 19156    66920      288      87     5966             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19157]  1000 19157    54664      310      63     3457             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19160]    26 19160   208592     4541      90      275         -1000 postmaster
Oct 21 22:50:35 foreman kernel: [19165]    26 19165    62962       52      59      302             0 postmaster
Oct 21 22:50:35 foreman kernel: [19167]    26 19167   208710    27672     153      260             0 postmaster
Oct 21 22:50:35 foreman kernel: [19168]    26 19168   208626      456      76      287             0 postmaster
Oct 21 22:50:35 foreman kernel: [19169]    26 19169   208592     2759      72      287             0 postmaster
Oct 21 22:50:35 foreman kernel: [19170]    26 19170   208828      170      73      331             0 postmaster
Oct 21 22:50:35 foreman kernel: [19171]    26 19171    63200      224      59      278             0 postmaster
Oct 21 22:50:35 foreman kernel: [19172]    26 19172   208793      120      69      332             0 postmaster
Oct 21 22:50:35 foreman kernel: [19177]  1000 19177   127226    23750     195     2310             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19180]  1000 19180   166374     4618     206    20029             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19187]    53 19187  1808242   229411     789    86484             0 java
Oct 21 22:50:35 foreman kernel: [19191]  1000 19191   124573    12402     194    10984             0 pulpcore-worker
Oct 21 22:50:35 foreman kernel: [19202]  1000 19202   125857     6713     199    17949             0 pulpcore-worker
Oct 21 22:50:35 foreman kernel: [19206]  1000 19206   166385     4601     206    20163             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19216]  1000 19216   166310     4448     206    20116             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19222]   997 19222   188424    46955     291    40895             0 ruby
Oct 21 22:50:35 foreman kernel: [19228]  1000 19228   166420     4662     206    20149             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19229]     0 19229    46058      203      92      475             0 httpd
Oct 21 22:50:35 foreman kernel: [19232]   997 19232   190928    59262     301    27922             0 sidekiq
Oct 21 22:50:35 foreman kernel: [19234]  1000 19234   166310     4446     206    20117             0 gunicorn
Oct 21 22:50:35 foreman kernel: [19256]    48 19256    46252      403      93      466             0 httpd
Oct 21 22:50:35 foreman kernel: [19257]    48 19257    46244      408      93      448             0 httpd
Oct 21 22:50:35 foreman kernel: [19258]    48 19258    46247      399      93      461             0 httpd
Oct 21 22:50:35 foreman kernel: [19259]    48 19259    46254      404      93      465             0 httpd
Oct 21 22:50:35 foreman kernel: [19260]    48 19260    46251      413      93      451             0 httpd
Oct 21 22:50:35 foreman kernel: [19261]    48 19261    46247      410      93      454             0 httpd
Oct 21 22:50:35 foreman kernel: [19262]    48 19262    46264      433      93      448             0 httpd
Oct 21 22:50:35 foreman kernel: [19263]    48 19263    46240      402      93      450             0 httpd
Oct 21 22:50:35 foreman kernel: [19309]   994 19309  1295239   183240     692   110541             0 java
Oct 21 22:50:35 foreman kernel: [19357]    26 19357   209116     1413      92      377             0 postmaster
Oct 21 22:50:35 foreman kernel: [19358]    26 19358   209281     2440     100      339             0 postmaster
Oct 21 22:50:35 foreman kernel: [19414]    26 19414   208922      725      86      387             0 postmaster
Oct 21 22:50:35 foreman kernel: [19436]    26 19436   208922     1008      85      388             0 postmaster
Oct 21 22:50:35 foreman kernel: [19487]    26 19487   208922     1102      85      383             0 postmaster
Oct 21 22:50:35 foreman kernel: [19489]    26 19489   209140      881      93      351             0 postmaster
Oct 21 22:50:35 foreman kernel: [19492]    26 19492   208922     1040      85      390             0 postmaster
Oct 21 22:50:35 foreman kernel: [19590]    26 19590   208928      162      75      485             0 postmaster
Oct 21 22:50:35 foreman kernel: [19591]    26 19591   209171      486      86      654             0 postmaster
Oct 21 22:50:35 foreman kernel: [19592]    26 19592   209157      629      86      521             0 postmaster
Oct 21 22:50:35 foreman kernel: [19640]    26 19640   209213      290      84      745             0 postmaster
Oct 21 22:50:35 foreman kernel: [19645]    26 19645   208924      245      83      478             0 postmaster
Oct 21 22:50:35 foreman kernel: [19649]    26 19649   209158     1307     103      464             0 postmaster
Oct 21 22:50:35 foreman kernel: [19653]   997 19653   401211   198691     718    24646             0 ruby
Oct 21 22:50:35 foreman kernel: [19659]   997 19659   401654   183348     712    30987             0 ruby
Oct 21 22:50:35 foreman kernel: [19665]   997 19665   365699   170699     648    23353             0 ruby
Oct 21 22:50:35 foreman kernel: [19674]    26 19674   208924      249      82      474             0 postmaster
Oct 21 22:50:35 foreman kernel: [19678]    26 19678   209192     1129     103      398             0 postmaster
Oct 21 22:50:35 foreman kernel: [19689]    26 19689   208953      266      82      483             0 postmaster
Oct 21 22:50:35 foreman kernel: [19690]    26 19690   208953      265      82      485             0 postmaster
Oct 21 22:50:35 foreman kernel: [19696]    26 19696   209155      910     101      422             0 postmaster
Oct 21 22:50:35 foreman kernel: [19697]    26 19697   209157     1053     103      427             0 postmaster
Oct 21 22:50:35 foreman kernel: [19724]   997 19724   192112    67016     303    19848             0 sidekiq
Oct 21 22:50:35 foreman kernel: [19725]   997 19725   403068   196498     722    19320             0 sidekiq
Oct 21 22:50:35 foreman kernel: [19760]    26 19760   209132     1497     103      265             0 postmaster
Oct 21 22:50:35 foreman kernel: [19767]    26 19767   209242     1627     104      415             0 postmaster
Oct 21 22:50:35 foreman kernel: [19771]    26 19771   208891      198      77      430             0 postmaster
Oct 21 22:50:35 foreman kernel: [19772]    26 19772   209217     1617     104      383             0 postmaster
Oct 21 22:50:35 foreman kernel: [19776]    26 19776   209148      564      86      318             0 postmaster
Oct 21 22:50:35 foreman kernel: [19780]    26 19780   209000      493      85      311             0 postmaster
Oct 21 22:50:35 foreman kernel: [19781]    26 19781   208891      379      77      247             0 postmaster
Oct 21 22:50:35 foreman kernel: [19801]   995 19801   110075     4694     105     3111             0 ruby
Oct 21 22:50:35 foreman kernel: [19946]    48 19946    46263      482      93      393             0 httpd
Oct 21 22:50:35 foreman kernel: [19949]    48 19949    46250      476      93      391             0 httpd
Oct 21 22:50:35 foreman kernel: [19950]    48 19950    46247      453      93      412             0 httpd
Oct 21 22:50:35 foreman kernel: [19961]    26 19961   209808     1428      93      304             0 postmaster
Oct 21 22:50:35 foreman kernel: [20005]    48 20005    46258      461      93      413             0 httpd
Oct 21 22:50:35 foreman kernel: [20734]     0 20734    39747      332      81        7             0 sshd
Oct 21 22:50:35 foreman kernel: [20739]     0 20739    28879       94      12       12             0 bash
Oct 21 22:50:35 foreman kernel: [20969]    26 20969   209247     1245      91      351             0 postmaster
Oct 21 22:50:35 foreman kernel: [20971]    26 20971   209247     1334      93      483             0 postmaster
Oct 21 22:50:35 foreman kernel: [21089]    26 21089   209109      953     101      338             0 postmaster
Oct 21 22:50:35 foreman kernel: [21193]    26 21193   209247     1640      92      245             0 postmaster
Oct 21 22:50:35 foreman kernel: [21196]    26 21196   209247     1168      89      244             0 postmaster
Oct 21 22:50:35 foreman kernel: [22612]    26 22612   209247     1310      89      254             0 postmaster
Oct 21 22:50:35 foreman kernel: [23861]    26 23861   209618     2651      97      241             0 postmaster
Oct 21 22:50:35 foreman kernel: [23963]     0 23963    32445      909      19        0             0 vi
Oct 21 22:50:35 foreman kernel: [23967]     0 23967    39747      342      80        0             0 sshd
Oct 21 22:50:35 foreman kernel: [23973]     0 23973    28879      100      12        0             0 bash
Oct 21 22:50:35 foreman kernel: [23991]     0 23991    27023       24       9        0             0 tail
Oct 21 22:50:35 foreman kernel: [23996]    26 23996   209591     2374      93      241             0 postmaster
Oct 21 22:50:35 foreman kernel: [24007]  1000 24007   517402   377544     889     1163             0 pulpcore-worker
Oct 21 22:50:35 foreman kernel: [24008]    26 24008   216936    18910     150      244             0 postmaster
Oct 21 22:50:35 foreman kernel: [24066]    26 24066   209244     1924      92      241             0 postmaster
Oct 21 22:50:35 foreman kernel: [24074]    89 24074    22472      250      47        0             0 pickup
Oct 21 22:50:35 foreman kernel: [24093]    26 24093   208928      480      75      246             0 postmaster
Oct 21 22:50:35 foreman kernel: [24110]    26 24110   209171      935      82      246             0 postmaster
Oct 21 22:50:35 foreman kernel: [24111]    26 24111   208928      478      75      246             0 postmaster
Oct 21 22:50:35 foreman kernel: [24119]    26 24119   209155     1387      87      242             0 postmaster
Oct 21 22:50:35 foreman kernel: [24122]     0 24122    39747      340      81        0             0 sshd
Oct 21 22:50:35 foreman kernel: [24129]     0 24129    28879      101      11        0             0 bash
Oct 21 22:50:35 foreman kernel: [24149]     0 24149    27023       24      10        0             0 tail
Oct 21 22:50:35 foreman kernel: [24155]    26 24155   209134      904      79      246             0 postmaster
Oct 21 22:50:35 foreman kernel: [24175]    26 24175   209728     2534      97      241             0 postmaster
Oct 21 22:50:35 foreman kernel: [24176]    26 24176   209155     1146      86      242             0 postmaster
Oct 21 22:50:35 foreman kernel: [24195]    26 24195   208928      480      75      246             0 postmaster
Oct 21 22:50:35 foreman kernel: Out of memory: Kill process 24007 (pulpcore-worker) score 150 or sacrifice child
Oct 21 22:50:36 foreman kernel: Killed process 24007 (pulpcore-worker), UID 1000, total-vm:2069608kB, anon-rss:1510176kB, file-rss:0kB, shmem-rss:0kB
Oct 21 22:50:36 foreman pulpcore-worker-2: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: Cleaning up task bda314f8-62d4-4f39-88c6-33a658416f64 and marking as failed. Reason: Worker has gone missing.
Oct 21 22:50:43 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:43 +0000] "GET /pulp/api/v3/tasks/bda314f8-62d4-4f39-88c6-33a658416f64/ HTTP/1.1" 200 1212 "-" "OpenAPI-Generator/3.14.1/ruby"
Oct 21 22:50:44 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:44 +0000] "GET /pulp/api/v3/contentguards/certguard/rhsm/?name=RHSMCertGuard HTTP/1.1" 200 2742 "-" "OpenAPI-Generator/1.4.0/ruby"
Oct 21 22:50:44 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:44 +0000] "PATCH /pulp/api/v3/contentguards/certguard/rhsm/c9062886-7112-490d-8088-c3170be26cd3/ HTTP/1.1" 200 2690 "-" "OpenAPI-Generator/1.4.0/ruby"
Oct 21 22:50:44 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:44 +0000] "GET /pulp/api/v3/contentguards/certguard/rhsm/?name=RHSMCertGuard HTTP/1.1" 200 2742 "-" "OpenAPI-Generator/1.4.0/ruby"
Oct 21 22:50:44 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:44 +0000] "PATCH /pulp/api/v3/contentguards/certguard/rhsm/c9062886-7112-490d-8088-c3170be26cd3/ HTTP/1.1" 200 2690 "-" "OpenAPI-Generator/1.4.0/ruby"
Oct 21 22:50:45 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:45 +0000] "GET /pulp/api/v3/distributions/rpm/rpm/?base_path=Default_Organization%2FLibrary%2Fcontent%2Fdist%2Frhel8%2F8%2Fx86_64%2Fbaseos%2Fos HTTP/1.1" 200 679 "-" "OpenAPI-Generator/3.13.3/ruby"
Oct 21 22:50:45 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:45 +0000] "PATCH /pulp/api/v3/distributions/rpm/rpm/04faba59-4c2c-474a-8858-5edcbad9e490/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.13.3/ruby"
Oct 21 22:50:45 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:45 +0000] "GET /pulp/api/v3/tasks/265795de-0ce4-41dc-85f8-b2f1033b801b/ HTTP/1.1" 200 535 "-" "OpenAPI-Generator/3.14.1/ruby"
Oct 21 22:50:45 foreman pulpcore-worker-2: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]: pulpcore.tasking.pulpcore_worker:INFO: Starting task 265795de-0ce4-41dc-85f8-b2f1033b801b
Oct 21 22:50:46 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:46 +0000] "GET /pulp/api/v3/tasks/265795de-0ce4-41dc-85f8-b2f1033b801b/ HTTP/1.1" 200 535 "-" "OpenAPI-Generator/3.14.1/ruby"
Oct 21 22:50:46 foreman pulpcore-worker-2: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]: pulpcore.tasking.pulpcore_worker:INFO: Task completed 265795de-0ce4-41dc-85f8-b2f1033b801b
Oct 21 22:50:47 foreman pulpcore-api: pulp [3690f6b4-44e3-4074-a2d0-9822a0a2a8b7]:  - - [21/Oct/2021:19:50:47 +0000] "GET /pulp/api/v3/tasks/265795de-0ce4-41dc-85f8-b2f1033b801b/ HTTP/1.1" 200 562 "-" "OpenAPI-Generator/3.14.1/ruby"
1 Like

That makes sense then. We recommend a minimum of 20 GB RAM (Installing Foreman 3.0 server with Katello 4.2 plugin on Enterprise Linux). If RAM is not easily available I think you could get away with 16 GB but any lower might be pushing it.

1 Like

I set up the machine as 2 gb because I am working on vmware workstation. When installing Foreman, I made 8gb because it wanted at least 8gb, but I had not read this document. Right now it’s 14GB (and it’s killing my machine :smiley: )

It’s sync right now, thanks a lot

If you happen to be in Istanbul, write to me, I will buy you a kebab. :smiley:

1 Like

No problem, I’m glad it worked! And thank you :slight_smile:

1 Like

It’s doing again :frowning:


2021-11-05T11:43:01 [I|app|76070a0b] Completed 200 OK in 72ms (Views: 49.0ms | ActiveRecord: 14.8ms | Allocations: 41432)
2021-11-05T11:43:06 [I|app|1ca807bf] Started GET "/foreman_tasks/api/tasks/e973d87f-2611-4677-88af-eb8b898f444a/details?include_permissions" for 192.168.133.1 at 2021-11-05 11:43:06 +0300
2021-11-05T11:43:06 [I|app|1ca807bf] Processing by ForemanTasks::Api::TasksController#details as JSON
2021-11-05T11:43:06 [I|app|1ca807bf]   Parameters: {"include_permissions"=>nil, "id"=>"e973d87f-2611-4677-88af-eb8b898f444a"}
2021-11-05T11:43:06 [I|app|1ca807bf]   Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/views/foreman_tasks/api/tasks/details.json.rabl
2021-11-05T11:43:06 [I|app|1ca807bf]   Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/views/foreman_tasks/api/tasks/details.json.rabl (Duration: 54.3ms | Allocations: 33981)
2021-11-05T11:43:06 [I|app|1ca807bf] Completed 200 OK in 64ms (Views: 52.3ms | ActiveRecord: 5.4ms | Allocations: 37312)