Foreman 2.3 Katello 3.18 File Repo hang on provisioning pulp 3 step

*ulp 3 Hung on Provisioning file repo

job run endless (more then 22 H )

Foreman 2.3 Katello 3.18

|foreman-tasks 3.0.6
||foreman_ansible 6.1.1
|foreman_memcache 0.1.1
|foreman_remote_execution 4.2.2
|foreman_snapshot_management 2.0.0
|foreman_statistics 1.0.0
|foreman_virt_who_configure 0.5.5
|katello 3.18.3.1

CentOS 7

Other relevant data:
The Task Hung on this Step:

16: Actions::Pulp3::Repository::RefreshDistribution (waiting for Pulp to start the task) [ 68164.80s / 183.15s ] Cancel
Queue: default

Started at: 2021-07-06 14:24:15 UTC

Ended at: 2021-07-07 09:20:19 UTC

Real time: 68164.80s

Execution time (excluding suspended state): 183.15s

Input:


repository_id: 73368
smart_proxy_id: 1
remote_user: admin
remote_cp_user: admin
current_request_id:
current_timezone: Europe/Berlin
current_user_id: 11
current_organization_id: 1
current_location_id:
Output:


pulp_tasks:

  • !ruby/object:Katello::Pulp3::Task
    smart_proxy: !ruby/object:SmartProxy
    concise_attributes:
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: id
      value_before_type_cast: 1
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: name
      value_before_type_cast: vlx21942.itz.adm.itzbund.net
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: url
      value_before_type_cast: https://vlx21942.itz.adm.itzbund.net:9090
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: created_at
      value_before_type_cast: 2020-07-28 12:20:27.236174000 Z
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: updated_at
      value_before_type_cast: 2020-08-13 04:46:28.781343000 Z
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: expired_logs
      value_before_type_cast: ‘1596451837’
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: puppet_path
      value_before_type_cast: “/tmp/kafo_installation20200728-10397-ngvnjd/environments”
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: download_policy
      value_before_type_cast: on_demand
    • !ruby/object:ActiveModel::Attribute::FromDatabase
      name: pubkey
      value_before_type_cast: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCecT0vaEeEsD/AxF7aQkTuIqGpb9CEfa3MAS95BcY+/iKec5c/LNKgwNOmJ76q7WXfjvb2UuVWloMHWWXykbKxdkld7XXKWv0CzSU9gA9+pxslI8npgew/1mKdps/J5yqpXl+r50CamfMrUOu75/6yB+7RsTZas4jQY0MoE1skty0B127QFNYODDRkbb1sZcf/RzLnjkyIA5YsNr075CDyNrg7O4Nptdu4Mdd76ow57GVYbpqL3Hvj1Cn0bqx03hSu6/5YFwpGs5qlqQNK7M4yYLIBofd7pej//MDGOZkNpecd5yVELhc8E5xnI7JS/HWCBbhwt0igDATqg+/DfPKZ
      foreman-proxy@vlt24078
      new_record: false
      active_record_yaml_version: 2
      pulp_data: !ruby/hash:ActiveSupport::HashWithIndifferentAccess
      pulp_href: “/pulp/api/v3/tasks/c1560dc9-e213-4b56-aae3-f492a3952d07/”
      pulp_created: ‘2021-07-06T14:24:15.188+00:00’
      state: waiting
      name: pulpcore.app.tasks.base.general_create
      worker: “/pulp/api/v3/workers/0f2ca71b-4a18-41fd-8bea-bf9c5daed81c/”
      child_tasks:
      progress_reports:
      created_resources:
      reserved_resources_record:
    • “/api/v3/distributions/”
      href: “/pulp/api/v3/tasks/c1560dc9-e213-4b56-aae3-f492a3952d07/”
      task_groups:
      poll_attempts:
      total: 286
      failed: 0

if you need logfiles plese specifi the logs your need. same problem is for uploading files in file repo.
need help to solve this problem. thanks

Can you try

  • Cancel the RefreshDistribution task
  • Restart the pulp-workers via
    foreman-maintain service restart
  • Try syncing again ?

hi,

I have make this steps, but if the sync ist start again the result is the same. the promote task hung on the same pulp3 task. I have now drop the pulp 3 database and recreate it. than i have create the file repos again and publish the file repo in the library. now the Promote will work correct.

I am having this same issue. Can you tell me how you dropped and recreated the pulp 3 database?

hi

her is a link to the description in this forum. i hope it helps.

Kind regards
Fabian