Unable to sync ostree content from centos

When attempting to sync the ostree repo
http://mirror.centos.org/centos/7/atomic/x86_64/repo/ I keep getting the following error: OST0005: Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)

I've attempted to sync other ostree repositories and get the same error. I've confirmed the system can reach that url and the summary file without issue running curl. So at this point I'm stuck. It's unclear what file it is trying to find that is generating the 404 error. The hope is to manage centos atomic from Foreman/Katello. Any help would be greatly appreciated.

Actions::Pulp::Repository::Sync

Input:

{"pulp_id"=>"7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"task_id"=>nil,
"source_url"=>nil,
"options"=>{},
"remote_user"=>"admin",
"remote_cp_user"=>"admin"}

Output:

{"pulp_tasks"=>
  [{"exception"=>nil,
    "task_type"=>"pulp.server.managers.repo.sync.sync",
    "_href"=>"/pulp/api/v2/tasks/cd958a52-be29-4e46-9ea4-0201bedae0ff/",     "task_id"=>"cd958a52-be29-4e46-9ea4-0201bedae0ff",
    "tags"=>
     ["pulp:repository:7e6ec4ad-03f4-42a3-a331-d03428fd2673",       "pulp:action:sync"],
    "finish_time"=>"2017-11-27T18:21:22Z",
    "_ns"=>"task_status",
    "start_time"=>"2017-11-27T18:21:21Z",
    "traceback"=>
     "Traceback (most recent call last):\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 240, in trace_task\n R = retval = fun(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 522, in __call__\n return super(Task, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 107, in __call__\n return super(PulpTask, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 438, in __protected_call__\n return self.run(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 769, in sync\n sync_report = sync_repo(transfer_repo, conduit, call_config)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 725, in wrap_f\n return f(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/web.py\", line 91, in sync_repo\n report = step.process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 572, in process_lifecycle\n super(PluginStep, self).process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 163, in process_lifecycle\n step.process()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\nPulpCodedException: Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)\n",     "spawned_tasks"=>[],
    "progress_report"=>
     {"ostree_web_importer"=>
       [{"num_success"=>1,
         "description"=>"Create/Open Local Repository",
         "step_type"=>"import_create_repository",
         "items_total"=>1,
         "state"=>"FINISHED",
         "error_details"=>[],
         "details"=>"",
         "num_failures"=>0,
         "step_id"=>"5598197b-a4b7-4cd6-b952-a6614e09981f",          "num_processed"=>1},
        {"num_success"=>0,
         "description"=>"Update Summary",
         "step_type"=>"import_summary",
         "items_total"=>1,
         "state"=>"FAILED",
         "error_details"=>
          [{"traceback"=>
             " File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\n",             "error"=>
             "Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"}],          "details"=>"",
         "num_failures"=>1,
         "step_id"=>"d0586c83-a35b-469d-9365-cd808a0d9209",          "num_processed"=>1},
        {"num_success"=>0,
         "description"=>"Pull Remote Branches",
         "step_type"=>"import_pull",
         "items_total"=>1,
         "state"=>"NOT_STARTED",
         "error_details"=>[],
         "details"=>"",
         "num_failures"=>0,
         "step_id"=>"ef8273eb-9364-4091-bc60-5e17ce4bf81c",          "num_processed"=>0},
        {"num_success"=>0,
         "description"=>"Add Content Units",
         "step_type"=>"import_add_unit",
         "items_total"=>1,
         "state"=>"NOT_STARTED",
         "error_details"=>[],
         "details"=>"",
         "num_failures"=>0,
         "step_id"=>"7adcb056-c22a-43f5-95f8-687d7a69724e",          "num_processed"=>0},
        {"num_success"=>0,
         "description"=>"Clean",
         "step_type"=>"import_clean",
         "items_total"=>1,
         "state"=>"NOT_STARTED",
         "error_details"=>[],
         "details"=>"",
         "num_failures"=>0,
         "step_id"=>"7f2d049a-c837-41ca-aea3-f114d0d74c05",          "num_processed"=>0}]},
    "queue"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com.dq",     "state"=>"error",
    "worker_name"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com",     "result"=>nil,
    "error"=>
     {"code"=>"OST0005",
      "data"=>
       {"reason"=>
         "GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"},       "description"=>
       "Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)",       "sub_errors"=>[]},
    "_id"=>{"$oid"=>"5a1c57a15ee17ba2cec4fa91"},
    "id"=>"5a1c57a15ee17ba2cec4fa91"}],
"contents_changed"=>true,
"poll_attempts"=>{"total"=>2, "failed"=>1}}
Sounds like it might be something to do with your fstab file with an incorrect entry, or to do with drives you may have mounted/unmounted recently?


··· On Tuesday, November 28, 2017 at 9:54:36 PM UTC+13, steve.hu...@gmail.com wrote:

When attempting to sync the ostree repo
http://mirror.centos.org/centos/7/atomic/x86_64/repo/ I keep getting the
following error: OST0005: Fetch summary failed. Reason:
GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)

I've attempted to sync other ostree repositories and get the same error.
I've confirmed the system can reach that url and the summary file without
issue running curl. So at this point I'm stuck. It's unclear what file it
is trying to find that is generating the 404 error. The hope is to manage
centos atomic from Foreman/Katello. Any help would be greatly appreciated.

Actions::Pulp::Repository::Sync

Input:

{"pulp_id"=>"7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"task_id"=>nil,
"source_url"=>nil,
"options"=>{},
"remote_user"=>"admin",
"remote_cp_user"=>"admin"}

Output:

{"pulp_tasks"=>
[{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.sync.sync",
"_href"=>"/pulp/api/v2/tasks/cd958a52-be29-4e46-9ea4-0201bedae0ff/",
"task_id"=>"cd958a52-be29-4e46-9ea4-0201bedae0ff",
"tags"=>
["pulp:repository:7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"pulp:action:sync"],
"finish_time"=>"2017-11-27T18:21:22Z",
"_ns"=>"task_status",
"start_time"=>"2017-11-27T18:21:21Z",
"traceback"=>
"Traceback (most recent call last):\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 240, in trace_task\n R = retval = fun(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 522, in __call__\n return super(Task, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 107, in __call__\n return super(PulpTask, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 438, in __protected_call__\n return self.run(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 769, in sync\n sync_report = sync_repo(transfer_repo, conduit, call_config)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 725, in wrap_f\n return f(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/web.py\", line 91, in sync_repo\n report = step.process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 572, in process_lifecycle\n super(PluginStep, self).process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 163, in process_lifecycle\n step.process()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\nPulpCodedException: Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)\n",
"spawned_tasks"=>[],
"progress_report"=>
{"ostree_web_importer"=>
[{"num_success"=>1,
"description"=>"Create/Open Local Repository",
"step_type"=>"import_create_repository",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"5598197b-a4b7-4cd6-b952-a6614e09981f",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Update Summary",
"step_type"=>"import_summary",
"items_total"=>1,
"state"=>"FAILED",
"error_details"=>
[{"traceback"=>
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\n",
"error"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"}],
"details"=>"",
"num_failures"=>1,
"step_id"=>"d0586c83-a35b-469d-9365-cd808a0d9209",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Pull Remote Branches",
"step_type"=>"import_pull",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"ef8273eb-9364-4091-bc60-5e17ce4bf81c",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Add Content Units",
"step_type"=>"import_add_unit",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7adcb056-c22a-43f5-95f8-687d7a69724e",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Clean",
"step_type"=>"import_clean",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7f2d049a-c837-41ca-aea3-f114d0d74c05",
"num_processed"=>0}]},
"queue"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com.dq",
"state"=>"error",
"worker_name"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com <javascript:>",
"result"=>nil,
"error"=>
{"code"=>"OST0005",
"data"=>
{"reason"=>
"GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"},
"description"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)",
"sub_errors"=>[]},
"_id"=>{"$oid"=>"5a1c57a15ee17ba2cec4fa91"},
"id"=>"5a1c57a15ee17ba2cec4fa91"}],
"contents_changed"=>true,
"poll_attempts"=>{"total"=>2, "failed"=>1}}

I'm curious what part of the message led you to this conclusion. I've done a reboot and there are no issues with fstab or any mounts. Since it's a 404 error I'm thinking this is related to it's ability to find files on the web server. I've also tried mirror the centos atomic ostree repo and I'm still seeing issues. It's trying to find objects that aren't there.

··· On Wednesday, November 29, 2017 at 2:07:33 PM UTC-7, Jasper Connery wrote:

Sounds like it might be something to do with your fstab file with an
incorrect entry, or to do with drives you may have mounted/unmounted
recently?

On Tuesday, November 28, 2017 at 9:54:36 PM UTC+13, steve.hu...@gmail.com > wrote:

When attempting to sync the ostree repo
http://mirror.centos.org/centos/7/atomic/x86_64/repo/ I keep getting the
following error: OST0005: Fetch summary failed. Reason:
GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)

I've attempted to sync other ostree repositories and get the same error.
I've confirmed the system can reach that url and the summary file without
issue running curl. So at this point I'm stuck. It's unclear what file it
is trying to find that is generating the 404 error. The hope is to manage
centos atomic from Foreman/Katello. Any help would be greatly appreciated.

Actions::Pulp::Repository::Sync

Input:

{"pulp_id"=>"7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"task_id"=>nil,
"source_url"=>nil,
"options"=>{},
"remote_user"=>"admin",
"remote_cp_user"=>"admin"}

Output:

{"pulp_tasks"=>
[{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.sync.sync",
"_href"=>"/pulp/api/v2/tasks/cd958a52-be29-4e46-9ea4-0201bedae0ff/",
"task_id"=>"cd958a52-be29-4e46-9ea4-0201bedae0ff",
"tags"=>
["pulp:repository:7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"pulp:action:sync"],
"finish_time"=>"2017-11-27T18:21:22Z",
"_ns"=>"task_status",
"start_time"=>"2017-11-27T18:21:21Z",
"traceback"=>
"Traceback (most recent call last):\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 240, in trace_task\n R = retval = fun(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 522, in __call__\n return super(Task, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 107, in __call__\n return super(PulpTask, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 438, in __protected_call__\n return self.run(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 769, in sync\n sync_report = sync_repo(transfer_repo, conduit, call_config)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 725, in wrap_f\n return f(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/web.py\", line 91, in sync_repo\n report = step.process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 572, in process_lifecycle\n super(PluginStep, self).process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 163, in process_lifecycle\n step.process()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\nPulpCodedException: Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)\n",
"spawned_tasks"=>[],
"progress_report"=>
{"ostree_web_importer"=>
[{"num_success"=>1,
"description"=>"Create/Open Local Repository",
"step_type"=>"import_create_repository",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"5598197b-a4b7-4cd6-b952-a6614e09981f",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Update Summary",
"step_type"=>"import_summary",
"items_total"=>1,
"state"=>"FAILED",
"error_details"=>
[{"traceback"=>
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\n",
"error"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"}],
"details"=>"",
"num_failures"=>1,
"step_id"=>"d0586c83-a35b-469d-9365-cd808a0d9209",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Pull Remote Branches",
"step_type"=>"import_pull",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"ef8273eb-9364-4091-bc60-5e17ce4bf81c",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Add Content Units",
"step_type"=>"import_add_unit",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7adcb056-c22a-43f5-95f8-687d7a69724e",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Clean",
"step_type"=>"import_clean",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7f2d049a-c837-41ca-aea3-f114d0d74c05",
"num_processed"=>0}]},
"queue"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com.dq",
"state"=>"error",
"worker_name"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com",
"result"=>nil,
"error"=>
{"code"=>"OST0005",
"data"=>
{"reason"=>
"GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"},
"description"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)",
"sub_errors"=>[]},
"_id"=>{"$oid"=>"5a1c57a15ee17ba2cec4fa91"},
"id"=>"5a1c57a15ee17ba2cec4fa91"}],
"contents_changed"=>true,
"poll_attempts"=>{"total"=>2, "failed"=>1}}

Could you find what is exactly the feed_url on ther pulp repo? Is it " http://mirror.centos.org/centos/7/atomic/x86_64/repo/" or some difference there. I was advised
by the Pulp team to check that, so I'm doing that :)

-- Ivan

čt 30. 11. 2017 v 19:01 odesílatel <steve.hunter1138@gmail.com> napsal:

···
I'm curious what part of the message led you to this conclusion. I've done
a reboot and there are no issues with fstab or any mounts. Since it's a 404
error I'm thinking this is related to it's ability to find files on the web
server. I've also tried mirror the centos atomic ostree repo and I'm still
seeing issues. It's trying to find objects that aren't there.

On Wednesday, November 29, 2017 at 2:07:33 PM UTC-7, Jasper Connery wrote:

Sounds like it might be something to do with your fstab file with an
incorrect entry, or to do with drives you may have mounted/unmounted
recently?

On Tuesday, November 28, 2017 at 9:54:36 PM UTC+13, steve.hu...@gmail.com >> wrote:

When attempting to sync the ostree repo
http://mirror.centos.org/centos/7/atomic/x86_64/repo/ I keep getting
the following error: OST0005: Fetch summary failed. Reason:
GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)

I've attempted to sync other ostree repositories and get the same error.
I've confirmed the system can reach that url and the summary file without
issue running curl. So at this point I'm stuck. It's unclear what file it
is trying to find that is generating the 404 error. The hope is to manage
centos atomic from Foreman/Katello. Any help would be greatly appreciated.

Actions::Pulp::Repository::Sync

Input:

{"pulp_id"=>"7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"task_id"=>nil,
"source_url"=>nil,
"options"=>{},
"remote_user"=>"admin",
"remote_cp_user"=>"admin"}

Output:

{"pulp_tasks"=>
[{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.sync.sync",
"_href"=>"/pulp/api/v2/tasks/cd958a52-be29-4e46-9ea4-0201bedae0ff/",
"task_id"=>"cd958a52-be29-4e46-9ea4-0201bedae0ff",
"tags"=>
["pulp:repository:7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"pulp:action:sync"],
"finish_time"=>"2017-11-27T18:21:22Z",
"_ns"=>"task_status",
"start_time"=>"2017-11-27T18:21:21Z",
"traceback"=>
"Traceback (most recent call last):\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 240, in trace_task\n R = retval = fun(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 522, in __call__\n return super(Task, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 107, in __call__\n return super(PulpTask, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 438, in __protected_call__\n return self.run(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 769, in sync\n sync_report = sync_repo(transfer_repo, conduit, call_config)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 725, in wrap_f\n return f(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/web.py\", line 91, in sync_repo\n report = step.process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 572, in process_lifecycle\n super(PluginStep, self).process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 163, in process_lifecycle\n step.process()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\nPulpCodedException: Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)\n",
"spawned_tasks"=>[],
"progress_report"=>
{"ostree_web_importer"=>
[{"num_success"=>1,
"description"=>"Create/Open Local Repository",
"step_type"=>"import_create_repository",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"5598197b-a4b7-4cd6-b952-a6614e09981f",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Update Summary",
"step_type"=>"import_summary",
"items_total"=>1,
"state"=>"FAILED",
"error_details"=>
[{"traceback"=>
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\n",
"error"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"}],
"details"=>"",
"num_failures"=>1,
"step_id"=>"d0586c83-a35b-469d-9365-cd808a0d9209",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Pull Remote Branches",
"step_type"=>"import_pull",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"ef8273eb-9364-4091-bc60-5e17ce4bf81c",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Add Content Units",
"step_type"=>"import_add_unit",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7adcb056-c22a-43f5-95f8-687d7a69724e",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Clean",
"step_type"=>"import_clean",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7f2d049a-c837-41ca-aea3-f114d0d74c05",
"num_processed"=>0}]},
"queue"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com.dq",
"state"=>"error",
"worker_name"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com",
"result"=>nil,
"error"=>
{"code"=>"OST0005",
"data"=>
{"reason"=>
"GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"},
"description"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)",
"sub_errors"=>[]},
"_id"=>{"$oid"=>"5a1c57a15ee17ba2cec4fa91"},
"id"=>"5a1c57a15ee17ba2cec4fa91"}],
"contents_changed"=>true,
"poll_attempts"=>{"total"=>2, "failed"=>1}}

--
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at https://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

Thank you Ivan. That got me pointed in the right direction. I wasn't able to see what the feed URL was set to (I played with pulp-admin for a bit but no dice) so I just manually set it using pulp-admin. I tried to sync this again using the Foreman webUI. It got a little further but now fails with Pulling remote refs failed. Reason: GLib.Error('[7] Couldn't connect to server', 'g-io-error-quark', 0). I'm now trying to run the sync by hand using pulp-admin from the CLI. I'll post if this has any effect and if the files pulled down can be seen by Foreman.


··· On Thursday, November 30, 2017 at 12:57:29 PM UTC-7, Ivan Necas wrote:

Could you find what is exactly the feed_url on ther pulp repo? Is it "
http://mirror.centos.org/centos/7/atomic/x86_64/repo/" or some difference
there. I was advised
by the Pulp team to check that, so I'm doing that :)

-- Ivan

čt 30. 11. 2017 v 19:01 odesílatel <steve.hu...@gmail.com <javascript:>>
napsal:

I'm curious what part of the message led you to this conclusion. I've
done a reboot and there are no issues with fstab or any mounts. Since it's
a 404 error I'm thinking this is related to it's ability to find files on
the web server. I've also tried mirror the centos atomic ostree repo and
I'm still seeing issues. It's trying to find objects that aren't there.

On Wednesday, November 29, 2017 at 2:07:33 PM UTC-7, Jasper Connery wrote:

Sounds like it might be something to do with your fstab file with an
incorrect entry, or to do with drives you may have mounted/unmounted
recently?

On Tuesday, November 28, 2017 at 9:54:36 PM UTC+13, >>> steve.hu...@gmail.com wrote:

When attempting to sync the ostree repo
http://mirror.centos.org/centos/7/atomic/x86_64/repo/ I keep getting
the following error: OST0005: Fetch summary failed. Reason:
GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)

I've attempted to sync other ostree repositories and get the same
error. I've confirmed the system can reach that url and the summary file
without issue running curl. So at this point I'm stuck. It's unclear what
file it is trying to find that is generating the 404 error. The hope is to
manage centos atomic from Foreman/Katello. Any help would be greatly
appreciated.

Actions::Pulp::Repository::Sync

Input:

{"pulp_id"=>"7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"task_id"=>nil,
"source_url"=>nil,
"options"=>{},
"remote_user"=>"admin",
"remote_cp_user"=>"admin"}

Output:

{"pulp_tasks"=>
[{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.sync.sync",
"_href"=>"/pulp/api/v2/tasks/cd958a52-be29-4e46-9ea4-0201bedae0ff/",
"task_id"=>"cd958a52-be29-4e46-9ea4-0201bedae0ff",
"tags"=>
["pulp:repository:7e6ec4ad-03f4-42a3-a331-d03428fd2673",
"pulp:action:sync"],
"finish_time"=>"2017-11-27T18:21:22Z",
"_ns"=>"task_status",
"start_time"=>"2017-11-27T18:21:21Z",
"traceback"=>
"Traceback (most recent call last):\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 240, in trace_task\n R = retval = fun(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 522, in __call__\n return super(Task, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 107, in __call__\n return super(PulpTask, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 438, in __protected_call__\n return self.run(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 769, in sync\n sync_report = sync_repo(transfer_repo, conduit, call_config)\n File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 725, in wrap_f\n return f(*args, **kwargs)\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/web.py\", line 91, in sync_repo\n report = step.process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 572, in process_lifecycle\n super(PluginStep, self).process_lifecycle()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 163, in process_lifecycle\n step.process()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\nPulpCodedException: Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)\n",
"spawned_tasks"=>[],
"progress_report"=>
{"ostree_web_importer"=>
[{"num_success"=>1,
"description"=>"Create/Open Local Repository",
"step_type"=>"import_create_repository",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"5598197b-a4b7-4cd6-b952-a6614e09981f",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Update Summary",
"step_type"=>"import_summary",
"items_total"=>1,
"state"=>"FAILED",
"error_details"=>
[{"traceback"=>
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n self._process_block()\n\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n self.process_main()\n\n File \"/usr/lib/python2.7/site-packages/pulp_ostree/plugins/importers/steps.py\", line 160, in process_main\n raise pe\n",
"error"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"}],
"details"=>"",
"num_failures"=>1,
"step_id"=>"d0586c83-a35b-469d-9365-cd808a0d9209",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Pull Remote Branches",
"step_type"=>"import_pull",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"ef8273eb-9364-4091-bc60-5e17ce4bf81c",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Add Content Units",
"step_type"=>"import_add_unit",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7adcb056-c22a-43f5-95f8-687d7a69724e",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Clean",
"step_type"=>"import_clean",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7f2d049a-c837-41ca-aea3-f114d0d74c05",
"num_processed"=>0}]},
"queue"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com.dq",
"state"=>"error",
"worker_name"=>"reserved_resource_worker-2@ussl-foreman.usanainc.com",
"result"=>nil,
"error"=>
{"code"=>"OST0005",
"data"=>
{"reason"=>
"GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)"},
"description"=>
"Fetch summary failed. Reason: GLib.Error('Server returned HTTP 404', 'g-io-error-quark', 1)",
"sub_errors"=>[]},
"_id"=>{"$oid"=>"5a1c57a15ee17ba2cec4fa91"},
"id"=>"5a1c57a15ee17ba2cec4fa91"}],
"contents_changed"=>true,
"poll_attempts"=>{"total"=>2, "failed"=>1}}

--
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-user...@googlegroups.com <javascript:>.
To post to this group, send email to forema...@googlegroups.com
<javascript:>.
Visit this group at https://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.