Fedora Errata and repository sync not working

Support
1

I am running Katello 2.1 on CentOS 7 and have several issues with repo sync

When I try to sync a repository it will usually end up in an error state,
but when I go to the more details link and go to the errors tab it always
says "No Errors".

I found information about this bug online :
http://projects.theforeman.org/issues/9068

That page mentions a fix that will be present in Katello 2.1.2 but nothing
about how to get around this issue right now.

Is there a current workaround?

After resuming several times, I was finally able to sync the fedora 20
updates repo (all 20 or so GB of it), but there was no errata. I thought
Fedora repos had errata? Is there a special repo address I have to use to
get the errata?

I'm not sure if this is related to #1 and the tasks never finishing
properly because of qpidd, but when I try to make a version of a content
view that includes a large repo (> 5GB) it eventually goes into error state
and times out. I am unable to resume this.

Has anyone else experienced issues creating versions of content view?

Actually a lot of things go into error state with no resume option and no
cancel option but I think they are all related to the tasks issue.

2

> I am running Katello 2.1 on CentOS 7 and have several issues with repo sync
>
> 1)
> When I try to sync a repository it will usually end up in an error state,
> but when I go to the more details link and go to the errors tab it always
> says "No Errors".
>
> I found information about this bug online :
> Bug #9068: foreman-tasks qpid connection seems broken - Katello - Foreman
>
> That page mentions a fix that will be present in Katello 2.1.2 but nothing
> about how to get around this issue right now.
>

Not sure I entirely follow. Katello 2.1.2 has been released with the fix -
so updating to that version of the packages and restarting services should
get you past this issue.

>
> Is there a current workaround?
>
> 2)
> After resuming several times, I was finally able to sync the fedora 20
> updates repo (all 20 or so GB of it), but there was no errata. I thought
> Fedora repos had errata? Is there a special repo address I have to use to
> get the errata?
>

I am unaware of errata for Fedora, but have heard (and there is a thread
on) errata for CentOS. Perhaps others may know.

>
> 3)
> I'm not sure if this is related to #1 and the tasks never finishing
> properly because of qpidd, but when I try to make a version of a content
> view that includes a large repo (> 5GB) it eventually goes into error state
> and times out. I am unable to resume this.
>
> Has anyone else experienced issues creating versions of content view?
>
> Actually a lot of things go into error state with no resume option and no
> cancel option but I think they are all related to the tasks issue.
>

This sounds related to #1 and often times restarting services
(katello-service restart) will make tasks resumable.

Eric

··· On Tue, Apr 14, 2015 at 3:10 PM, Nathan Peters wrote:

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

3

I'm not sure what I'm doing wrong then, but I cant' seem to get upgraded to
2.1.2. In fact I only installed this last week so I'm not sure why I'm at
2.1.0 then since apparently 2.1.2 was out 25 days ago.

in my yum installed list I have

katello-repos.noarch 2.1.3-1.el7
katello-installer.noarch 2.1.1-4.el7
katello.noarch 2.1.0-2.el7

I've ran katello-installer --upgrade several times it runs successfully but
stays at the same version.

I've tried yum clean all and yum -y update and everything says it's up to
date.

Also tried updating the repos by yum update -y
http://fedorapeople.org/groups/katello/releases/yum/2.1/katello/RHEL/7Server/x86_64/katello-repos-latest.rpm

But that also claimed that they were already up to date.

··· > Not sure I entirely follow. Katello 2.1.2 has been released with the fix - > so updating to that version of the packages and restarting services should > get you past this issue. > > > >
4

What version of ruby193-rubygems-katello ?

··· On Apr 14, 2015 11:56 PM, "Nathan Peters" wrote:

I’m not sure what I’m doing wrong then, but I cant’ seem to get upgraded
to 2.1.2. In fact I only installed this last week so I’m not sure why I’m
at 2.1.0 then since apparently 2.1.2 was out 25 days ago.

in my yum installed list I have

katello-repos.noarch 2.1.3-1.el7
katello-installer.noarch 2.1.1-4.el7
katello.noarch 2.1.0-2.el7

I’ve ran katello-installer --upgrade several times it runs successfully
but stays at the same version.

I’ve tried yum clean all and yum -y update and everything says it’s up to
date.

Also tried updating the repos by yum update -y
http://fedorapeople.org/groups/katello/releases/yum/2.1/katello/RHEL/7Server/x86_64/katello-repos-latest.rpm

But that also claimed that they were already up to date.

Not sure I entirely follow. Katello 2.1.2 has been released with the fix

  • so updating to that version of the packages and restarting services
    should get you past this issue.

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

5

ruby193-rubygem-katello.noarch 2.1.2-3.el7

Hmm, does that mean I do have 2.1.2?

If that's the case then the task bug definitely still exists in this
version. I've installed this on 2 different machines and both of them go
into error mode frequently (every 30 minutes or so) when syncing
repositories.

··· On Tuesday, April 14, 2015 at 8:59:51 PM UTC-7, Eric Helms wrote: > > What version of ruby193-rubygems-katello ? > On Apr 14, 2015 11:56 PM, "Nathan Peters" > wrote: > >> I'm not sure what I'm doing wrong then, but I cant' seem to get upgraded >> to 2.1.2. In fact I only installed this last week so I'm not sure why I'm >> at 2.1.0 then since apparently 2.1.2 was out 25 days ago. >> >> in my yum installed list I have >> >> katello-repos.noarch 2.1.3-1.el7 >> katello-installer.noarch 2.1.1-4.el7 >> katello.noarch 2.1.0-2.el7 >> >> I've ran katello-installer --upgrade several times it runs successfully >> but stays at the same version. >> >> I've tried yum clean all and yum -y update and everything says it's up to >> date. >> >> Also tried updating the repos by yum update -y >> http://fedorapeople.org/groups/katello/releases/yum/2.1/katello/RHEL/7Server/x86_64/katello-repos-latest.rpm >> >> But that also claimed that they were already up to date. >> >> >> >>> Not sure I entirely follow. Katello 2.1.2 has been released with the fix >>> - so updating to that version of the packages and restarting services >>> should get you past this issue. >>> >>> >>> >>> -- >> You received this message because you are subscribed to the Google Groups >> "Foreman users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to foreman-user...@googlegroups.com . >> To post to this group, send email to forema...@googlegroups.com >> . >> Visit this group at http://groups.google.com/group/foreman-users. >> For more options, visit https://groups.google.com/d/optout. >> >
6

That does indicate 2.1.2. What is your setup when hitting this? Single
server? Capsules? Any environments assigned? Can you see any errors in
messages ? You can upload a foreman - debug for us to examine as well.

Eric

··· On Apr 15, 2015 12:09 AM, "Nathan Peters" wrote:

ruby193-rubygem-katello.noarch 2.1.2-3.el7

Hmm, does that mean I do have 2.1.2?

If that’s the case then the task bug definitely still exists in this
version. I’ve installed this on 2 different machines and both of them go
into error mode frequently (every 30 minutes or so) when syncing
repositories.

On Tuesday, April 14, 2015 at 8:59:51 PM UTC-7, Eric Helms wrote:

What version of ruby193-rubygems-katello ?
On Apr 14, 2015 11:56 PM, “Nathan Peters” nathanp...@gmail.com wrote:

I’m not sure what I’m doing wrong then, but I cant’ seem to get upgraded
to 2.1.2. In fact I only installed this last week so I’m not sure why I’m
at 2.1.0 then since apparently 2.1.2 was out 25 days ago.

in my yum installed list I have

katello-repos.noarch 2.1.3-1.el7
katello-installer.noarch 2.1.1-4.el7
katello.noarch 2.1.0-2.el7

I’ve ran katello-installer --upgrade several times it runs successfully
but stays at the same version.

I’ve tried yum clean all and yum -y update and everything says it’s up
to date.

Also tried updating the repos by yum update -y http://fedorapeople.org/
groups/katello/releases/yum/2.1/katello/RHEL/7Server/x86_64/
katello-repos-latest.rpm

But that also claimed that they were already up to date.

Not sure I entirely follow. Katello 2.1.2 has been released with the
fix - so updating to that version of the packages and restarting services
should get you past this issue.

–
You received this message because you are subscribed to the Google
Groups “Foreman users” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to foreman-user...@googlegroups.com.
To post to this group, send email to forema...@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

7

It looks like I have it working finally. Because the katello.rpm was
listed as 2.1.0 and I didn't know the actual version was listed in
rubygem-katello I had assumed I had 2.1.0. The manual also seems very
unclear on this as it states the current version is 2.1 with no minor
version info. You actually have to do a bit of digging into the patch
release notes to figure out what the actual minor version is.

I commented out the qpid stuff in the yaml file as the bug report suggested
and then had to go through into the dynflow console and manually resume
about 200 candlepin and repo sync jobs that were in error state. Then I
restarted the services, waiting for some more jobs to error our, resumed or
skipped them, rebooted the server, and I was finally able to sync repos now.

··· On Tuesday, April 14, 2015 at 9:15:41 PM UTC-7, Eric Helms wrote: > > That does indicate 2.1.2. What is your setup when hitting this? Single > server? Capsules? Any environments assigned? Can you see any errors in > messages ? You can upload a foreman - debug for us to examine as well. > > Eric > >
8

Nevermind, I spoke too soon. It worked for several small repos, but now I
just tried to do an 8GB repo and here's the error logs from the errors tab
of the tasks view.

Action:

Actions::ElasticSearch::Repository::IndexContent

Input:

{"dependency"=>
[{"exception"=>nil,
"task_type"=>"pulp.server.tasks.repository.sync_with_auto_publish",
"_href"=>"/pulp/api/v2/tasks/76583d22-634a-42bf-b035-7cc81a5311a6/",
"task_id"=>"76583d22-634a-42bf-b035-7cc81a5311a6",
"tags"=>
["pulp:repository:My_Company-CentOS_7-Internal_CentOS_7",
"pulp:action:sync"],
"finish_time"=>"2015-04-15T17:41:32Z",
"_ns"=>"task_status",
"start_time"=>"2015-04-15T17:41:32Z",
"traceback"=>nil,
"spawned_tasks"=>
[{"_href"=>"/pulp/api/v2/tasks/70447739-9f22-4456-b58a-f54a24233732/",
"task_id"=>"70447739-9f22-4456-b58a-f54a24233732"},
{"_href"=>"/pulp/api/v2/tasks/7c820048-e198-44f4-a84e-fb5e48ac7e8e/",
"task_id"=>"7c820048-e198-44f4-a84e-fb5e48ac7e8e"}],
"progress_report"=>
{"yum_importer"=>
{"content"=>
{"size_total"=>0,
"items_left"=>0,
"items_total"=>0,
"state"=>"FINISHED",
"size_left"=>0,
"details"=>
{"rpm_total"=>0, "rpm_done"=>0, "drpm_total"=>0, "drpm_done"=>0},
"error_details"=>[]},
"comps"=>{"state"=>"FINISHED"},
"distribution"=>
{"items_total"=>6,
"state"=>"FINISHED",
"error_details"=>[],
"items_left"=>0},
"errata"=>{"state"=>"FINISHED"},
"metadata"=>{"state"=>"FINISHED"}}},
"queue"=>"reserved_resource_worker-0@katello.dq",
"state"=>"finished",
"result"=>
{"importer_type_id"=>"yum_importer",
"importer_id"=>"yum_importer",
"exception"=>nil,
"repo_id"=>"My_Company-CentOS_7-Internal_CentOS_7",
"removed_count"=>0,
"started"=>"2015-04-15T17:38:06Z",
"_ns"=>"repo_sync_results",
"completed"=>"2015-04-15T17:41:30Z",
"traceback"=>nil,
"summary"=>
{"content"=>{"state"=>"FINISHED"},
"comps"=>{"state"=>"FINISHED"},
"distribution"=>{"state"=>"FINISHED"},
"errata"=>{"state"=>"FINISHED"},
"metadata"=>{"state"=>"FINISHED"}},
"added_count"=>0,
"error_message"=>nil,
"updated_count"=>100,
"details"=>
{"content"=>
{"size_total"=>0,
"items_left"=>0,
"items_total"=>0,
"state"=>"FINISHED",
"size_left"=>0,
"details"=>
{"rpm_total"=>0, "rpm_done"=>0, "drpm_total"=>0, "drpm_done"=>0},
"error_details"=>[]},
"comps"=>{"state"=>"FINISHED"},
"distribution"=>
{"items_total"=>6,
"state"=>"FINISHED",
"error_details"=>[],
"items_left"=>0},
"errata"=>{"state"=>"FINISHED"},
"metadata"=>{"state"=>"FINISHED"}},
"id"=>"552ea2ca229dcf199517de3f",
"result"=>"success"},
"error"=>nil,
"_id"=>{"$oid"=>"552ea1fe8b7c82e0f6949236"},
"id"=>"552ea1fe229dcf193822f5b5"},
{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.publish.publish",
"_href"=>"/pulp/api/v2/tasks/70447739-9f22-4456-b58a-f54a24233732/",
"task_id"=>"70447739-9f22-4456-b58a-f54a24233732",
"tags"=>
["pulp:repository:My_Company-CentOS_7-Internal_CentOS_7",
"pulp:action:publish"],
"finish_time"=>"2015-04-15T17:53:44Z",
"_ns"=>"task_status",
"start_time"=>"2015-04-15T17:41:32Z",
"traceback"=>nil,
"spawned_tasks"=>[],
"progress_report"=>{},
"queue"=>"reserved_resource_worker-0@katello.dq",
"state"=>"finished",
"result"=>
{"exception"=>nil,
"repo_id"=>"My_Company-CentOS_7-Internal_CentOS_7",
"started"=>"2015-04-15T17:41:32Z",
"_ns"=>"repo_publish_results",
"completed"=>"2015-04-15T17:53:44Z",
"traceback"=>nil,
"distributor_type_id"=>"nodes_http_distributor",
"summary"=>"succeeded",
"error_message"=>nil,
"details"=>{"unit_count"=>8565},
"distributor_id"=>"My_Company-CentOS_7-Internal_CentOS_7_nodes",
"id"=>"552ea5a8229dcf199517de42",
"result"=>"success"},
"error"=>nil,
"_id"=>{"$oid"=>"552ea2cb8b7c82e0f6949239"},
"id"=>"552ea2cb229dcf199517de40"},
{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.publish.publish",
"_href"=>"/pulp/api/v2/tasks/7c820048-e198-44f4-a84e-fb5e48ac7e8e/",
"task_id"=>"7c820048-e198-44f4-a84e-fb5e48ac7e8e",
"tags"=>
["pulp:repository:My_Company-CentOS_7-Internal_CentOS_7",
"pulp:action:publish"],
"finish_time"=>"2015-04-15T17:54:30Z",
"_ns"=>"task_status",
"start_time"=>"2015-04-15T17:53:45Z",
"traceback"=>nil,
"spawned_tasks"=>[],
"progress_report"=>
{"My_Company-CentOS_7-Internal_CentOS_7"=>
[{"num_success"=>1,
"description"=>"Copying files",
"step_type"=>"save_tar",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"e23bf6bb-9f7b-495d-8cdd-7c60222bb8dd",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Initializing repo metadata",
"step_type"=>"initialize_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"9112d93a-554d-4232-a908-7b26a6bbff72",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Publishing Distribution files",
"step_type"=>"distribution",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"dde39d1a-b129-4916-8a64-69d82cb4f445",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Publishing RPMs",
"step_type"=>"rpms",
"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"d015ea27-68ab-49a7-9d46-da1ba65d3b9e",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Publishing Delta RPMs",
"step_type"=>"drpms",
"items_total"=>1,
"state"=>"SKIPPED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"9cf36c05-9043-4efa-b363-fa881901bf85",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Publishing Errata",
"step_type"=>"errata",
"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"cd3f5300-9d5c-4e34-9314-c83b618f5d80",
"num_processed"=>0},
{"num_success"=>99,
"description"=>"Publishing Comps file",
"step_type"=>"comps",
"items_total"=>99,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"c0b7df56-c958-470b-a751-9bba29601b9f",
"num_processed"=>99},
{"num_success"=>0,
"description"=>"Publishing Metadata.",
"step_type"=>"metadata",
"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"f058605b-122e-4713-888e-40282e288774",
"num_processed"=>0},
{"num_success"=>1,
"description"=>"Closing repo metadata",
"step_type"=>"close_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"53a31820-4af3-483d-9353-1e64f408e13b",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Generating sqlite files",
"step_type"=>"generate sqlite",
"items_total"=>1,
"state"=>"SKIPPED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"564ab98f-9f69-4b00-905e-1c6302f2c14e",
"num_processed"=>0},
{"num_success"=>1,
"description"=>"Publishing files to web",
"step_type"=>"publish_directory",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"2c463fd0-689f-4bf5-9ef2-a284f3279a5a",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Writing Listings File",
"step_type"=>"initialize_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"3e42cd24-c451-46c6-b4da-e2bddbbb90b9",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Writing Listings File",
"step_type"=>"initialize_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"0e0d1ce8-8a75-4928-8950-a650390cb304",
"num_processed"=>1}]},
"queue"=>"reserved_resource_worker-0@katello.dq",
"state"=>"finished",
"result"=>
{"exception"=>nil,
"repo_id"=>"My_Company-CentOS_7-Internal_CentOS_7",
"started"=>"2015-04-15T17:53:45Z",
"_ns"=>"repo_publish_results",
"completed"=>"2015-04-15T17:54:29Z",
"traceback"=>nil,
"distributor_type_id"=>"yum_distributor",
"summary"=>
{"generate sqlite"=>"SKIPPED",
"initialize_repo_metadata"=>"FINISHED",
"rpms"=>"FINISHED",
"close_repo_metadata"=>"FINISHED",
"drpms"=>"SKIPPED",
"comps"=>"FINISHED",
"distribution"=>"FINISHED",
"metadata"=>"FINISHED",
"publish_directory"=>"FINISHED",
"errata"=>"FINISHED",
"save_tar"=>"FINISHED"},
"error_message"=>nil,
"details"=>
[{"num_success"=>1,
"description"=>"Copying files",
"step_type"=>"save_tar",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"e23bf6bb-9f7b-495d-8cdd-7c60222bb8dd",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Initializing repo metadata",
"step_type"=>"initialize_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"9112d93a-554d-4232-a908-7b26a6bbff72",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Publishing Distribution files",
"step_type"=>"distribution",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"dde39d1a-b129-4916-8a64-69d82cb4f445",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Publishing RPMs",
"step_type"=>"rpms",
"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"d015ea27-68ab-49a7-9d46-da1ba65d3b9e",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Publishing Delta RPMs",
"step_type"=>"drpms",
"items_total"=>1,
"state"=>"SKIPPED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"9cf36c05-9043-4efa-b363-fa881901bf85",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Publishing Errata",
"step_type"=>"errata",
"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"cd3f5300-9d5c-4e34-9314-c83b618f5d80",
"num_processed"=>0},
{"num_success"=>99,
"description"=>"Publishing Comps file",
"step_type"=>"comps",
"items_total"=>99,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"c0b7df56-c958-470b-a751-9bba29601b9f",
"num_processed"=>99},
{"num_success"=>0,
"description"=>"Publishing Metadata.",
"step_type"=>"metadata",
"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"f058605b-122e-4713-888e-40282e288774",
"num_processed"=>0},
{"num_success"=>1,
"description"=>"Closing repo metadata",
"step_type"=>"close_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"53a31820-4af3-483d-9353-1e64f408e13b",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Generating sqlite files",
"step_type"=>"generate sqlite",
"items_total"=>1,
"state"=>"SKIPPED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"564ab98f-9f69-4b00-905e-1c6302f2c14e",
"num_processed"=>0},
{"num_success"=>1,
"description"=>"Publishing files to web",
"step_type"=>"publish_directory",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"2c463fd0-689f-4bf5-9ef2-a284f3279a5a",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Writing Listings File",
"step_type"=>"initialize_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"3e42cd24-c451-46c6-b4da-e2bddbbb90b9",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Writing Listings File",
"step_type"=>"initialize_repo_metadata",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"num_failures"=>0,
"step_id"=>"0e0d1ce8-8a75-4928-8950-a650390cb304",
"num_processed"=>1}],
"distributor_id"=>"My_Company-CentOS_7-Internal_CentOS_7",
"id"=>"552ea5d5229dcf199517de4b",
"result"=>"success"},
"error"=>nil,
"_id"=>{"$oid"=>"552ea2cc8b7c82e0f694923b"},
"id"=>"552ea2cc229dcf199517de41"}],
"id"=>1,
"remote_user"=>"admin-375a9869",
"remote_cp_user"=>"admin",
"locale"=>"en"}

Output:

{}

Exception:

RestClient::RequestTimeout: Request Timeout

Backtrace:

/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:56:in
rescue in transmit' /opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:11:intransmit'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:64:in
execute' /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:33:inexecute'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/resource.rb:67:in
post' /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/base.rb:91:inget_response'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/base.rb:82:in
call' /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/resources/repository.rb:161:inunit_search'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:151:in
block in rpm_ids&#39; /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:139:in<<'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:139:in
block (2 levels) in rpm_ids&#39; /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:138:inloop'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:138:in
block in rpm_ids&#39; /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:145:ineach'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:145:in
each&#39; /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:145:inreduce'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:145:in
rescue in rpm_ids&#39; /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/extensions/repository.rb:130:inrpm_ids'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/models/katello/glue/pulp/repo.rb:245:in
package_ids&#39; /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/models/katello/glue/pulp/repo.rb:302:inpackages'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/models/katello/glue/elastic_search/repository.rb:61:in
index_packages&#39; /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/models/katello/glue/elastic_search/repository.rb:123:inindex_content'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/elastic_search/repository/index_content.rb:24:in
run&#39; /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:443:inblock (3 levels) in execute_run'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:26:in
call&#39; /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:26:inpass'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware.rb:16:in
pass&#39; /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/middleware/remote_action.rb:27:inblock in run'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/middleware/remote_action.rb:57:in
block (2 levels) in as_remote_user&#39; /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/util/thread_session.rb:84:inpulp_config'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/middleware/remote_action.rb:43:in
as_pulp_user&#39; /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/middleware/remote_action.rb:56:inblock in as_remote_user'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/util/thread_session.rb:91:in
cp_config&#39; /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/middleware/remote_action.rb:38:inas_cp_user'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/middleware/remote_action.rb:55:in
`as_remote_user'
/opt/rh/ruby

9

I have this on about 2 dozen repos pretty much every night on 2.1.2. I
haven't had much time to spend on it but it definitely seems load related.

I tried updating my synch schedules to spread out the load but ran into
issues with the phantom synch schedules. I tried the sync schedule cleanup
task but it's returning an exception. In the meantime, I've been hoping it
was solved in 2.2.

··· On Wednesday, April 15, 2015 at 2:09:47 PM UTC-4, Nathan Peters wrote: > > Nevermind, I spoke too soon. It worked for several small repos, but now I > just tried to do an 8GB repo and here's the error logs from the errors tab > of the tasks view. > > Exception: > > RestClient::RequestTimeout: Request Timeout > > Backtrace: > > /opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in > `block in create_with_logging_context' > >