Discovered repo not synching packages

Support
1

Hi,

After doing a discovery on
"https://fedorapeople.org/groups/katello/releases/yum/3.1/" and adding
the different repo's in it, I have two repositories that are not syncing
any packages. The package count is 0 while there are multiple packages
in it.

The problematic repo's are:

client el7 x86_64

candlepin el7 x86_64


2016-10-06 10:09:49 [app] [I] Started POST
"/katello/api/v2/repositories/sync_complete?token=******************"
for **.***.***.** at 2016-10-06 10:09:49 +0200
2016-10-06 10:09:49 [app] [I] Processing by
Katello::Api::V2::RepositoriesController#sync_complete as */*
2016-10-06 10:09:49 [app] [I]   Parameters:
{"call_report"=>"[FILTERED]", "event_type"=>"repo.sync.finish",
"payload"=>{"importer_id"=>"yum_importer", "exception"=>nil,
"repo_id"=>"Netbulae-Katello-candlepin_el7_x86_64",
"traceback"=>nil, "started"=>"2016-10-06T08:09:21Z",
"_ns"=>"repo_sync_results", "completed"=>"2016-10-06T08:09:49Z",
"importer_type_id"=>"yum_importer", "error_message"=>nil,
"summary"=>{"content"=>{"state"=>"FINISHED"},
"comps"=>{"state"=>"FINISHED"},
"purge_duplicates"=>{"state"=>"FINISHED"},
"distribution"=>{"state"=>"FINISHED"},
"errata"=>{"state"=>"FINISHED"}, "metadata"=>{"state"=>"FINISHED"}},
"added_count"=>0, "result"=>"success", "updated_count"=>0,
"details"=>{"content"=>{"size_total"=>0, "items_left"=>0,
"items_total"=>0, "state"=>"FINISHED", "size_left"=>0,
"details"=>{"rpm_total"=>0, "rpm_done"=>0, "drpm_total"=>0,
"drpm_done"=>0}, "error_details"=>nil},
"comps"=>{"state"=>"FINISHED"},
"purge_duplicates"=>{"state"=>"FINISHED"},
"distribution"=>{"items_total"=>0, "state"=>"FINISHED",
"error_details"=>nil, "items_left"=>0},
"errata"=>{"state"=>"FINISHED"}, "metadata"=>{"state"=>"FINISHED"}},
"id"=>"57f606cd67e2350812c36e23", "removed_count"=>0},
"token"=>"******************", "api_version"=>"v2", "repository"=>{}}
2016-10-06 10:09:49 [app] [I] Sync_complete called for candlepin el7
x86_64, running after_sync.
2016-10-06 10:09:49 [app] [I] Completed 200 OK in 36ms (Views: 0.3ms
> ActiveRecord: 1.9ms)

When I add the repo manually with
"https://fedorapeople.org/groups/katello/releases/yum/3.1/client/el7/x86_64/"
it syncs perfectly.

Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts

··· ---------------- 
Tel: 053 20 30 270 	info@netbulae.eu 	Staalsteden 4-3A 	KvK 08198180
Fax: 053 20 30 271 	www.netbulae.eu 	7547 TA Enschede 	BTW NL821234584B01
2

Hi Jorick,

> After doing a discovery on [ https://fedorapeople.org/groups/katello/releases/yum/3.1/ | "https://fedorapeople.org/groups/katello/releases/yum/3.1/" ] and adding the different repo's in it, I have two repositories that are not syncing any packages. The package count is 0 while there are multiple packages in it.

I have found during my testing that it can be somewhat easy to temporarily get the UI out of sync with Pulp - meaning that Pulp is syncing packages but Katello is reporting 0 packages in a repository but /var/lib/pulp/<path> is populated - when going through multiple create/delete operations in a short period of time. I believe this happens because maintenance tasks aren't getting a chance to run (for example, to remove orphaned packages).

For me the issue has cleared itself up within a day or so (after maintenance tasks have had a chance to run), but I have also been able to force a fix by setting "force_post_sync_actions" to "true" in Administer -> Settings -> Content, then syncing the repository in question. (credit goes to JSherrill for that idea)

Outside of that, I would compare the "discovered" repo URL to your manual setting.

Hope this helps,

j

··· From: "Jorick Astrego" To: foreman-users@googlegroups.com Sent: Thursday, October 6, 2016 3:16:54 AM Subject: [foreman-users] discovered repo not synching packages

Hi,

After doing a discovery on [ https://fedorapeople.org/groups/katello/releases/yum/3.1/ | “https://fedorapeople.org/groups/katello/releases/yum/3.1/” ] and adding the different repo’s in it, I have two repositories that are not syncing any packages. The package count is 0 while there are multiple packages in it.

The problematic repo’s are:

client el7 x86_64

candlepin el7 x86_64

BQ_BEGIN

2016-10-06 10:09:49 [app] [I] Started POST “/katello/api/v2/repositories/sync_complete?token=******************” for .*.*. at 2016-10-06 10:09:49 +0200
2016-10-06 10:09:49 [app] [I] Processing by Katello::Api::V2::RepositoriesController#sync_complete as /
2016-10-06 10:09:49 [app] [I] Parameters: {“call_report”=>"[FILTERED]", “event_type”=>“repo.sync.finish”, “payload”=>{“importer_id”=>“yum_importer”, “exception”=>nil, “repo_id”=>“Netbulae-Katello-candlepin_el7_x86_64”, “traceback”=>nil, “started”=>“2016-10-06T08:09:21Z”, “_ns”=>“repo_sync_results”, “completed”=>“2016-10-06T08:09:49Z”, “importer_type_id”=>“yum_importer”, “error_message”=>nil, “summary”=>{“content”=>{“state”=>“FINISHED”}, “comps”=>{“state”=>“FINISHED”}, “purge_duplicates”=>{“state”=>“FINISHED”}, “distribution”=>{“state”=>“FINISHED”}, “errata”=>{“state”=>“FINISHED”}, “metadata”=>{“state”=>“FINISHED”}}, “added_count”=>0, “result”=>“success”, “updated_count”=>0, “details”=>{“content”=>{“size_total”=>0, “items_left”=>0, “items_total”=>0, “state”=>“FINISHED”, “size_left”=>0, “details”=>{“rpm_total”=>0, “rpm_done”=>0, “drpm_total”=>0, “drpm_done”=>0}, “error_details”=>nil}, “comps”=>{“state”=>“FINISHED”}, “purge_duplicates”=>{“state”=>“FINISHED”}, “distribution”=>{“items_total”=>0, “state”=>“FINISHED”, “error_details”=>nil, “items_left”=>0}, “errata”=>{“state”=>“FINISHED”}, “metadata”=>{“state”=>“FINISHED”}}, “id”=>“57f606cd67e2350812c36e23”, “removed_count”=>0}, “token”=>"******************", “api_version”=>“v2”, “repository”=>{}}
2016-10-06 10:09:49 [app] [I] Sync_complete called for candlepin el7 x86_64, running after_sync.
2016-10-06 10:09:49 [app] [I] Completed 200 OK in 36ms (Views: 0.3ms | ActiveRecord: 1.9ms)

BQ_END

When I add the repo manually with [ https://fedorapeople.org/groups/katello/releases/yum/3.1/client/el7/x86_64/ | “https://fedorapeople.org/groups/katello/releases/yum/3.1/client/el7/x86_64/” ] it syncs perfectly.

Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts

Tel: 053 20 30 270 info@netbulae.eu Staalsteden 4-3A KvK 08198180
Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01

–
You received this message because you are subscribed to the Google Groups “Foreman users” group.
To unsubscribe from this group and stop receiving emails from it, send an email to [ mailto:foreman-users+unsubscribe@googlegroups.com | foreman-users+unsubscribe@googlegroups.com ] .
To post to this group, send email to [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ] .
Visit this group at [ https://groups.google.com/group/foreman-users | https://groups.google.com/group/foreman-users ] .
For more options, visit [ https://groups.google.com/d/optout | https://groups.google.com/d/optout ] .

3

Yes, it cleared itself up after time. Thanks for the info, so I know why.

Regards,

Jorick

··· On 10/06/2016 03:41 PM, 'Jason B. Nance' via Foreman users wrote: > Hi Jorick, > > > After doing a discovery > on"https://fedorapeople.org/groups/katello/releases/yum/3.1/"and > adding the different repo's in it, I have two repositories that are > not syncing any packages. The package count is 0 while there are > multiple packages in it. > > I have found during my testing that it can be somewhat easy to > temporarily get the UI out of sync with Pulp - meaning that Pulp is > syncing packages but Katello is reporting 0 packages in a repository > but /var/lib/pulp/ is populated - when going through multiple > create/delete operations in a short period of time. I believe this > happens because maintenance tasks aren't getting a chance to run (for > example, to remove orphaned packages). > > For me the issue has cleared itself up within a day or so (after > maintenance tasks have had a chance to run), but I have also been able > to force a fix by setting "force_post_sync_actions" to "true" in > Administer -> Settings -> Content, then syncing the repository in > question. (credit goes to JSherrill for that idea) > > Outside of that, I would compare the "discovered" repo URL to your > manual setting. > > Hope this helps, > > j > > > ------------------------------------------------------------------------ > *From: *"Jorick Astrego" > *To: *foreman-users@googlegroups.com > *Sent: *Thursday, October 6, 2016 3:16:54 AM > *Subject: *[foreman-users] discovered repo not synching packages > > Hi, > > After doing a discovery on > "https://fedorapeople.org/groups/katello/releases/yum/3.1/" and adding > the different repo's in it, I have two repositories that are not > syncing any packages. The package count is 0 while there are multiple > packages in it. > > The problematic repo's are: > > client el7 x86_64 > > candlepin el7 x86_64 > > > 2016-10-06 10:09:49 [app] [I] Started POST > "/katello/api/v2/repositories/sync_complete?token=******************" > for **.***.***.** at 2016-10-06 10:09:49 +0200 > 2016-10-06 10:09:49 [app] [I] Processing by > Katello::Api::V2::RepositoriesController#sync_complete as */* > 2016-10-06 10:09:49 [app] [I] Parameters: > {"call_report"=>"[FILTERED]", "event_type"=>"repo.sync.finish", > "payload"=>{"importer_id"=>"yum_importer", "exception"=>nil, > "repo_id"=>"Netbulae-Katello-candlepin_el7_x86_64", > "traceback"=>nil, "started"=>"2016-10-06T08:09:21Z", > "_ns"=>"repo_sync_results", "completed"=>"2016-10-06T08:09:49Z", > "importer_type_id"=>"yum_importer", "error_message"=>nil, > "summary"=>{"content"=>{"state"=>"FINISHED"}, > "comps"=>{"state"=>"FINISHED"}, > "purge_duplicates"=>{"state"=>"FINISHED"}, > "distribution"=>{"state"=>"FINISHED"}, > "errata"=>{"state"=>"FINISHED"}, > "metadata"=>{"state"=>"FINISHED"}}, "added_count"=>0, > "result"=>"success", "updated_count"=>0, > "details"=>{"content"=>{"size_total"=>0, "items_left"=>0, > "items_total"=>0, "state"=>"FINISHED", "size_left"=>0, > "details"=>{"rpm_total"=>0, "rpm_done"=>0, "drpm_total"=>0, > "drpm_done"=>0}, "error_details"=>nil}, > "comps"=>{"state"=>"FINISHED"}, > "purge_duplicates"=>{"state"=>"FINISHED"}, > "distribution"=>{"items_total"=>0, "state"=>"FINISHED", > "error_details"=>nil, "items_left"=>0}, > "errata"=>{"state"=>"FINISHED"}, > "metadata"=>{"state"=>"FINISHED"}}, > "id"=>"57f606cd67e2350812c36e23", "removed_count"=>0}, > "token"=>"******************", "api_version"=>"v2", "repository"=>{}} > 2016-10-06 10:09:49 [app] [I] Sync_complete called for candlepin > el7 x86_64, running after_sync. > 2016-10-06 10:09:49 [app] [I] Completed 200 OK in 36ms (Views: > 0.3ms | ActiveRecord: 1.9ms) > > When I add the repo manually with > "https://fedorapeople.org/groups/katello/releases/yum/3.1/client/el7/x86_64/" > it syncs perfectly. > > > > > > > > Met vriendelijke groet, With kind regards, > > Jorick Astrego > * > Netbulae Virtualization Experts * > ------------------------------------------------------------------------ > Tel: 053 20 30 270 info@netbulae.eu Staalsteden 4-3A KvK 08198180 > Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01 > > > ------------------------------------------------------------------------ > > -- > You received this message because you are subscribed to the Google > Groups "Foreman users" group. > To unsubscribe from this group and stop receiving emails from it, send > an email to foreman-users+unsubscribe@googlegroups.com > . > To post to this group, send email to foreman-users@googlegroups.com > . > Visit this group at https://groups.google.com/group/foreman-users. > For more options, visit https://groups.google.com/d/optout. > -- > You received this message because you are subscribed to the Google > Groups "Foreman users" group. > To unsubscribe from this group and stop receiving emails from it, send > an email to foreman-users+unsubscribe@googlegroups.com > . > To post to this group, send email to foreman-users@googlegroups.com > . > Visit this group at https://groups.google.com/group/foreman-users. > For more options, visit https://groups.google.com/d/optout.

Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts

Tel: 053 20 30 270 	info@netbulae.eu 	Staalsteden 4-3A 	KvK 08198180
Fax: 053 20 30 271 	www.netbulae.eu 	7547 TA Enschede 	BTW NL821234584B01