Content hosts unvailable - katello 2.1 / Foreman 1.7.3 (...Resources::Candlepin::Consumer: 410 Gone)

Raphael_Kropp · March 25, 2015, 11:21am

Hello,

I'm running katello 2.1 on rhel 7.1 x86_64. After a manipulation I've made
I'm not able to reach the content hosts page anymore. If I remember well it
was after deleting an activation key and/or a content view on which a
content host was linked to. Since that manipulation I can't see any content
hosts anymore.

That's what I get when I try to go on that page:

<https://lh3.googleusercontent.com/-iGYzuMlqR_w/VRKW0FBXVCI/AAAAAAAAAII/2pWsrqHU-Io/s1600/Capture.PNG>

Same request in CLI:
[root@host~]# hammer -u xxxxxx content-host list --organization yyyy
[Foreman] password for xxxxxx:
Katello::Resources::Candlepin::Consumer: 410 Gone {"displayMessage":"Unit
a2c3db96-1ddd-48aa-a76e-576315db9c6b has been
deleted","requestUuid":"5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed","deletedId":"a2c3db96-1ddd-48aa-a76e-576315db9c6b"}
(GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b)

When I try to delete that content host id:
[root@host~]# hammer -u xxxxxx content-host delete --id
a2c3db96-1ddd-48aa-a76e-576315db9c6b
[Foreman] password for xxxxxx:
Could not delete content host:
Task f885cfed-0844-4a2b-8997-92ce05099dd4:
Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b
has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found

That task stays on error and i'm forced to Unlock it. This is the Exception
message of the task:

RestClient::ResourceNotFound: 404 Resource Not Found

Does anyone have a work-around for this situation ?

Regards,

R.

ehelms · March 25, 2015, 5:26pm

Howdy,

There is a rake task you can run to cleanup these situations:

foreman-rake clean_backend_objects

Eric

···

On Wed, Mar 25, 2015 at 7:21 AM, Raphael Kropp wrote:

Hello,

I’m running katello 2.1 on rhel 7.1 x86_64. After a manipulation I’ve made
I’m not able to reach the content hosts page anymore. If I remember well it
was after deleting an activation key and/or a content view on which a
content host was linked to. Since that manipulation I can’t see any content
hosts anymore.

That’s what I get when I try to go on that page:

https://lh3.googleusercontent.com/-iGYzuMlqR_w/VRKW0FBXVCI/AAAAAAAAAII/2pWsrqHU-Io/s1600/Capture.PNG

Same request in CLI:
[root@host~]# hammer -u xxxxxx content-host list --organization yyyy
[Foreman] password for xxxxxx:
Katello::Resources::Candlepin::Consumer: 410 Gone {“displayMessage”:“Unit
a2c3db96-1ddd-48aa-a76e-576315db9c6b has been
deleted”,“requestUuid”:“5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed”,“deletedId”:“a2c3db96-1ddd-48aa-a76e-576315db9c6b”}
(GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b)

When I try to delete that content host id:
[root@host~]# hammer -u xxxxxx content-host delete --id
a2c3db96-1ddd-48aa-a76e-576315db9c6b
[Foreman] password for xxxxxx:
Could not delete content host:
Task f885cfed-0844-4a2b-8997-92ce05099dd4:
Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b
has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found

That task stays on error and i’m forced to Unlock it. This is the
Exception message of the task:

RestClient::ResourceNotFound: 404 Resource Not Found

Does anyone have a work-around for this situation ?

Regards,

R.

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

John_Beranek · June 12, 2015, 8:59am

Getting similar issues syncing repositories on our Katello 2.1
installation. Output from katello:clean_backend_objects:

foreman-rake katello:clean_backend_objects --trace

** Invoke katello:clean_backend_objects (first_time)
** Invoke environment (first_time)
** Execute environment
** Execute katello:clean_backend_objects
rake aborted!
Expect initializer to return hash if a group of attributes is defined by
lazy_accessor
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/lazy_accessor.rb:177:in
run_initializer' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/lazy_accessor.rb:154:inlazy_attribute_get'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/lazy_accessor.rb:74:in
block (2 levels) in lazy_accessor' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/lib/katello/tasks/clean_backend_objects.rake:11:inblock in cleanup_systems'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in
block (2 levels) in find_each' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:ineach'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in
block in find_each' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:72:infind_in_batches'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:20:in
find_each' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/querying.rb:8:infind_each'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/lib/katello/tasks/clean_backend_objects.rake:5:in
cleanup_systems' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/lib/katello/tasks/clean_backend_objects.rake:57:inblock (2 levels) in <top (required)>'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:205:in call' /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:205:inblock in execute'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:200:in each' /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:200:inexecute'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:158:in block in invoke_with_call_chain' /opt/rh/ruby193/root/usr/share/ruby/monitor.rb:211:inmon_synchronize'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:151:in
invoke_with_call_chain' /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:144:ininvoke'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:116:in invoke_task' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:inblock (2
levels) in top_level'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:in each' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:inblock in
top_level'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:133:in
standard_exception_handling' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:88:intop_level'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:66:in block in run' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:133:instandard_exception_handling'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:63:in run' /opt/rh/ruby193/root/usr/bin/rake:32:in<main>'
Tasks: TOP => katello:clean_backend_objects

Cheers,

John

···

On Wednesday, 25 March 2015 11:22:10 UTC, Raphael Kropp wrote: > > Hello, > > I'm running katello 2.1 on rhel 7.1 x86_64. After a manipulation I've made > I'm not able to reach the content hosts page anymore. If I remember well it > was after deleting an activation key and/or a content view on which a > content host was linked to. Since that manipulation I can't see any content > hosts anymore. > > That's what I get when I try to go on that page: > > > > > > > > > > > > > > > > Same request in CLI: > [root@host~]# hammer -u xxxxxx content-host list --organization yyyy > [Foreman] password for xxxxxx: > Katello::Resources::Candlepin::Consumer: 410 Gone {"displayMessage":"Unit > a2c3db96-1ddd-48aa-a76e-576315db9c6b has been > deleted","requestUuid":"5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed","deletedId":"a2c3db96-1ddd-48aa-a76e-576315db9c6b"} > (GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b) > > When I try to delete that content host id: > [root@host~]# hammer -u xxxxxx content-host delete --id > a2c3db96-1ddd-48aa-a76e-576315db9c6b > [Foreman] password for xxxxxx: > Could not delete content host: > Task f885cfed-0844-4a2b-8997-92ce05099dd4: > Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b > has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found > > That task stays on error and i'm forced to Unlock it. This is the > Exception message of the task: > > RestClient::ResourceNotFound: 404 Resource Not Found > > Does anyone have a work-around for this situation ? > > Regards, > > R. >

Vladimir_Stackov · March 25, 2015, 6:03pm

Where could I read about katello rake tasks?

···

2015-03-25 20:26 GMT+03:00 Eric D Helms :

Howdy,

There is a rake task you can run to cleanup these situations:

foreman-rake clean_backend_objects

Eric

On Wed, Mar 25, 2015 at 7:21 AM, Raphael Kropp raphael.kropp@gmail.com > wrote:

Hello,

I’m running katello 2.1 on rhel 7.1 x86_64. After a manipulation I’ve
made I’m not able to reach the content hosts page anymore. If I remember
well it was after deleting an activation key and/or a content view on which
a content host was linked to. Since that manipulation I can’t see any
content hosts anymore.

That’s what I get when I try to go on that page:

https://lh3.googleusercontent.com/-iGYzuMlqR_w/VRKW0FBXVCI/AAAAAAAAAII/2pWsrqHU-Io/s1600/Capture.PNG

Same request in CLI:
[root@host~]# hammer -u xxxxxx content-host list --organization yyyy
[Foreman] password for xxxxxx:
Katello::Resources::Candlepin::Consumer: 410 Gone {“displayMessage”:“Unit
a2c3db96-1ddd-48aa-a76e-576315db9c6b has been
deleted”,“requestUuid”:“5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed”,“deletedId”:“a2c3db96-1ddd-48aa-a76e-576315db9c6b”}
(GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b)

When I try to delete that content host id:
[root@host~]# hammer -u xxxxxx content-host delete --id
a2c3db96-1ddd-48aa-a76e-576315db9c6b
[Foreman] password for xxxxxx:
Could not delete content host:
Task f885cfed-0844-4a2b-8997-92ce05099dd4:
Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b
has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found

That task stays on error and i’m forced to Unlock it. This is the
Exception message of the task:

RestClient::ResourceNotFound: 404 Resource Not Found

Does anyone have a work-around for this situation ?

Regards,

R.

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

–
Kind regards,
Vladimir.

Raphael_Kropp · March 26, 2015, 9:12am

Hi Eric,

I've been able to solve my problem with:
foreman-rake katello:clean_backend_objects
Thank's for your help !
Regards,

Raphael

···

Le mercredi 25 mars 2015 18:26:50 UTC+1, Eric Helms a écrit : > > Howdy, > > There is a rake task you can run to cleanup these situations: > > foreman-rake clean_backend_objects > > > Eric > > On Wed, Mar 25, 2015 at 7:21 AM, Raphael Kropp > wrote: > >> Hello, >> >> I'm running katello 2.1 on rhel 7.1 x86_64. After a manipulation I've >> made I'm not able to reach the content hosts page anymore. If I remember >> well it was after deleting an activation key and/or a content view on which >> a content host was linked to. Since that manipulation I can't see any >> content hosts anymore. >> >> That's what I get when I try to go on that page: >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> Same request in CLI: >> [root@host~]# hammer -u xxxxxx content-host list --organization yyyy >> [Foreman] password for xxxxxx: >> Katello::Resources::Candlepin::Consumer: 410 Gone {"displayMessage":"Unit >> a2c3db96-1ddd-48aa-a76e-576315db9c6b has been >> deleted","requestUuid":"5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed","deletedId":"a2c3db96-1ddd-48aa-a76e-576315db9c6b"} >> (GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b) >> >> When I try to delete that content host id: >> [root@host~]# hammer -u xxxxxx content-host delete --id >> a2c3db96-1ddd-48aa-a76e-576315db9c6b >> [Foreman] password for xxxxxx: >> Could not delete content host: >> Task f885cfed-0844-4a2b-8997-92ce05099dd4: >> Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b >> has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found >> >> That task stays on error and i'm forced to Unlock it. This is the >> Exception message of the task: >> >> RestClient::ResourceNotFound: 404 Resource Not Found >> >> Does anyone have a work-around for this situation ? >> >> Regards, >> >> R. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Foreman users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to foreman-user...@googlegroups.com . >> To post to this group, send email to forema...@googlegroups.com >> . >> Visit this group at http://groups.google.com/group/foreman-users. >> For more options, visit https://groups.google.com/d/optout. >> > >

John_Beranek · June 12, 2015, 10:29am

After clearing the stalled sync tasks, and attempting a re-sync on the
repositories which failed to sync, I was left with a single repository that
gives out an error, CentOS 6.6 Extras. The error given by Katello is:

ActiveRecord::RecordNotUnique: PGError: ERROR: duplicate key value violates unique constraint "katello_system_errata_eid_sid"
: INSERT INTO katello_system_errata (erratum_id, system_id) VALUES (7442, 8), (7389, 8), (7489, 8), (7636, 8)

Seems odd, given CentOS doesn't have errata…

Cheers,

John

···

On Friday, 12 June 2015 09:59:25 UTC+1, John Beranek - PA wrote: > > Getting similar issues syncing repositories on our Katello 2.1 > installation. Output from katello:clean_backend_objects: > > # foreman-rake katello:clean_backend_objects --trace > ** Invoke katello:clean_backend_objects (first_time) > ** Invoke environment (first_time) > ** Execute environment > ** Execute katello:clean_backend_objects > rake aborted! > Expect initializer to return hash if a group of attributes is defined by > lazy_accessor > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/lazy_accessor.rb:177:in > `run_initializer' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/lazy_accessor.rb:154:in > `lazy_attribute_get' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/katello/lazy_accessor.rb:74:in > `block (2 levels) in lazy_accessor' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/lib/katello/tasks/clean_backend_objects.rake:11:in > `block in cleanup_systems' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in > `block (2 levels) in find_each' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in > `each' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in > `block in find_each' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:72:in > `find_in_batches' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:20:in > `find_each' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/querying.rb:8:in > `find_each' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/lib/katello/tasks/clean_backend_objects.rake:5:in > `cleanup_systems' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/lib/katello/tasks/clean_backend_objects.rake:57:in > `block (2 levels) in ' > /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:205:in `call' > /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:205:in `block in execute' > /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:200:in `each' > /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:200:in `execute' > /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:158:in `block in > invoke_with_call_chain' > /opt/rh/ruby193/root/usr/share/ruby/monitor.rb:211:in `mon_synchronize' > /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:151:in > `invoke_with_call_chain' > /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:144:in `invoke' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:116:in > `invoke_task' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:in `block (2 > levels) in top_level' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:in `each' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:in `block in > top_level' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:133:in > `standard_exception_handling' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:88:in `top_level' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:66:in `block in > run' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:133:in > `standard_exception_handling' > /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:63:in `run' > /opt/rh/ruby193/root/usr/bin/rake:32:in `' > Tasks: TOP => katello:clean_backend_objects > > Cheers, > > John > > On Wednesday, 25 March 2015 11:22:10 UTC, Raphael Kropp wrote: >> >> Hello, >> >> I'm running katello 2.1 on rhel 7.1 x86_64. After a manipulation I've >> made I'm not able to reach the content hosts page anymore. If I remember >> well it was after deleting an activation key and/or a content view on which >> a content host was linked to. Since that manipulation I can't see any >> content hosts anymore. >> >> That's what I get when I try to go on that page: >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> Same request in CLI: >> [root@host~]# hammer -u xxxxxx content-host list --organization yyyy >> [Foreman] password for xxxxxx: >> Katello::Resources::Candlepin::Consumer: 410 Gone {"displayMessage":"Unit >> a2c3db96-1ddd-48aa-a76e-576315db9c6b has been >> deleted","requestUuid":"5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed","deletedId":"a2c3db96-1ddd-48aa-a76e-576315db9c6b"} >> (GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b) >> >> When I try to delete that content host id: >> [root@host~]# hammer -u xxxxxx content-host delete --id >> a2c3db96-1ddd-48aa-a76e-576315db9c6b >> [Foreman] password for xxxxxx: >> Could not delete content host: >> Task f885cfed-0844-4a2b-8997-92ce05099dd4: >> Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b >> has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found >> >> That task stays on error and i'm forced to Unlock it. This is the >> Exception message of the task: >> >> RestClient::ResourceNotFound: 404 Resource Not Found >> >> Does anyone have a work-around for this situation ? >> >> Regards, >> >> R. >> >

dLobatog · March 26, 2015, 7:12am

> Where could I read about katello rake tasks?

Hi Vladimir,

There isn't a comprehensive list of katello rake tasks in Katello.org.
Each of the sections might contain info about some task if it's
relevant. However, you can see all tasks here:

Probably the most useful ones for users could be:

github.com

Katello/katello/blob/master/lib/katello/tasks/clean_backend_objects.rake

namespace :katello do
  desc "Cleans backend objects (hosts) that are missing in one or more backend systems.  Run with COMMIT=true to commit changes."
  task :clean_backend_objects => ["environment", "check_ping"] do
    class BackendCleaner
      def initialize
        @candlepin_uuids = []
        @katello_candlepin_uuids = []
      end

      def populate!
        @candlepin_uuids = Katello::Resources::Candlepin::Consumer.all_uuids
        @katello_candlepin_uuids = Katello::Host::SubscriptionFacet.pluck(:uuid).compact
      end

      def hosts_with_no_subscriptions
        ::Host.where(:id => Katello::Host::SubscriptionFacet.where(:uuid => @katello_candlepin_uuids - @candlepin_uuids).select(:host_id))
      end

      def hosts_with_nil_facets
        nil_sub = Katello::Host::SubscriptionFacet.where(:uuid => nil).select(:host_id).to_sql

This file has been truncated. show original

github.com

Katello/katello/blob/master/lib/katello/tasks/delete_orphaned_content.rake

namespace :katello do
  desc "Remove orphaned and unneeded content/repos from a smart proxy.\
        Run with SMART_PROXY_ID=1 to run for a single smart proxy."
  task :delete_orphaned_content => ["dynflow:client"] do
    User.current = User.anonymous_admin
    smart_proxy_id = ENV['SMART_PROXY_ID']
    if smart_proxy_id
      proxy = SmartProxy.find(smart_proxy_id)
      remove_orphan(proxy)
    else
      SmartProxy.with_content.uniq.reverse_each do |smart_proxy|
        remove_orphan(smart_proxy)
      end
    end
  end

  def remove_orphan(proxy)
    ForemanTasks.async_task(Actions::Katello::OrphanCleanup::RemoveOrphans, proxy)
    puts _("Orphaned content deletion started in background.")
  rescue RuntimeError => e

This file has been truncated. show original

https://github.com/Katello/katello/blob/master/lib/katello/tasks/regenerate_repo_metadata.rake
https://github.com/Katello/katello/blob/master/lib/katello/tasks/reindex.rake

Hope that helps

···

On 03/25, Vladimir Stackov wrote: > > 2015-03-25 20:26 GMT+03:00 Eric D Helms : > > > Howdy, > > > > There is a rake task you can run to cleanup these situations: > > > > foreman-rake clean_backend_objects > > > > > > Eric > > > > On Wed, Mar 25, 2015 at 7:21 AM, Raphael Kropp > > wrote: > > > >> Hello, > >> > >> I'm running katello 2.1 on rhel 7.1 x86_64. After a manipulation I've > >> made I'm not able to reach the content hosts page anymore. If I remember > >> well it was after deleting an activation key and/or a content view on which > >> a content host was linked to. Since that manipulation I can't see any > >> content hosts anymore. > >> > >> That's what I get when I try to go on that page: > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> Same request in CLI: > >> [root@host~]# hammer -u xxxxxx content-host list --organization yyyy > >> [Foreman] password for xxxxxx: > >> Katello::Resources::Candlepin::Consumer: 410 Gone {"displayMessage":"Unit > >> a2c3db96-1ddd-48aa-a76e-576315db9c6b has been > >> deleted","requestUuid":"5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed","deletedId":"a2c3db96-1ddd-48aa-a76e-576315db9c6b"} > >> (GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b) > >> > >> When I try to delete that content host id: > >> [root@host~]# hammer -u xxxxxx content-host delete --id > >> a2c3db96-1ddd-48aa-a76e-576315db9c6b > >> [Foreman] password for xxxxxx: > >> Could not delete content host: > >> Task f885cfed-0844-4a2b-8997-92ce05099dd4: > >> Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b > >> has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found > >> > >> That task stays on error and i'm forced to Unlock it. This is the > >> Exception message of the task: > >> > >> RestClient::ResourceNotFound: 404 Resource Not Found > >> > >> Does anyone have a work-around for this situation ? > >> > >> Regards, > >> > >> R. > >> > >> -- > >> You received this message because you are subscribed to the Google Groups > >> "Foreman users" group. > >> To unsubscribe from this group and stop receiving emails from it, send an > >> email to foreman-users+unsubscribe@googlegroups.com. > >> To post to this group, send email to foreman-users@googlegroups.com. > >> Visit this group at http://groups.google.com/group/foreman-users. > >> For more options, visit https://groups.google.com/d/optout. > >> > > > > -- > > You received this message because you are subscribed to the Google Groups > > "Foreman users" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to foreman-users+unsubscribe@googlegroups.com. > > To post to this group, send email to foreman-users@googlegroups.com. > > Visit this group at http://groups.google.com/group/foreman-users. > > For more options, visit https://groups.google.com/d/optout. > > > > > > -- > Kind regards, > Vladimir. > > -- > You received this message because you are subscribed to the Google Groups "Foreman users" group. > To unsubscribe from this group and stop receiving emails from it, send an email to foreman-users+unsubscribe@googlegroups.com. > To post to this group, send email to foreman-users@googlegroups.com. > Visit this group at http://groups.google.com/group/foreman-users. > For more options, visit https://groups.google.com/d/optout.

–
Daniel Lobato Garcia

@eLobatoss

GPG: http://keys.gnupg.net/pks/lookup?op=get&search=0x7A92D6DD38D6DE30
Keybase: elobato (Daniel Lobato Garcia) | Keybase

Michael_Bassler1 · April 6, 2015, 6:38pm

I am in a similar state but my foreman-rake katello:clean_backend_objects
fails. RHEL 6.6 host Katello 2.2/Foreman 1.8RC2

hammer -u xxx content-host list --organization xyz
/usr/lib/ruby/gems/1.8/gems/hammer_cli-0.1.4/lib/hammer_cli/./apipie/…/
abstract.rb:68: warning: already initialized constant DEFAULT_LABEL_INDENT
Katello::Resources::Candlepin::Consumer: 410 Gone {"displayMessage":"Unit
cdeb46d7-5562-4342-960d-c4c6a62bfcc0 has been deleted","requestUuid":
"1f036e1d-2790-4470-aafb-416970e40c17","deletedId":
"cdeb46d7-5562-4342-960d-c4c6a62bfcc0"} (GET /candlepin/consumers/cdeb46d7-
5562-4342-960d-c4c6a62bfcc0)

foreman-rake katello:clean_backend_objects
Workaround for RbVmomi may not work as ComputeResource is already loaded:
ComputeResource
System 24 host.example.com 514665f7-ea97-4331-9a6a-6dfd6aab6796 is
partially missing. Cleaning.
rake aborted!
PGError: ERROR: update or delete on table "katello_systems" violates
foreign key constraint "katello_system_repositories_system_id_fk" on table
"katello_system_repositories"
DETAIL: Key (id)=(24) is still referenced from table
"katello_system_repositories".
: DELETE FROM "katello_systems" WHERE "katello_systems"."id" = 24

Tasks: TOP => katello:clean_backend_objects
(See full trace by running task with --trace)

Full Trace:
foreman-rake katello:clean_backend_objects --trace
** Invoke katello:clean_backend_objects (first_time)
** Invoke environment (first_time)
** Execute environment
Workaround for RbVmomi may not work as ComputeResource is already loaded:
ComputeResource
** Execute katello:clean_backend_objects
System 24 host.example.com 514665f7-ea97-4331-9a6a-6dfd6aab6796 is
partially missing. Cleaning.
rake aborted!
PGError: ERROR: update or delete on table "katello_systems" violates
foreign key constraint "katello_system_repositories_system_id_fk" on table
"katello_system_repositories"
DETAIL: Key (id)=(24) is still referenced from table
"katello_system_repositories".
: DELETE FROM "katello_systems" WHERE "katello_systems"."id" = 24
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/
active_record/connection_adapters/postgresql_adapter.rb:1158:in async_exec' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:1158:inexec_no_cache'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:675:in
block in exec_delete' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ active_record/connection_adapters/abstract_adapter.rb:280:inblock in log'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications/instrumenter.rb:20:in
instrument' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract_adapter.rb:275:inlog'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/
active_record/connection_adapters/postgresql_adapter.rb:674:in exec_delete' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/database_statements.rb:101:indelete'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/query_cache.rb:14:in
delete' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ active_record/relation.rb:413:indelete_all'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation.rb:442:in
delete' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/querying.rb:7:indelete'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/
active_record/persistence.rb:119:in delete' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0/lib/katello/tasks/clean_backend_objects.rake:25:inblock in cleanup_systems'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in
block (2 levels) in find_each' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ active_record/relation/batches.rb:21:ineach'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in
block in find_each' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:72:infind_in_batches'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/
active_record/relation/batches.rb:20:in find_each' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/querying.rb:8:infind_each'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0/lib/katello/tasks/clean_backend_objects.rake:5:in
cleanup_systems' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0/lib/katello/tasks/ clean_backend_objects.rake:67:inblock (2 levels) in <top (required)>'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:205:in call' /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:205:inblock in execute'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:200:in each' /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:200:inexecute'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:158:in block in invoke_with_call_chain' /opt/rh/ruby193/root/usr/share/ruby/monitor.rb:211:inmon_synchronize'
/opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:151:in invoke_with_call_chain' /opt/rh/ruby193/root/usr/share/ruby/rake/task.rb:144:ininvoke'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:116:in invoke_task' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:inblock (2
levels) in top_level'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:in each' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:94:inblock in
top_level'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:133:in standard_exception_handling' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:88:intop_level'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:66:in block in run' /opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:133:in
standard_exception_handling'
/opt/rh/ruby193/root/usr/share/ruby/rake/application.rb:63:in run' /opt/rh/ruby193/root/usr/bin/rake:32:in<main>'
caused by: (PGError) ERROR: update or delete on table "katello_systems"
violates foreign key constraint "katello_system_repositories_system_id_fk"
on table "katello_system_repositories"
DETAIL: Key (id)=(24) is still referenced from table
"katello_system_repositories".

... skipped 40 lines

Tasks: TOP => katello:clean_backend_objects

···

On Thursday, March 26, 2015 at 2:12:55 AM UTC-7, Raphael Kropp wrote: > > Hi Eric, > > I've been able to solve my problem with: > foreman-rake katello:clean_backend_objects > Thank's for your help ! > Regards, > > Raphael > > Le mercredi 25 mars 2015 18:26:50 UTC+1, Eric Helms a écrit : >> >> Howdy, >> >> There is a rake task you can run to cleanup these situations: >> >> foreman-rake clean_backend_objects >> >> >> Eric >> >> On Wed, Mar 25, 2015 at 7:21 AM, Raphael Kropp >> wrote: >> >>> Hello, >>> >>> I'm running katello 2.1 on rhel 7.1 x86_64. After a manipulation I've >>> made I'm not able to reach the content hosts page anymore. If I remember >>> well it was after deleting an activation key and/or a content view on which >>> a content host was linked to. Since that manipulation I can't see any >>> content hosts anymore. >>> >>> That's what I get when I try to go on that page: >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> Same request in CLI: >>> [root@host~]# hammer -u xxxxxx content-host list --organization yyyy >>> [Foreman] password for xxxxxx: >>> Katello::Resources::Candlepin::Consumer: 410 Gone >>> {"displayMessage":"Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b has been >>> deleted","requestUuid":"5c7b4eb5-e9fa-4e65-8ec3-dbee889817ed","deletedId":"a2c3db96-1ddd-48aa-a76e-576315db9c6b"} >>> (GET /candlepin/consumers/a2c3db96-1ddd-48aa-a76e-576315db9c6b) >>> >>> When I try to delete that content host id: >>> [root@host~]# hammer -u xxxxxx content-host delete --id >>> a2c3db96-1ddd-48aa-a76e-576315db9c6b >>> [Foreman] password for xxxxxx: >>> Could not delete content host: >>> Task f885cfed-0844-4a2b-8997-92ce05099dd4: >>> Katello::Errors::CandlepinError: Unit a2c3db96-1ddd-48aa-a76e-576315db9c6b >>> has been deleted; RestClient::ResourceNotFound: 404 Resource Not Found >>> >>> That task stays on error and i'm forced to Unlock it. This is the >>> Exception message of the task: >>> >>> RestClient::ResourceNotFound: 404 Resource Not Found >>> >>> Does anyone have a work-around for this situation ? >>> >>> Regards, >>> >>> R. >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Foreman users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to foreman-user...@googlegroups.com. >>> To post to this group, send email to forema...@googlegroups.com. >>> Visit this group at http://groups.google.com/group/foreman-users. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >>

Michael_Bassler1 · April 7, 2015, 3:26pm

I fixed my own issue, I found a task that was in default org to delete the
host in question. I was able to dynflow to skip steps and after clearing
the task I was able to run the katello:clean_backend_objects successfully.

···

On Monday, April 6, 2015 at 11:38:57 AM UTC-7, Michael Bassler wrote: > > I am in a similar state but my foreman-rake katello:clean_backend_objects > fails. RHEL 6.6 host Katello 2.2/Foreman 1.8RC2 > > hammer -u xxx content-host list --organization xyz > /usr/lib/ruby/gems/1.8/gems/hammer_cli-0.1.4/lib/hammer_cli/./apipie/../ > abstract.rb:68: warning: already initialized constant DEFAULT_LABEL_INDENT > Katello::Resources::Candlepin::Consumer: 410 Gone {"displayMessage":"Unit > cdeb46d7-5562-4342-960d-c4c6a62bfcc0 has been deleted","requestUuid": > "1f036e1d-2790-4470-aafb-416970e40c17","deletedId": > "cdeb46d7-5562-4342-960d-c4c6a62bfcc0"} (GET /candlepin/consumers/cdeb46d7 > -5562-4342-960d-c4c6a62bfcc0) > > > foreman-rake katello:clean_backend_objects > Workaround for RbVmomi may not work as ComputeResource is already loaded: > ComputeResource > System 24 host.example.com 514665f7-ea97-4331-9a6a-6dfd6aab6796 is > partially missing. Cleaning. > rake aborted! > PGError: ERROR: update or delete on table "katello_systems" violates > foreign key constraint "katello_system_repositories_system_id_fk" on > table "katello_system_repositories" > DETAIL: Key (id)=(24) is still referenced from table > "katello_system_repositories". > : DELETE FROM "katello_systems" WHERE "katello_systems"."id" = 24 > > Tasks: TOP => katello:clean_backend_objects > (See full trace by running task with --trace) > > Full Trace: > foreman-rake katello:clean_backend_objects --trace > ** Invoke katello:clean_backend_objects (first_time) > ** Invoke environment (first_time) > ** Execute environment > Workaround for RbVmomi may not work as ComputeResource is already loaded: > ComputeResource > ** Execute katello:clean_backend_objects > System 24 host.example.com 514665f7-ea97-4331-9a6a-6dfd6aab6796 is > partially missing. Cleaning. > rake aborted! > PGError: ERROR: update or delete on table "katello_systems" violates > foreign key constraint "katello_system_repositories_system_id_fk" on > table "katello_system_repositories" > DETAIL: Key (id)=(24) is still referenced from table > "katello_system_repositories". > : DELETE FROM "katello_systems" WHERE "katello_systems"."id" = 24 > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ > active_record/connection_adapters/postgresql_adapter.rb:1158:in > `async_exec' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:1158:in > `exec_no_cache' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:675:in > `block in exec_delete' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ > active_record/connection_adapters/abstract_adapter.rb:280:in `block in > log' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications/instrumenter.rb:20:in > `instrument' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract_adapter.rb:275:in > `log' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ > active_record/connection_adapters/postgresql_adapter.rb:674:in > `exec_delete' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/database_statements.rb:101:in > `delete' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/query_cache.rb:14:in > `delete' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ > active_record/relation.rb:413:in `delete_all' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation.rb:442:in > `delete' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/querying.rb:7:in > `delete' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ > active_record/persistence.rb:119:in `delete' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0/lib/katello/tasks/clean_backend_objects.rake:25:in > `block in cleanup_systems' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in > `block (2 levels) in find_each' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/ > active_record/relation/batches.rb:21:in `each' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:21:in > `block in find_each' > /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/batches.rb:72:in > `find_in_batches' > / > ...

Jorick_Astrego · April 7, 2015, 11:15am

Hi,

After the easter weekend I came back to a broken Katello 2.1. My daily
sync plan has several repo's stuck

ActiveRecord::RecordNotUnique: PGError: ERROR:  duplicate key value violates unique constraint &quot;katello_system_errata_eid_sid&quot;
: INSERT INTO katello_system_errata (erratum_id, system_id) VALUES (5442, 2)

I have now restarted the server, resumed the sync tasks, skipped and
resumed the NodeContentGenerator tasks (they wouldn't resume).

But I get more problems and I'm unable to sync some of the repos properly:

Katello::Errors::PulpError: PLP0000: [Errno 2] No such file or directory: &#39;/var/lib/pulp/content/drpm/drpms/spice-gtk-0.20-8.el7_0.22-2.el7.i686.drpm&#39;

Is there a way to clear the repository and reinitialize the sync? Or
should I remove and readd the repo's to get things going again?

From production.log:

Connection reset by peer (Errno::ECONNRESET)
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/serialization.rb:67:in
`gets&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/serialization.rb:67:in
`receive_message&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:44:in
`block in listen&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:38:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:38:in
`listen&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in
`block (3 levels) in initialize&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in
`loop&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in
`block (2 levels) in initialize&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in
`catch&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in
`block in initialize&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
`block in create_with_logging_context&#39;
Client disconnected.
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 23]
because Broken pipe
PGError: ERROR:  duplicate key value violates unique constraint
&quot;katello_system_errata_eid_sid&quot;
: INSERT INTO katello_system_errata (erratum_id, system_id) VALUES
(5442, 2) (ActiveRecord::RecordNotUnique)
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:654:in
`async_exec&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:654:in
`block in execute&#39;

&lt;snip&gt;

/opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:116:in
`block in match&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:115:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:115:in
`match&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/executors/parallel/worker.rb:17:in
`on_message&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:82:in
`on_envelope&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:72:in
`receive&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
`block (2 levels) in run&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
`loop&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
`block in run&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
`catch&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
`run&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:13:in
`block in initialize&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
`block in create_with_logging_context&#39;
caused by: (PGError) ERROR:  duplicate key value violates unique
constraint &quot;katello_system_errata_eid_sid&quot;

    ... skipped 91 lines
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 21]
because Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 24]
because Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 4]
because Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 5]
because Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 13]
because Broken pipe
Processing by HostsController#externalNodes as YML
  Parameters: {&quot;name&quot;=&gt;&quot;back1en.netbulae.mgmt&quot;}
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 7]
because Broken pipe
  Rendered text template (0.0ms)
Completed 200 OK in 496ms (Views: 0.7ms | ActiveRecord: 12.9ms)

Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts

···

----------------

Tel: 053 20 30 270 	info@netbulae.eu 	Staalsteden 4-3A 	KvK 08198180
Fax: 053 20 30 271 	www.netbulae.eu 	7547 TA Enschede 	BTW NL821234584B01

ehelms · April 7, 2015, 3:29pm

What repositories were these that hit this issue?

···

On Tue, Apr 7, 2015 at 7:15 AM, Jorick Astrego wrote:

Hi,

After the easter weekend I came back to a broken Katello 2.1. My daily
sync plan has several repo’s stuck

ActiveRecord::RecordNotUnique: PGError: ERROR: duplicate key value violates unique constraint “katello_system_errata_eid_sid”
: INSERT INTO katello_system_errata (erratum_id, system_id) VALUES (5442, 2)

I have now restarted the server, resumed the sync tasks, skipped and
resumed the NodeContentGenerator tasks (they wouldn’t resume).

But I get more problems and I’m unable to sync some of the repos properly:

Katello::Errors::PulpError: PLP0000: [Errno 2] No such file or directory: ‘/var/lib/pulp/content/drpm/drpms/spice-gtk-0.20-8.el7_0.22-2.el7.i686.drpm’

Is there a way to clear the repository and reinitialize the sync? Or
should I remove and readd the repo’s to get things going again?

From production.log:

Connection reset by peer (Errno::ECONNRESET)
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/serialization.rb:67:in
gets' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/serialization.rb:67:inreceive_message’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:44:in
block in listen' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:38:ineach’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:38:in
listen' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:inblock (3 levels) in initialize’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in
loop' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:inblock (2 levels) in initialize’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in
catch' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:inblock in initialize’
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
call' /opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:inblock in create_with_logging_context’
Client disconnected.
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 23] because
Broken pipe
PGError: ERROR: duplicate key value violates unique constraint
"katello_system_errata_eid_sid"
: INSERT INTO katello_system_errata (erratum_id, system_id) VALUES (5442,
2) (ActiveRecord::RecordNotUnique)
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:654:in
async_exec' /opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:654:inblock in execute’

/opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:116:in
block in match' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:115:ineach’
/opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:115:in
match' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/executors/parallel/worker.rb:17:inon_message’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:82:in
on_envelope' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:72:inreceive’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
block (2 levels) in run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:inloop’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
block in run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:incatch’
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in
run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:13:inblock in initialize’
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
call' /opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:inblock in create_with_logging_context’
caused by: (PGError) ERROR: duplicate key value violates unique
constraint “katello_system_errata_eid_sid”
... skipped 91 lines
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 21] because
Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 24] because
Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 4] because
Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 5] because
Broken pipe
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 13] because
Broken pipe
Processing by HostsController#externalNodes as YML
Parameters: {“name”=>“back1en.netbulae.mgmt”}
message could not be sent
Dynflow::Listeners::Serialization::Protocol::Done[request_id: 7] because
Broken pipe
Rendered text template (0.0ms)
Completed 200 OK in 496ms (Views: 0.7ms | ActiveRecord: 12.9ms)

Met vriendelijke groet, With kind regards,

Jorick Astrego

*Netbulae Virtualization Experts *

Tel: 053 20 30 270 info@netbulae.eu Staalsteden 4-3A KvK 08198180 Fax:
053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

Jorick_Astrego · April 8, 2015, 12:13pm

Currently quite a lot:

http://mirror.nl.leaseweb.net/epel/7/x86_64/

http://mirror.centos.org/centos/7/cr/x86_64/

https://fedorapeople.org/groups/katello/releases/yum/2.1/client/RHEL/7/x86_64/

http://resources.ovirt.org/pub/ovirt-3.5-pre/rpm/el7/

http://copr-be.cloud.fedoraproject.org/results/patternfly/patternfly1/epel-7-x86_64/

http://yum.puppetlabs.com/el/6/dependencies/x86_64/

And the foreman 1.7 plugins repo throws this error in the "sync status"
view:

undefined method `[]&#39; for nil:NilClass (NoMethodError)
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/pulp/repository/presenters/abstract_sync_presenter.rb:52:in
`task_result&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/pulp/repository/presenters/abstract_sync_presenter.rb:56:in
`task_result_details&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/pulp/repository/presenters/yum_presenter.rb:84:in
`task_details&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/pulp/repository/presenters/yum_presenter.rb:120:in
`cancelled?&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/pulp/repository/presenters/yum_presenter.rb:30:in
`humanized_details&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/pulp/repository/presenters/abstract_sync_presenter.rb:23:in
`humanized_output&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/helpers/presenter.rb:21:in
`humanized_output&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/helpers/presenter.rb:45:in
`map&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/helpers/presenter.rb:45:in
`humanized_output&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/lib/actions/helpers/presenter.rb:21:in
`humanized_output&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/foreman-tasks-0.6.10/app/models/foreman_tasks/task/dynflow_task.rb:72:in
`get_humanized&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/foreman-tasks-0.6.10/app/models/foreman_tasks/task/dynflow_task.rb:53:in
`humanized&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/controllers/katello/sync_management_controller.rb:81:in
`format_sync_progress&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/controllers/katello/sync_management_controller.rb:151:in
`block in get_product_info&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/delegation.rb:6:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/delegation.rb:6:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/controllers/katello/sync_management_controller.rb:150:in
`get_product_info&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/controllers/katello/sync_management_controller.rb:47:in
`block in index&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/controllers/katello/sync_management_controller.rb:47:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/app/controllers/katello/sync_management_controller.rb:47:in
`index&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/implicit_render.rb:4:in
`send_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/base.rb:167:in
`process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rendering.rb:10:in
`process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/callbacks.rb:18:in
`block in process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:614:in
`block (2 levels) in
_run__1207062502202910192__process_action__1920137924691120330__callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:215:in
`block in _conditional_callback_around_11368&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:326:in
`around&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:310:in
`_callback_around_3087&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:214:in
`_conditional_callback_around_11368&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:591:in
`block in
_run__1207062502202910192__process_action__1920137924691120330__callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:215:in
`block in _conditional_callback_around_11367&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:326:in
`around&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:310:in
`_callback_around_13&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:214:in
`_conditional_callback_around_11367&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:414:in
`_run__1207062502202910192__process_action__1920137924691120330__callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in
`__run_callback&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:385:in
`_run_process_action_callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:81:in
`run_callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/callbacks.rb:17:in
`process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rescue.rb:29:in
`process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:30:in
`block in process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in
`block in instrument&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications/instrumenter.rb:20:in
`instrument&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in
`instrument&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:29:in
`process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/params_wrapper.rb:207:in
`process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/railties/controller_runtime.rb:18:in
`process_action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/base.rb:121:in
`process&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/rendering.rb:45:in
`process&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal.rb:203:in
`dispatch&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rack_delegation.rb:14:in
`dispatch&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal.rb:246:in
`block in action&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:73:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:73:in
`dispatch&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:36:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:68:in
`block in call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:600:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/engine.rb:479:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/railtie/configurable.rb:30:in
`method_missing&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:68:in
`block in call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:600:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/apipie-rails-0.2.6/lib/apipie/extractor/recorder.rb:97:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/apipie-rails-0.2.6/lib/apipie/middleware/checksum_in_headers.rb:27:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/best_standards_support.rb:17:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/etag.rb:23:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/conditionalget.rb:25:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/head.rb:14:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/params_parser.rb:21:in
`call&#39;
/usr/share/foreman/lib/middleware/catch_json_parse_errors.rb:9:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/flash.rb:242:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb:205:in
`context&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb:200:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/cookies.rb:339:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/query_cache.rb:64:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/connection_pool.rb:473:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/callbacks.rb:28:in
`block in call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in
`_run__839350312298858555__call__2036082066599817760__callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in
`__run_callback&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:385:in
`_run_call_callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:81:in
`run_callbacks&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/callbacks.rb:27:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/remote_ip.rb:31:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/debug_exceptions.rb:16:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/show_exceptions.rb:56:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.2/lib/katello/middleware/silenced_logger.rb:29:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/request_id.rb:22:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/methodoverride.rb:21:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/runtime.rb:17:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/cache/strategy/local_cache.rb:72:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/lock.rb:15:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:136:in
`forward&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:245:in
`fetch&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:185:in
`lookup&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:66:in
`call!&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:51:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/engine.rb:479:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/application.rb:223:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/railtie/configurable.rb:30:in
`method_missing&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/builder.rb:134:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/urlmap.rb:64:in
`block in call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/urlmap.rb:49:in
`each&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/urlmap.rb:49:in
`call&#39;
/usr/lib/ruby/gems/1.8/gems/passenger-4.0.18/lib/phusion_passenger/rack/thread_handler_extension.rb:77:in
`process_request&#39;
/usr/lib/ruby/gems/1.8/gems/passenger-4.0.18/lib/phusion_passenger/request_handler/thread_handler.rb:140:in
`accept_and_process_next_request&#39;
/usr/lib/ruby/gems/1.8/gems/passenger-4.0.18/lib/phusion_passenger/request_handler/thread_handler.rb:108:in
`main_loop&#39;
/usr/lib/ruby/gems/1.8/gems/passenger-4.0.18/lib/phusion_passenger/request_handler.rb:441:in
`block (3 levels) in start_threads&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
`call&#39;
/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
`block in create_with_logging_context&#39;

···

On 04/07/2015 05:29 PM, Eric D Helms wrote: > What repositories were these that hit this issue? > > On Tue, Apr 7, 2015 at 7:15 AM, Jorick Astrego > wrote: > > Hi, > > After the easter weekend I came back to a broken Katello 2.1. My > daily sync plan has several repo's stuck > > ActiveRecord::RecordNotUnique: PGError: ERROR: duplicate key value violates unique constraint "katello_system_errata_eid_sid" > : INSERT INTO katello_system_errata (erratum_id, system_id) VALUES (5442, 2) > > I have now restarted the server, resumed the sync tasks, skipped > and resumed the NodeContentGenerator tasks (they wouldn't resume). > > But I get more problems and I'm unable to sync some of the repos > properly: > > Katello::Errors::PulpError: PLP0000: [Errno 2] No such file or directory: '/var/lib/pulp/content/drpm/drpms/spice-gtk-0.20-8.el7_0.22-2.el7.i686.drpm' > > > Is there a way to clear the repository and reinitialize the sync? > Or should I remove and readd the repo's to get things going again? > > From production.log: > > Connection reset by peer (Errno::ECONNRESET) > /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/serialization.rb:67:in > `gets' > /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/serialization.rb:67:in > `receive_message' > /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:44:in > `block in listen' > /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:38:in > `each' > /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:38:in > `listen' > /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/listeners/socket.rb:21:in > `block (3 levels) in initialize' > /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/liste

Content hosts unvailable - katello 2.1 / Foreman 1.7.3 (...Resources::Candlepin::Consumer: 410 Gone)

foreman-rake katello:clean_backend_objects --trace

*Netbulae Virtualization Experts *

Tel: 053 20 30 270 info@netbulae.eu Staalsteden 4-3A KvK 08198180 Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01

Netbulae Virtualization Experts

Tel: 053 20 30 270 info@netbulae.eu Staalsteden 4-3A KvK 08198180 Fax:
053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01