[katello] 404 error on Activation Key

Jorick_Astrego · February 18, 2015, 12:54pm

Hi,

Running Katello 2.1 on Centos 6.6.

I added some activation_keys during setup, but now I cannot load the
Activation Keys view anymore because of a 404 error.

When using hammer, I get this error:

hammer activation-key list --organization="Netbulae"

Katello::Resources::Candlepin::ActivationKey: 404 Resource Not Found
&lt;html&gt;&lt;head&gt;&lt;title&gt;Apache Tomcat/6.0.24 - Error
report&lt;/title&gt;&lt;style&gt;&lt;!--H1
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;}
H2
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;}
H3
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;}
BODY
{font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}
B
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;}
P
{font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A
{color : black;}A.name {color : black;}HR {color :
#525D76;}--&gt;&lt;/style&gt; &lt;/head&gt;&lt;body&gt;&lt;h1&gt;HTTP Status 404 - &lt;/h1&gt;&lt;HR
size=&quot;1&quot; noshade=&quot;noshade&quot;&gt;&lt;p&gt;&lt;b&gt;type&lt;/b&gt; Status
report&lt;/p&gt;&lt;p&gt;&lt;b&gt;message&lt;/b&gt; &lt;u&gt;&lt;/u&gt;&lt;/p&gt;&lt;p&gt;&lt;b&gt;description&lt;/b&gt; &lt;u&gt;The
requested resource () is not available.&lt;/u&gt;&lt;/p&gt;&lt;HR size=&quot;1&quot;
noshade=&quot;noshade&quot;&gt;&lt;h3&gt;Apache Tomcat/6.0.24&lt;/h3&gt;&lt;/body&gt;&lt;/html&gt; (GET
/candlepin/activation_keys/8ae4e4984b978407014b97e71abb006a)

The keys are in the database and I have only 1 organization currenlty

foreman=# select * from katello_activation_keys;

 id |       name       | description | organization_id |
environment_id |         created_at         |        
updated_at         | user_id | max_content_hosts | content_vie
w_id |              cp_id               | release_version |
unlimited_content_hosts | auto_attach

···

----+------------------+-------------+-----------------+----------------+----------------------------+----------------------------+---------+-------------------+------------ -----+----------------------------------+-----------------+-------------------------+------------- 2 | oVirt35_Engine | | 1 > 1 | 2015-02-17 14:16:35.823102 | 2015-02-17 14:16:36.29161 | 3 | | 1 | 8ae4e4984b978407014b97e5d24d0064 | | t | t 3 | oVirt35_Host | | 1 > 1 | 2015-02-17 14:16:53.452747 | 2015-02-17 14:16:53.897064 | 3 | | 1 | 8ae4e4984b978407014b97e6173d0066 | | t | t 4 | Katello21 | | 1 > 1 | 2015-02-17 14:17:12.29845 | 2015-02-17 14:17:12.954831 | 3 | | 1 | 8ae4e4984b978407014b97e6612e0068 | | t | t 5 | Backup_NFS | | 1 > 1 | 2015-02-17 14:17:59.327101 | 2015-02-17 14:18:00.421178 | 3 | | 1 | 8ae4e4984b978407014b97e71abb006a | | t | t 1 | GlusterFS36_Node | | 1 > 1 | 2015-02-17 14:15:59.16437 | 2015-02-17 14:20:11.869645 | 3 | | 1 | 8ae4e4984b978407014b97e55ee30062 | | t | t (5 rows)

In production log, I see the error below and there is no output in
catalina.out

/opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in
`block in create_with_logging_context'
RestClient::ResourceNotFound:
Katello::Resources::Candlepin::ActivationKey: 404 Resource Not Found
<html><head><title>Apache Tomcat/6.0.24 - Error
report</title><style><!--H1
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;}
H2
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;}
H3
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;}
BODY
{font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}
B
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;}
P
{font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A
{color : black;}A.name {color : black;}HR {color :
#525D76;}--></style> </head><body><h1>HTTP Status 404 - </h1><HR
size="1" noshade="noshade"><p><b>type</b> Status
report</p><p><b>message</b> <u></u></p><p><b>description</b> <u>The
requested resource () is not available.</u></p><HR size="1"
noshade="noshade"><h3>Apache Tomcat/6.0.24</h3></body></html> (GET
/candlepin/activation_keys/8ae4e4984b978407014b97e71abb006a)
Body: <html><head><title>Apache Tomcat/6.0.24 - Error
report</title><style><!--H1
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;}
H2
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;}
H3
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;}
BODY
{font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}
B
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;}
P
{font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A
{color : black;}A.name {color : black;}HR {color :
#525D76;}--></style> </head><body><h1>HTTP Status 404 - </h1><HR
size="1" noshade="noshade"><p><b>type</b> Status
report</p><p><b>message</b> <u></u></p><p><b>description</b> <u>The
requested resource () is not available.</u></p><HR size="1"
noshade="noshade"><h3>Apache Tomcat/6.0.24</h3></body></html>
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/abstract_response.rb:48:in
`return!'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:230:in
`process_result'
/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:50:in
`block in transmit'
/opt/rh/ruby193/root/usr/share/ruby/net/http.rb:746:in `start'
/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:44:in
`transmit'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:64:in
`execute'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:33:in
`execute'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/resource.rb:51:in
`get'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/http_resource.rb:96:in
`get'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/resources/candlepin.rb:764:in
`get'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/models/katello/glue/candlepin/activation_key.rb:23:in
`block (2 levels) in included'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/lazy_accessor.rb:175:in
`instance_eval'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/lazy_accessor.rb:175:in
`run_initializer'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/lazy_accessor.rb:154:in
`lazy_attribute_get'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/lazy_accessor.rb:74:in
`block (2 levels) in lazy_accessor'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/helpers.rb:18:in
`data_object_attribute'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:77:in
`attribute'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:38:in
`block in compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:37:in
`each_pair'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:37:in
`compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:21:in
`block in build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:166:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:20:in
`build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:51:in
`to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`block in render'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:285:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/partials.rb:27:in
`object_to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/partials.rb:14:in
`partial'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:124:in
`extends'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:34:in
`block in compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:33:in
`each'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:33:in
`compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:21:in
`block in build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:166:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:20:in
`build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:53:in
`block in to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/delegation.rb:6:in
`map'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/delegation.rb:6:in
`map'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:53:in
`to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`block in render'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:285:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/partials.rb:27:in
`object_to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:108:in
`child'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:46:in
`block in compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:45:in
`each'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:45:in
`compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:21:in
`block in build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:166:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:20:in
`build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:51:in
`to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`block in render'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:285:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/partials.rb:27:in
`object_to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/partials.rb:14:in
`partial'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:124:in
`extends'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:34:in
`block in compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:33:in
`each'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:33:in
`compile_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:21:in
`block in build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:166:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/builder.rb:20:in
`build'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:51:in
`to_hash'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:63:in
`to_json'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`block in render'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:285:in
`cache_results'
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.9.0/lib/rabl/engine.rb:39:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/views/katello/api/v2/activation_keys/index.json.rabl:1:in
`__opt_rh_ruby____root_usr_share_gems_gems_katello_______app_views_katello_api_v__activation_keys_index_json_rabl__3607832042774015224_81205600'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/template.rb:145:in
`block in render'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:125:in
`instrument'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/template.rb:143:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/template_renderer.rb:47:in
`block (2 levels) in render_template'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/abstract_renderer.rb:38:in
`block in instrument'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in
`block in instrument'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications/instrumenter.rb:20:in
`instrument'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in
`instrument'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/abstract_renderer.rb:38:in
`instrument'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/template_renderer.rb:46:in
`block in render_template'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/template_renderer.rb:54:in
`render_with_layout'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/template_renderer.rb:45:in
`render_template'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/template_renderer.rb:18:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/renderer.rb:36:in
`render_template'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_view/renderer/renderer.rb:17:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/rendering.rb:110:in
`_render_template'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/streaming.rb:225:in
`_render_template'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/rendering.rb:103:in
`render_to_body'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/renderers.rb:28:in
`render_to_body'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/compatibility.rb:50:in
`render_to_body'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/rendering.rb:88:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rendering.rb:16:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:40:in
`block (2 levels) in render'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/core_ext/benchmark.rb:5:in
`block in ms'
/opt/rh/ruby193/root/usr/share/ruby/benchmark.rb:295:in `realtime'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/core_ext/benchmark.rb:5:in
`ms'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:40:in
`block in render'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:83:in
`cleanup_view_runtime'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/railties/controller_runtime.rb:24:in
`cleanup_view_runtime'
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:39:in
`render'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/api/v2/rendering.rb:43:in
`respond_with_template'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/api/v2/rendering.rb:58:in
`respond_with_template_collection'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/api/v2/rendering.rb:71:in
`try_specific_collection_template'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.1.0/app/lib/katello/api/v2/rendering.rb:11:in
`respond_fo

Jorick_Astrego · February 18, 2015, 3:08pm

Hmm, it's not only activation keys but the whole candlepin is botched. I
just finished configuring everything … again :-& Is there some way to
get things going again?

This is on publishing a new version of a content view:

Actions::Candlepin::Environment::SetContent

RestClient::ResourceNotFound:
Katello::Resources::Candlepin::Environment: 404 Resource Not Found
&lt;html&gt;&lt;head&gt;&lt;title&gt;Apache Tomcat/6.0.24 - Error
report&lt;/title&gt;&lt;style&gt;&lt;!--H1
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;}
H2
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;}
H3
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;}
BODY
{font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}
B
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;}
P
{font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A
{color : black;}A.name {color : black;}HR {color :
#525D76;}--&gt;&lt;/style&gt; &lt;/head&gt;&lt;body&gt;&lt;h1&gt;HTTP Status 404 - &lt;/h1&gt;&lt;HR
size=&quot;1&quot; noshade=&quot;noshade&quot;&gt;&lt;p&gt;&lt;b&gt;type&lt;/b&gt; Status
report&lt;/p&gt;&lt;p&gt;&lt;b&gt;message&lt;/b&gt; &lt;u&gt;&lt;/u&gt;&lt;/p&gt;&lt;p&gt;&lt;b&gt;description&lt;/b&gt; &lt;u&gt;The
requested resource () is not available.&lt;/u&gt;&lt;/p&gt;&lt;HR size=&quot;1&quot;
noshade=&quot;noshade&quot;&gt;&lt;h3&gt;Apache Tomcat/6.0.24&lt;/h3&gt;&lt;/body&gt;&lt;/html&gt; (GET
/candlepin/environments/1-2)

I did a reboot, and see the following in the /var/log/candlepin/error.log

2015-02-18 15:53:42,027 [=, org=] ERROR
org.candlepin.guice.CandlepinGuiceResteasyBootstrap - Could not
create Guice injector.
com.google.inject.CreationException: Guice creation errors:

1) Error injecting constructor, java.lang.RuntimeException:
javax.jms.JMSException: Error creating connection: Connection refused
  at
org.candlepin.guice.AMQPBusPubProvider.&lt;init&gt;(AMQPBusPubProvider.java:67)
  while locating org.candlepin.guice.AMQPBusPubProvider
  at
org.candlepin.guice.CandlepinModule.configureAmqp(CandlepinModule.java:348)
  while locating org.candlepin.audit.AMQPBusPublisher

1 error
    at
com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:435)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:183)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)
~[guice-3.0.jar:na]
    at com.google.inject.Guice.createInjector(Guice.java:95)
~[guice-3.0.jar:na]
    at
org.candlepin.guice.CandlepinContextListener.getInjector(CandlepinContextListener.java:146)
[CandlepinContextListener.class:na]
    at
org.candlepin.guice.CandlepinGuiceResteasyBootstrap.contextInitialized(CandlepinGuiceResteasyBootstrap.java:57)
~[CandlepinGuiceResteasyBootstrap.class:na]
    at
org.candlepin.guice.CandlepinContextListener.contextInitialized(CandlepinContextListener.java:114)
[CandlepinContextListener.class:na]
    at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526) [catalina-6.0.24.jar:na]
    at
org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) [catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.StandardHost.start(StandardHost.java:722)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) [catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.StandardService.start(StandardService.java:516)
[catalina-6.0.24.jar:na]
    at
org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
[catalina-6.0.24.jar:na]
    at org.apache.catalina.startup.Catalina.start(Catalina.java:593)
[catalina-6.0.24.jar:na]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.7.0_75]
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
~[na:1.7.0_75]
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.7.0_75]
    at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_75]
    at
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
[bootstrap-6.0.24.jar:na]
    at
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
[bootstrap-6.0.24.jar:na]
Caused by: java.lang.RuntimeException: javax.jms.JMSException: Error
creating connection: Connection refused
    at
org.candlepin.guice.AMQPBusPubProvider.&lt;init&gt;(AMQPBusPubProvider.java:88)
~[AMQPBusPubProvider.class:na]
    at
org.candlepin.guice.AMQPBusPubProvider$$FastClassByGuice$$ef75a35a.newInstance(&lt;generated&gt;)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.BoundProviderFactory.get(BoundProviderFactory.java:53)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
~[guice-3.0.jar:na]
    at com.google.inject.Scopes$1$1.get(Scopes.java:65)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:40)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:204)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:198)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:198)
~[guice-3.0.jar:na]
    at
com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:179)
~[guice-3.0.jar:na]
    ... 29 common frames omitted
Caused by: javax.jms.JMSException: Error creating connection:
Connection refused
    at
org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:125)
~[qpid-client-0.22.jar:na]
    at
org.candlepin.guice.AMQPBusPubProvider.&lt;init&gt;(AMQPBusPubProvider.java:81)
~[AMQPBusPubProvider.class:na]
    ... 45 common frames omitted
Caused by: org.apache.qpid.AMQConnectionFailureException: Connection
refused
    at
org.apache.qpid.client.AMQConnection.&lt;init&gt;(AMQConnection.java:475)
~[qpid-client-0.22.jar:na]
    at
org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:121)
~[qpid-client-0.22.jar:na]
    ... 46 common frames omitted
Caused by: org.apache.qpid.transport.TransportException: Error
connecting to broker
    at
org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:86)
~[qpid-common-0.22.jar:na]
    at
org.apache.qpid.transport.Connection.connect(Connection.java:232)
~[qpid-common-0.22.jar:na]
    at
org.apache.qpid.client.AMQConnectionDelegate_0_10.makeBrokerConnection(AMQConnectionDelegate_0_10.java:221)
~[qpid-client-0.22.jar:na]
    at
org.apache.qpid.client.AMQConnection.makeBrokerConnection(AMQConnection.java:619)
~[qpid-client-0.22.jar:na]
    at
org.apache.qpid.client.AMQConnection.&lt;init&gt;(AMQConnection.java:398)
~[qpid-client-0.22.jar:na]
    ... 47 common frames omitted
Caused by: java.net.ConnectException: Connection refused
    at java.net.PlainSocketImpl.socketConnect(Native Method)
~[na:1.7.0_75]
    at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
~[na:1.7.0_75]
    at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
~[na:1.7.0_75]
    at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
~[na:1.7.0_75]
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
~[na:1.7.0_75]
    at java.net.Socket.connect(Socket.java:579) ~[na:1.7.0_75]
    at
org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:82)
~[qpid-common-0.22.jar:na]
    ... 51 common frames omitted

And the following in /var/log/messages

Feb 18 15:54:28 katello-test pulp: pulp.server.db.connection:ERROR:
Could not connect to MongoDB at localhost:27017:
Feb 18 15:54:28 katello-test pulp: pulp.server.db.connection:ERROR:
could not connect to localhost:27017: [Errno 111] Connection refused
Feb 18 15:54:28 katello-test pulp: pulp.server.db.connection:ERROR:
... Waiting 32 seconds and trying again.
Feb 18 15:55:00 katello-test pulp: pulp.server.db.connection:ERROR:
Could not connect to MongoDB at localhost:27017:
Feb 18 15:55:00 katello-test pulp: pulp.server.db.connection:ERROR:
could not connect to localhost:27017: [Errno 111] Connection refused
Feb 18 15:55:00 katello-test pulp: pulp.server.db.connection:ERROR:
... Waiting 32 seconds and trying again.
Feb 18 15:55:32 katello-test pulp: pulp.server.db.connection:ERROR:
Could not connect to MongoDB at localhost:27017:
Feb 18 15:55:32 katello-test pulp: pulp.server.db.connection:ERROR:
could not connect to localhost:27017: [Errno 111] Connection refused
Feb 18 15:55:32 katello-test pulp: pulp.server.db.connection:ERROR:
... Waiting 32 seconds and trying again.
Feb 18 15:56:04 katello-test pulp: pulp.server.db.connection:ERROR:
Could not connect to MongoDB at localhost:27017:
Feb 18 15:56:04 katello-test pulp: pulp.server.db.connection:ERROR:
could not connect to localhost:27017: [Errno 111] Connection refused
Feb 18 15:56:04 katello-test pulp: pulp.server.db.connection:ERROR:
... Waiting 32 seconds and trying again.
Feb 18 15:56:24 katello-test pulp: celery.beat:INFO: beat: Starting...
Feb 18 15:56:25 katello-test pulp: pulp.server.db.connection:INFO:
Database connection established with: seeds = localhost:27017, name
= pulp_database
Feb 18 15:56:25 katello-test pulp: pulp.server.async.scheduler:INFO:
Worker Timeout Monitor Started
Feb 18 15:56:25 katello-test pulp: pulp.server.async.scheduler:INFO:
Event Monitor Starting
Feb 18 15:56:25 katello-test pulp: kombu.mixins:INFO: Connected to
qpid://guest@katello-test.t:5671//
Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
Connected to qpid://guest@katello-test.netbulae.test:5671//
Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
Connected to qpid://guest@katello-test.netbulae.test:5671//
Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
Connected to qpid://guest@katello-test.netbulae.test:5671//
Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
Connected to qpid://guest@katello-test.netbulae.test:5671//
Feb 18 15:56:35 katello-test pulp: celery.worker.consumer:INFO:
Connected to qpid://guest@katello-test.netbulae.test:5671//
Feb 18 15:56:36 katello-test puppet-agent[2440]: Setting
config_version is deprecated in puppet.conf. See
http://links.puppetlabs.com/env-settings-deprecations
Feb 18 15:56:36 katello-test puppet-agent[2440]:    (at
/usr/lib/ruby/site_ruby/1.8/puppet/settings.rb:1141:in
`issue_deprecation_warning&#39;)
Feb 18 15:56:37 katello-test pulp: pulp.server.db.connection:INFO:
Database connection established with: seeds = localhost:27017, name
= pulp_database
Feb 18 15:56:37 katello-test pulp:
pulp.server.async.worker_watcher:INFO: New worker
&#39;reserved_resource_worker-1@katello-test.netbulae.test&#39; discovered
Feb 18 15:56:37 katello-test pulp:
pulp.server.async.worker_watcher:INFO: New worker
&#39;reserved_resource_worker-0@katello-test.netbulae.test&#39; discovered
Feb 18 15:56:37 katello-test pulp:
pulp.server.async.worker_watcher:INFO: New worker
&#39;reserved_resource_worker-2@katello-test.netbulae.test&#39; discovered
Feb 18 15:56:37 katello-test pulp: pulp.server.db.connection:INFO:
Database connection established with: seeds = localhost:27017, name
= pulp_database
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin nodes_http_distributor for types: node
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin docker_distributor_web for types: docker_image
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin docker_distributor_export for types: docker_image
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin puppet_distributor for types: puppet_module
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin puppet_file_distributor for types: puppet_module
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin puppet_install_distributor for types: puppet_module
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin yum_clone_distributor for types:
rpm,srpm,drpm,erratum,distribution,package_category,package_group
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin yum_distributor for types:
rpm,srpm,drpm,erratum,package_group,package_category,distribution,yum_repo_metadata_file
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin export_distributor for types:
rpm,srpm,drpm,erratum,distribution,package_category,package_group
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin iso_distributor for types: iso
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin group_export_distributor for types:
rpm,srpm,drpm,erratum,distribution,package_category,package_group
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin docker_importer for types: docker_image
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin puppet_importer for types: puppet_module
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin yum_importer for types:
distribution,drpm,erratum,package_group,package_category,rpm,srpm,yum_repo_metadata_file,package_environment
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin iso_importer for types: iso
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin node for types: node,repository
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin puppet_whole_repo_profiler for types: puppet_module
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin yum_profiler for types: rpm,erratum
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin yum for types: rpm
Feb 18 15:56:37 katello-test pulp: pulp.plugins.loader.manager:INFO:
Loaded plugin rhui for types: rpm
Feb 18 15:56:37 katello-test pulp:
pulp.server.agent.direct.services:INFO: AMQP broker configured:
{katello-test.netbulae.test:5671}:|transport=SSL|host=katello-test.netbulae.test|port=5671|cacert=/etc/pki/katello/certs/katello-default-ca.crt|clientcert=/etc/pki/katello/qpid_client_striped.crt|userid=None|password=None|vhost=None
Feb 18 15:56:37 katello-test pulp:
pulp.server.async.worker_watcher:INFO: New work

Justin_Sherrill · February 18, 2015, 3:54pm

> Hmm, it's not only activation keys but the whole candlepin is botched.
> I just finished configuring everything … again :-& Is there some way
> to get things going again?
>
> This is on publishing a new version of a content view:
>
> Actions::Candlepin::Environment::SetContent
>
> RestClient::ResourceNotFound:
> Katello::Resources::Candlepin::Environment: 404 Resource Not Found
> <html><head><title>Apache Tomcat/6.0.24 - Error
> report</title><style><!–H1
> {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;}
> H2
> {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;}
> H3
> {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;}
> BODY
> {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}
> B
> {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;}
> P
> {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A
> {color : black;}A.name {color : black;}HR {color :
> #525D76;}–></style> </head><body><h1>HTTP Status 404 - </h1><HR
> size="1" noshade="noshade"><p><b>type</b> Status
> report</p><p><b>message</b> <u></u></p><p><b>description</b>
> <u>The requested resource () is not available.</u></p><HR size="1"
> noshade="noshade"><h3>Apache Tomcat/6.0.24</h3></body></html> (GET
> /candlepin/environments/1-2)
>
>
>
> I did a reboot, and see the following in the /var/log/candlepin/error.log
>
> 2015-02-18 15:53:42,027 [=, org=] ERROR
> org.candlepin.guice.CandlepinGuiceResteasyBootstrap - Could not
> create Guice injector.
> com.google.inject.CreationException: Guice creation errors:
>
> 1) Error injecting constructor, java.lang.RuntimeException:
> javax.jms.JMSException: Error creating connection: Connection refused
> at
> org.candlepin.guice.AMQPBusPubProvider.<init>(AMQPBusPubProvider.java:67)
> while locating org.candlepin.guice.AMQPBusPubProvider
> at
> org.candlepin.guice.CandlepinModule.configureAmqp(CandlepinModule.java:348)
> while locating org.candlepin.audit.AMQPBusPublisher
>
> 1 error
> at
> com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:435)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:183)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)
> ~[guice-3.0.jar:na]
> at com.google.inject.Guice.createInjector(Guice.java:95)
> ~[guice-3.0.jar:na]
> at
> org.candlepin.guice.CandlepinContextListener.getInjector(CandlepinContextListener.java:146)
> [CandlepinContextListener.class:na]
> at
> org.candlepin.guice.CandlepinGuiceResteasyBootstrap.contextInitialized(CandlepinGuiceResteasyBootstrap.java:57)
> ~[CandlepinGuiceResteasyBootstrap.class:na]
> at
> org.candlepin.guice.CandlepinContextListener.contextInitialized(CandlepinContextListener.java:114)
> [CandlepinContextListener.class:na]
> at
> org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.StandardHost.start(StandardHost.java:722)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.StandardService.start(StandardService.java:516)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
> [catalina-6.0.24.jar:na]
> at
> org.apache.catalina.startup.Catalina.start(Catalina.java:593)
> [catalina-6.0.24.jar:na]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[na:1.7.0_75]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ~[na:1.7.0_75]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[na:1.7.0_75]
> at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_75]
> at
> org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
> [bootstrap-6.0.24.jar:na]
> at
> org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
> [bootstrap-6.0.24.jar:na]
> Caused by: java.lang.RuntimeException: javax.jms.JMSException:
> Error creating connection: Connection refused
> at
> org.candlepin.guice.AMQPBusPubProvider.<init>(AMQPBusPubProvider.java:88)
> ~[AMQPBusPubProvider.class:na]
> at
> org.candlepin.guice.AMQPBusPubProvider$$FastClassByGuice$$ef75a35a.newInstance(<generated>)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.BoundProviderFactory.get(BoundProviderFactory.java:53)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
> ~[guice-3.0.jar:na]
> at com.google.inject.Scopes$1$1.get(Scopes.java:65)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:40)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:204)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:198)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:198)
> ~[guice-3.0.jar:na]
> at
> com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:179)
> ~[guice-3.0.jar:na]
> … 29 common frames omitted
> Caused by: javax.jms.JMSException: Error creating connection:
> Connection refused
> at
> org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:125)
> ~[qpid-client-0.22.jar:na]
> at
> org.candlepin.guice.AMQPBusPubProvider.<init>(AMQPBusPubProvider.java:81)
> ~[AMQPBusPubProvider.class:na]
> … 45 common frames omitted
> Caused by: org.apache.qpid.AMQConnectionFailureException:
> Connection refused
> at
> org.apache.qpid.client.AMQConnection.<init>(AMQConnection.java:475) ~[qpid-client-0.22.jar:na]
> at
> org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:121)
> ~[qpid-client-0.22.jar:na]
> … 46 common frames omitted
> Caused by: org.apache.qpid.transport.TransportException: Error
> connecting to broker
> at
> org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:86)
> ~[qpid-common-0.22.jar:na]
> at
> org.apache.qpid.transport.Connection.connect(Connection.java:232)
> ~[qpid-common-0.22.jar:na]
> at
> org.apache.qpid.client.AMQConnectionDelegate_0_10.makeBrokerConnection(AMQConnectionDelegate_0_10.java:221)
> ~[qpid-client-0.22.jar:na]
> at
> org.apache.qpid.client.AMQConnection.makeBrokerConnection(AMQConnection.java:619)
> ~[qpid-client-0.22.jar:na]
> at
> org.apache.qpid.client.AMQConnection.<init>(AMQConnection.java:398) ~[qpid-client-0.22.jar:na]
> … 47 common frames omitted
> Caused by: java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> ~[na:1.7.0_75]
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> ~[na:1.7.0_75]
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> ~[na:1.7.0_75]
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> ~[na:1.7.0_75]
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> ~[na:1.7.0_75]
> at java.net.Socket.connect(Socket.java:579) ~[na:1.7.0_75]
> at
> org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:82)
> ~[qpid-common-0.22.jar:na]
> … 51 common frames omitted
>
> And the following in /var/log/messages
>
> Feb 18 15:54:28 katello-test pulp:
> pulp.server.db.connection:ERROR: Could not connect to MongoDB at
> localhost:27017:
> Feb 18 15:54:28 katello-test pulp:
> pulp.server.db.connection:ERROR: could not connect to
> localhost:27017: [Errno 111] Connection refused
> Feb 18 15:54:28 katello-test pulp:
> pulp.server.db.connection:ERROR: … Waiting 32 seconds and trying
> again.
> Feb 18 15:55:00 katello-test pulp:
> pulp.server.db.connection:ERROR: Could not connect to MongoDB at
> localhost:27017:
> Feb 18 15:55:00 katello-test pulp:
> pulp.server.db.connection:ERROR: could not connect to
> localhost:27017: [Errno 111] Connection refused
> Feb 18 15:55:00 katello-test pulp:
> pulp.server.db.connection:ERROR: … Waiting 32 seconds and trying
> again.
> Feb 18 15:55:32 katello-test pulp:
> pulp.server.db.connection:ERROR: Could not connect to MongoDB at
> localhost:27017:
> Feb 18 15:55:32 katello-test pulp:
> pulp.server.db.connection:ERROR: could not connect to
> localhost:27017: [Errno 111] Connection refused
> Feb 18 15:55:32 katello-test pulp:
> pulp.server.db.connection:ERROR: … Waiting 32 seconds and trying
> again.
> Feb 18 15:56:04 katello-test pulp:
> pulp.server.db.connection:ERROR: Could not connect to MongoDB at
> localhost:27017:
> Feb 18 15:56:04 katello-test pulp:
> pulp.server.db.connection:ERROR: could not connect to
> localhost:27017: [Errno 111] Connection refused
> Feb 18 15:56:04 katello-test pulp:
> pulp.server.db.connection:ERROR: … Waiting 32 seconds and trying
> again.
> Feb 18 15:56:24 katello-test pulp: celery.beat:INFO: beat: Starting…
> Feb 18 15:56:25 katello-test pulp: pulp.server.db.connection:INFO:
> Database connection established with: seeds = localhost:27017,
> name = pulp_database
> Feb 18 15:56:25 katello-test pulp:
> pulp.server.async.scheduler:INFO: Worker Timeout Monitor Started
> Feb 18 15:56:25 katello-test pulp:
> pulp.server.async.scheduler:INFO: Event Monitor Starting
> Feb 18 15:56:25 katello-test pulp: kombu.mixins:INFO: Connected to
> qpid://guest@katello-test.t:5671//
> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
> Connected to qpid://guest@katello-test.netbulae.test:5671//
> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
> Connected to qpid://guest@katello-test.netbulae.test:5671//
> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
> Connected to qpid://guest@katello-test.netbulae.test:5671//
> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO:
> Connected to qpid://guest@katello-test.netbulae.test:5671//
> Feb 18 15:56:35 katello-test pulp: celery.worker.consumer:INFO:
> Connected to qpid://guest@katello-test.netbulae.test:5671//
> Feb 18 15:56:36 katello-test puppet-agent[2440]: Setting
> config_version is deprecated in puppet.conf. See
> http://links.puppetlabs.com/env-settings-deprecations
> Feb 18 15:56:36 katello-test puppet-agent[2440]: (at
> /usr/lib/ruby/site_ruby/1.8/puppet/settings.rb:1141:in
> `issue_deprecation_warning')
> Feb 18 15:56:37 katello-test pulp: pulp.server.db.connection:INFO:
> Database connection established with: seeds = localhost:27017,
> name = pulp_database
> Feb 18 15:56:37 katello-test pulp:
> pulp.server.async.worker_watcher:INFO: New worker
> 'reserved_resource_worker-1@katello-test.netbulae.test' discovered
> Feb 18 15:56:37 katello-test pulp:
> pulp.server.async.worker_watcher:INFO: New worker
> 'reserved_resource_worker-0@katello-test.netbulae.test' discovered
> Feb 18 15:56:37 katello-test pulp:
> pulp.server.async.worker_watcher:INFO: New worker
> 'reserved_resource_worker-2@katello-test.netbulae.test' discovered
> Feb 18 15:56:37 katello-test pulp: pulp.server.db.connection:INFO:
> Database connection established with: seeds = localhost:27017,
> name = pulp_database
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin
> nodes_http_distributor for types: node
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin
> docker_distributor_web for types: docker_image
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin
> docker_distributor_export for types: docker_image
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin puppet_distributor
> for types: puppet_module
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin
> puppet_file_distributor for types: puppet_module
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin
> puppet_install_distributor for types: puppet_module
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin
> yum_clone_distributor for types:
> rpm,srpm,drpm,erratum,distribution,package_category,package_group
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin yum_distributor
> for types:
> rpm,srpm,drpm,erratum,package_group,package_category,distribution,yum_repo_metadata_file
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin export_distributor
> for types:
> rpm,srpm,drpm,erratum,distribution,package_category,package_group
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin iso_distributor
> for types: iso
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin
> group_export_distributor for types:
> rpm,srpm,drpm,erratum,distribution,package_category,package_group
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin docker_importer
> for types: docker_image
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin puppet_importer
> for types: puppet_module
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Loaded plugin yum_importer for
> types:
> distribution,drpm,erratum,package_group,package_category,rpm,srpm,yum_repo_metadata_file,package_environment
> Feb 18 15:56:37 katello-test pulp:
> pulp.plugins.loader.manager:INFO: Load

···

On 02/18/2015 10:08 AM, Jorick Astrego wrote:

Jorick_Astrego · February 19, 2015, 11:30am

Got things going again by restarting tomcat6 service and then forman
service

···

On 02/18/2015 04:54 PM, Justin Sherrill wrote: > On 02/18/2015 10:08 AM, Jorick Astrego wrote: >> Hmm, it's not only activation keys but the whole candlepin is >> botched. I just finished configuring everything ... again :-& Is >> there some way to get things going again? >> >> This is on publishing a new version of a content view: >> >> Actions::Candlepin::Environment::SetContent >> >> RestClient::ResourceNotFound: >> Katello::Resources::Candlepin::Environment: 404 Resource Not >> Found Apache Tomcat/6.0.24 - Error >> report

HTTP Status 404 -

> size="1" noshade="noshade">

type Status >> report

message

description >> The requested resource () is not available.

> size="1" noshade="noshade">

Apache >> Tomcat/6.0.24

(GET /candlepin/environments/1-2) >> >> >> >> I did a reboot, and see the following in the /var/log/candlepin/error.log >> >> 2015-02-18 15:53:42,027 [=, org=] ERROR >> org.candlepin.guice.CandlepinGuiceResteasyBootstrap - Could not >> create Guice injector. >> com.google.inject.CreationException: Guice creation errors: >> >> 1) Error injecting constructor, java.lang.RuntimeException: >> javax.jms.JMSException: Error creating connection: Connection refused >> at >> org.candlepin.guice.AMQPBusPubProvider.(AMQPBusPubProvider.java:67) >> while locating org.candlepin.guice.AMQPBusPubProvider >> at >> org.candlepin.guice.CandlepinModule.configureAmqp(CandlepinModule.java:348) >> while locating org.candlepin.audit.AMQPBusPublisher >> >> 1 error >> at >> com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:435) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:183) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109) >> ~[guice-3.0.jar:na] >> at com.google.inject.Guice.createInjector(Guice.java:95) >> ~[guice-3.0.jar:na] >> at >> org.candlepin.guice.CandlepinContextListener.getInjector(CandlepinContextListener.java:146) >> [CandlepinContextListener.class:na] >> at >> org.candlepin.guice.CandlepinGuiceResteasyBootstrap.contextInitialized(CandlepinGuiceResteasyBootstrap.java:57) >> ~[CandlepinGuiceResteasyBootstrap.class:na] >> at >> org.candlepin.guice.CandlepinContextListener.contextInitialized(CandlepinContextListener.java:114) >> [CandlepinContextListener.class:na] >> at >> org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.StandardContext.start(StandardContext.java:4709) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.StandardHost.start(StandardHost.java:722) [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.StandardService.start(StandardService.java:516) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.core.StandardServer.start(StandardServer.java:710) >> [catalina-6.0.24.jar:na] >> at >> org.apache.catalina.startup.Catalina.start(Catalina.java:593) >> [catalina-6.0.24.jar:na] >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) ~[na:1.7.0_75] >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> ~[na:1.7.0_75] >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> ~[na:1.7.0_75] >> at java.lang.reflect.Method.invoke(Method.java:606) >> ~[na:1.7.0_75] >> at >> org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) >> [bootstrap-6.0.24.jar:na] >> at >> org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) >> [bootstrap-6.0.24.jar:na] >> Caused by: java.lang.RuntimeException: javax.jms.JMSException: >> Error creating connection: Connection refused >> at >> org.candlepin.guice.AMQPBusPubProvider.(AMQPBusPubProvider.java:88) >> ~[AMQPBusPubProvider.class:na] >> at >> org.candlepin.guice.AMQPBusPubProvider$$FastClassByGuice$$ef75a35a.newInstance() >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.BoundProviderFactory.get(BoundProviderFactory.java:53) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) >> ~[guice-3.0.jar:na] >> at com.google.inject.Scopes$1$1.get(Scopes.java:65) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:40) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:204) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:198) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:198) >> ~[guice-3.0.jar:na] >> at >> com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:179) >> ~[guice-3.0.jar:na] >> ... 29 common frames omitted >> Caused by: javax.jms.JMSException: Error creating connection: >> Connection refused >> at >> org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:125) >> ~[qpid-client-0.22.jar:na] >> at >> org.candlepin.guice.AMQPBusPubProvider.(AMQPBusPubProvider.java:81) >> ~[AMQPBusPubProvider.class:na] >> ... 45 common frames omitted >> Caused by: org.apache.qpid.AMQConnectionFailureException: >> Connection refused >> at >> org.apache.qpid.client.AMQConnection.(AMQConnection.java:475) >> ~[qpid-client-0.22.jar:na] >> at >> org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:121) >> ~[qpid-client-0.22.jar:na] >> ... 46 common frames omitted >> Caused by: org.apache.qpid.transport.TransportException: Error >> connecting to broker >> at >> org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:86) >> ~[qpid-common-0.22.jar:na] >> at >> org.apache.qpid.transport.Connection.connect(Connection.java:232) >> ~[qpid-common-0.22.jar:na] >> at >> org.apache.qpid.client.AMQConnectionDelegate_0_10.makeBrokerConnection(AMQConnectionDelegate_0_10.java:221) >> ~[qpid-client-0.22.jar:na] >> at >> org.apache.qpid.client.AMQConnection.makeBrokerConnection(AMQConnection.java:619) >> ~[qpid-client-0.22.jar:na] >> at >> org.apache.qpid.client.AMQConnection.(AMQConnection.java:398) >> ~[qpid-client-0.22.jar:na] >> ... 47 common frames omitted >> Caused by: java.net.ConnectException: Connection refused >> at java.net.PlainSocketImpl.socketConnect(Native Method) >> ~[na:1.7.0_75] >> at >> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) >> ~[na:1.7.0_75] >> at >> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) >> ~[na:1.7.0_75] >> at >> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) >> ~[na:1.7.0_75] >> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) >> ~[na:1.7.0_75] >> at java.net.Socket.connect(Socket.java:579) ~[na:1.7.0_75] >> at >> org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:82) >> ~[qpid-common-0.22.jar:na] >> ... 51 common frames omitted >> >> And the following in /var/log/messages >> >> Feb 18 15:54:28 katello-test pulp: >> pulp.server.db.connection:ERROR: Could not connect to MongoDB at >> localhost:27017: >> Feb 18 15:54:28 katello-test pulp: >> pulp.server.db.connection:ERROR: could not connect to >> localhost:27017: [Errno 111] Connection refused >> Feb 18 15:54:28 katello-test pulp: >> pulp.server.db.connection:ERROR: ... Waiting 32 seconds and >> trying again. >> Feb 18 15:55:00 katello-test pulp: >> pulp.server.db.connection:ERROR: Could not connect to MongoDB at >> localhost:27017: >> Feb 18 15:55:00 katello-test pulp: >> pulp.server.db.connection:ERROR: could not connect to >> localhost:27017: [Errno 111] Connection refused >> Feb 18 15:55:00 katello-test pulp: >> pulp.server.db.connection:ERROR: ... Waiting 32 seconds and >> trying again. >> Feb 18 15:55:32 katello-test pulp: >> pulp.server.db.connection:ERROR: Could not connect to MongoDB at >> localhost:27017: >> Feb 18 15:55:32 katello-test pulp: >> pulp.server.db.connection:ERROR: could not connect to >> localhost:27017: [Errno 111] Connection refused >> Feb 18 15:55:32 katello-test pulp: >> pulp.server.db.connection:ERROR: ... Waiting 32 seconds and >> trying again. >> Feb 18 15:56:04 katello-test pulp: >> pulp.server.db.connection:ERROR: Could not connect to MongoDB at >> localhost:27017: >> Feb 18 15:56:04 katello-test pulp: >> pulp.server.db.connection:ERROR: could not connect to >> localhost:27017: [Errno 111] Connection refused >> Feb 18 15:56:04 katello-test pulp: >> pulp.server.db.connection:ERROR: ... Waiting 32 seconds and >> trying again. >> Feb 18 15:56:24 katello-test pulp: celery.beat:INFO: beat: >> Starting... >> Feb 18 15:56:25 katello-test pulp: >> pulp.server.db.connection:INFO: Database connection established >> with: seeds = localhost:27017, name = pulp_database >> Feb 18 15:56:25 katello-test pulp: >> pulp.server.async.scheduler:INFO: Worker Timeout Monitor Started >> Feb 18 15:56:25 katello-test pulp: >> pulp.server.async.scheduler:INFO: Event Monitor Starting >> Feb 18 15:56:25 katello-test pulp: kombu.mixins:INFO: Connected >> to qpid://guest@katello-test.t:5671// >> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO: >> Connected to qpid://guest@katello-test.netbulae.test:5671// >> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO: >> Connected to qpid://guest@katello-test.netbulae.test:5671// >> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO: >> Connected to qpid://guest@katello-test.netbulae.test:5671// >> Feb 18 15:56:34 katello-test pulp: celery.worker.consumer:INFO: >> Connected to qpid://guest@katello-test.netbulae.test:5671// >> Feb 18 15:56:35 katello-test pulp: celery.worker.consumer:INFO: >> Connected to qpid://guest@katello-test.netbulae.test:5671// >> Feb 18 15:56:36 katello-test puppet-agent[2440]: Setting >> config_version is deprecated in puppet.conf. See >> http://links.puppetlabs.com/env-settings-deprecations >> Feb 18 15:56:36 katello-test puppet-agent[2440]: (at >> /usr/lib/ruby/site_ruby/1.8/puppet/settings.rb:1141:in >> `issue_deprecation_warning') >> Feb 18 15:56:37 katello-test pulp: >> pulp.server.db.connection:INFO: Database connection established >> with: seeds = localhost:27017, name = pulp_database >> Feb 18 15:56:37 katello-test pulp: >> pulp.server.async.worker_watcher:INFO: New worker >> 'reserved_resource_worker-1@katello-test.netbulae.test' discovered >> Feb 18 15:56:37 katello-test pulp: >> pulp.server.async.worker_watcher:INFO: New worker >> 'reserved_resource_worker-0@katello-test.netbulae.test' discovered >> Feb 18 15:56:37 katello-test pulp: >> pulp.server.async.worker_watcher:INFO: New worker >> 'reserved_resource_worker-2@katello-test.netbulae.test' discovered >> Feb 18 15:56:37 katello-test pulp: >> pulp.server.db.connection:INFO: Database connection established >> with: seeds = localhost:27017, name = pulp_database >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> nodes_http_distributor for types: node >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> docker_distributor_web for types: docker_image >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> docker_distributor_export for types: docker_image >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> puppet_distributor for types: puppet_module >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> puppet_file_distributor for types: puppet_module >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> puppet_install_distributor for types: puppet_module >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> yum_clone_distributor for types: >> rpm,srpm,drpm,erratum,distribution,package_category,package_group >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin yum_distributor >> for types: >> rpm,srpm,drpm,erratum,package_group,package_category,distribution,yum_repo_metadata_file >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> export_distributor for types: >> rpm,srpm,drpm,erratum,distribution,package_category,package_group >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin iso_distributor >> for types: iso >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin >> group_export_distributor for types: >> rpm,srpm,drpm,erratum,distribution,package_category,package_group >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.manager:INFO: Loaded plugin docker_importer >> for types: docker_image >> Feb 18 15:56:37 katello-test pulp: >> pulp.plugins.loader.ma

Justin_Miller · June 2, 2015, 2:58pm

I seem to be having a similar problem. Candlepin seems to be the issue… I
have tried restarting to no avail like you mentioned…

Anyone else have this ? Katello 2.3 and Foreman 1.9 the dev branch?

this is in the candlepin.log
2015-06-01 14:34:15,781 [=, org=] WARN org.hornetq.core.client - HQ212037:
Connection failure has been detected: HQ119015: The connection was
disconnected because of server shutdown [code=DISCONNECTED]
2015-06-01 14:34:15,784 [=, org=] WARN org.hornetq.core.client - HQ212037:
Connection failure has been detected: HQ119015: The connection was
disconnected because of server shutdown [code=DISCONNECTED]
2015-06-01 14:34:15,787 [=, org=] WARN org.hornetq.core.client - HQ212037:
Connection failure has been detected: HQ119015: The connection was
disconnected because of server shutdown [code=DISCONNECTED]
2015-06-01 14:34:15,794 [=, org=] WARN org.hornetq.core.server - HQ222113:
On ManagementService stop, there are 1 unexpected registered MBeans:
[core.acceptor.60a2310c-f966-11e4-9ec0-494309c0ef14]
2015-06-01 14:34:15,835 [=, org=] INFO
org.candlepin.audit.HornetqContextListener - Hornetq server stopped.
2015-06-01 14:34:15,835 [=, org=] INFO
org.candlepin.pinsetter.core.PinsetterKernel - shutting down pinsetter
kernel
2015-06-01 14:34:15,838 [=, org=] INFO
org.candlepin.pinsetter.core.PinsetterKernel - allowing running jobs to
finish…
2015-06-01 14:34:16,029 [=, org=] INFO
org.candlepin.pinsetter.core.PinsetterKernel - pinsetter kernel is shut
down
2015-06-01 14:34:16,856 [=, org=] INFO
org.candlepin.guice.CandlepinContextListener - Candlepin initializing
context.
2015-06-01 14:34:16,857 [=, org=] INFO
org.candlepin.guice.CandlepinContextListener - Candlepin reading
configuration.
2015-06-01 14:34:16,860 [=, org=] INFO
org.candlepin.common.config.EncryptedConfiguration - No secret file
provided.
2015-06-01 14:34:17,007 [=, org=] INFO
org.candlepin.guice.CustomizableModules - Found custom module
module.config.adapter_module
2015-06-01 14:34:18,474 [=, org=] INFO
org.candlepin.guice.AMQPBusPubProvider - AMQP connection factory created.
2015-06-01 14:34:18,904 [=, org=] WARN
org.apache.qpid.transport.network.security.ssl.SSLUtil - Exception
received while trying to verify hostname
2015-06-01 14:34:18,988 [=, org=] INFO
org.candlepin.guice.AMQPBusPubProvider - AMQP session created
successfully…
2015-06-01 14:34:19,689 [=, org=] WARN
com.mchange.v2.c3p0.management.ActiveManagementCoordinator - A
C3P0Registry mbean is already registered. This probably means that an
application using c3p0 was undeployed, but not all PooledDataSources were
closed prior to undeployment. This may lead to resource leaks over time.
Please take care to close all PooledDataSources.
2015-06-01 14:34:20,620 [=, org=] WARN org.hibernate.id.UUIDHexGenerator -
HHH000409: Using org.hibernate.id.UUIDHexGenerator which does not generate
IETF RFC 4122 compliant UUID values; consider using
org.hibernate.id.UUIDGenerator instead
2015-06-01 14:34:21,545 [=, org=] ERROR
org.candlepin.guice.CandlepinGuiceResteasyBootstrap - Could not create
Guice injector.
com.google.inject.CreationException: Guice creation errors:

Error in custom provider, java.lang.NullPointerException
while locating com.google.inject.persist.jpa.JpaPersistService
while locating javax.persistence.EntityManager
at
org.candlepin.policy.js.JsRunnerProvider.<init>(JsRunnerProvider.java:74)
at org.candlepin.guice.CandlepinModule.configure(CandlepinModule.java:229)
while locating org.candlepin.policy.js.JsRunnerProvider
Caused by: java.lang.NullPointerException
at
com.google.inject.persist.jpa.JpaPersistService.begin(JpaPersistService.java:70)
at
com.google.inject.persist.jpa.JpaPersistService.get(JpaPersistService.java:50)
at
com.google.inject.persist.jpa.JpaPersistService.get(JpaPersistService.java:34)
at
com.google.inject.internal.BoundProviderFactory.get(BoundProviderFactory.java:55)
at
com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)
at
com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
at
com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:974)
at
org.candlepin.model.AbstractHibernateCurator.currentSession(AbstractHibernateCurator.java:373)
at org.candlepin.model.RulesCurator.getDbRules(RulesCurator.java:76)
at
org.candlepin.model.RulesCurator.updateDbRules(RulesCurator.java:83)
at
org.candlepin.policy.js.JsRunnerProvider.<init>(JsRunnerProvider.java:78)
at
org.candlepin.policy.js.JsRunnerProvider$$FastClassByGuice$$db9cfd63.newInstance(<generated>)
at
com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at
com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60)
at
com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
at
com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
at
com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
at
com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
at com.google.inject.Scopes$1$1.get(Scopes.java:65)
at
com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:40)
at
com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:204)
at
com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:198)
at
com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
at
com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:198)
at
com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:179)
at
com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)
at com.google.inject.Guice.createInjector(Guice.java:95)
at
org.candlepin.guice.CandlepinContextListener.getInjector(CandlepinContextListener.java:146)
at
org.candlepin.guice.CandlepinGuiceResteasyBootstrap.contextInitialized(CandlepinGuiceResteasyBootstrap.java:57)
at
org.candlepin.guice.CandlepinContextListener.contextInitialized(CandlepinContextListener.java:114)
at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
at
org.apache.catalina.startup.HostConfig.checkResources(HostConfig.java:1244)
at
org.apache.catalina.startup.HostConfig.check(HostConfig.java:1342)
at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:303)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
at
org.apache.catalina.core.ContainerBase.backgroundProcess(ContainerBase.java:1337)
at
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1601)
at
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1610)
at
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1590)
at java.lang.Thread.run(Thread.java:745)

···

On Thursday, February 19, 2015 at 6:30:25 AM UTC-5, Jorick Astrego wrote: > > Got things going again by restarting tomcat6 service and then forman > service ;-) > > > > On 02/18/2015 04:54 PM, Justin Sherrill wrote: > > On 02/18/2015 10:08 AM, Jorick Astrego wrote: > > Hmm, it's not only activation keys but the whole candlepin is botched. I > just finished configuring everything ... again :-& Is there some way to get > things going again? > > This is on publishing a new version of a content view: > > Actions::Candlepin::Environment::SetContent > > RestClient::ResourceNotFound: Katello::Resources::Candlepin::Environment: > 404 Resource Not Found Apache Tomcat/6.0.24 - Error > report >

HTTP Status 404 -

noshade="noshade">

type Status report

message >

description The requested resource () is not > available.

Apache > Tomcat/6.0.24

(GET /candlepin/environments/1-2) > > > > I did a reboot, and see the following in the /var/log/candlepin/error.log > > 2015-02-18 15:53:42,027 [=, org=] ERROR > org.candlepin.guice.CandlepinGuiceResteasyBootstrap - Could not create > Guice injector. > com.google.inject.CreationException: Guice creation errors: > > 1) Error injecting constructor, java.lang.RuntimeException: > javax.jms.JMSException: Error creating connection: Connection refused > at > org.candlepin.guice.AMQPBusPubProvider.(AMQPBusPubProvider.java:67) > while locating org.candlepin.guice.AMQPBusPubProvider > at > org.candlepin.guice.CandlepinModule.configureAmqp(CandlepinModule.java:348) > while locating org.candlepin.audit.AMQPBusPublisher > > 1 error > at > com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:435) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:183) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109) > ~[guice-3.0.jar:na] > at com.google.inject.Guice.createInjector(Guice.java:95) > ~[guice-3.0.jar:na] > at > org.candlepin.guice.CandlepinContextListener.getInjector(CandlepinContextListener.java:146) > [CandlepinContextListener.class:na] > at > org.candlepin.guice.CandlepinGuiceResteasyBootstrap.contextInitialized(CandlepinGuiceResteasyBootstrap.java:57) > ~[CandlepinGuiceResteasyBootstrap.class:na] > at > org.candlepin.guice.CandlepinContextListener.contextInitialized(CandlepinContextListener.java:114) > [CandlepinContextListener.class:na] > at > org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.StandardContext.start(StandardContext.java:4709) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:637) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:563) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:498) > [catalina-6.0.24.jar:na] > at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) > [catalina-6.0.24.jar:na] > at org.apache.catalina.core.StandardHost.start(StandardHost.java:722) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.StandardService.start(StandardService.java:516) > [catalina-6.0.24.jar:na] > at > org.apache.catalina.core.StandardServer.start(StandardServer.java:710) > [catalina-6.0.24.jar:na] > at org.apache.catalina.startup.Catalina.start(Catalina.java:593) > [catalina-6.0.24.jar:na] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[na:1.7.0_75] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > ~[na:1.7.0_75] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[na:1.7.0_75] > at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_75] > at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) > [bootstrap-6.0.24.jar:na] > at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) > [bootstrap-6.0.24.jar:na] > Caused by: java.lang.RuntimeException: javax.jms.JMSException: Error > creating connection: Connection refused > at > org.candlepin.guice.AMQPBusPubProvider.(AMQPBusPubProvider.java:88) > ~[AMQPBusPubProvider.class:na] > at > org.candlepin.guice.AMQPBusPubProvider$$FastClassByGuice$$ef75a35a.newInstance() > ~[guice-3.0.jar:na] > at > com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.BoundProviderFactory.get(BoundProviderFactory.java:53) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) > ~[guice-3.0.jar:na] > at com.google.inject.Scopes$1$1.get(Scopes.java:65) ~[guice-3.0.jar:na] > at > com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:40) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:204) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:198) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:198) > ~[guice-3.0.jar:na] > at > com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:179) > ~[guice-3.0.jar:na] > ... 29 common frames omitted > Caused by: javax.jms.JMSException: Error creating connection: Connection > refused > at > org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:125) > ~[qpid-client-0.22.jar:na] > at > org.candlepin.guice.AMQPBusPubProvider.(AMQPBusPubProvider.java:81) > ~[AMQPBusPubProvider.class:na] > ... 45 common frames omitted > Caused by: org.apache.qpid.AMQConnectionFailureException: Connection > refused > at org.apache.qpid.client.AMQConnection.(AMQConnection.java:475) > ~[qpid-client-0.22.jar:na] > at > org.apache.qpid.client.AMQConnectionFactory.createConnection(AMQConnectionFactory.java:121) > ~[qpid-client-0.22.jar:na] > ... 46 common frames omitted > Caused by: org.apache.qpid.transport.TransportException: Error connecting > to broker > at > org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:86) > ~[qpid-common-0.22.jar:na] > at org.apache.qpid.transport.Connection.connect(Connection.java:232) > ~[qpid-common-0.22.jar:na] > at > org.apache.qpid.client.AMQConnectionDelegate_0_10.makeBrokerConnection(AMQConnectionDelegate_0_10.java:221) > ~[qpid-client-0.22.jar:na] > at > org.apache.qpid.client.AMQConnection.makeBrokerConnection(AMQConnection.java:619) > ~[qpid-client-0.22.jar:na] > at org.apache.qpid.client.AMQConnection.(AMQConnection.java:398) > ~[qpid-client-0.22.jar:na] > ... 47 common frames omitted > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:1.7.0_75] > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > ~[na:1.7.0_75] > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > ~[na:1.7.0_75] > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > ~[na:1.7.0_75] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > ~[na:1.7.0_75] > at java.net.Socket.connect(Socket.java:579) ~[na:1.7.0_75] > at > org.apache.qpid.transport.network.io.IoNetworkTransport.connect(IoNetworkTransport.java:82) > ~[qpid-common-0.22.jar:na] > ... 51 common frames omitted > > And the following in /var/log/messages > > Feb 18 15:54:28 katello-test pulp: pulp.server.db.connection:ERROR: Could > not connect to MongoDB at localhost:27017: > Feb 18 15:54:28 katello-test pulp: pulp.server.db.connection:ERROR: could > not connect to localhost:27017: [Errno 111] Connection refused > Feb 18 15:54:28 katello-test pulp: pulp.server.db.co