Qpidd and foreman-proxy service not running

Hi,

I have my katello/foreman 2.2 running in some errors, can anyone please
help to take a look? Thanks!

foreman

[/home/sxin] 1006# katello-service status

qdrouterd (pid 16503) is running…

foreman-proxy is stopped

celery init v10.0.

Using config script: /etc/default/pulp_workers

node reserved_resource_worker-0 (pid 19251) is running…

node reserved_resource_worker-1 (pid 19030) is running…

node reserved_resource_worker-2 (pid 19326) is running…

node reserved_resource_worker-3 (pid 19057) is running…

elasticsearch (pid 17343) is running…

celery init v10.0.

Using config script: /etc/default/pulp_resource_manager

node resource_manager (pid 19494) is running…

mongod (pid 16819) is running…

tomcat6 (pid 18654) is running… [ OK ]

celery init v10.0.

Using configuration: /etc/default/pulp_workers, /etc/default/pulp_celerybeat

pulp_celerybeat (pid 17691) is running.

dynflow_executor is running.

dynflow_executor_monitor is running.

httpd (pid 21362) is running…

Some services failed: qpidd,foreman-proxy
here is the log:

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self._session.next_receiver()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in next_receiver

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
689, in next_receiver

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if self._ecwait(lambda: self.incoming, timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
50, in _ecwait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self._ewait(lambda: self.closed or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close

Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeou