Hi,
I have my katello/foreman 2.2 running in some errors, can anyone please
help to take a look? Thanks!
foreman
[/home/sxin] 1006# katello-service status
qdrouterd (pid 16503) is running…
foreman-proxy is stopped
celery init v10.0.
Using config script: /etc/default/pulp_workers
node reserved_resource_worker-0 (pid 19251) is running…
node reserved_resource_worker-1 (pid 19030) is running…
node reserved_resource_worker-2 (pid 19326) is running…
node reserved_resource_worker-3 (pid 19057) is running…
elasticsearch (pid 17343) is running…
celery init v10.0.
Using config script: /etc/default/pulp_resource_manager
node resource_manager (pid 19494) is running…
mongod (pid 16819) is running…
tomcat6 (pid 18654) is running… [ OK ]
celery init v10.0.
Using configuration: /etc/default/pulp_workers, /etc/default/pulp_celerybeat
pulp_celerybeat (pid 17691) is running.
dynflow_executor is running.
dynflow_executor_monitor is running.
httpd (pid 21362) is running…
Some services failed: qpidd,foreman-proxy
here is the log:
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self._session.next_receiver()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in next_receiver
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
689, in next_receiver
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if self._ecwait(lambda: self.incoming, timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
50, in _ecwait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self._ewait(lambda: self.closed or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
767, in sync
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
if not self._ewait(lambda: not self.outgoing and not self.acked,
timeout=timeout):
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
595, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
result = self.connection._ewait(lambda: self.error or predicate(), timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
234, in _ewait
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.check_error()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
226, in check_error
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.close()
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
345, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
ssn.close(timeout=timeout)
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "<string>", line 6, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line
776, in close
Aug 24 21:40:02 foreman pulp: kombu.transport.qpid:ERROR: (17691-61184)
self.sync(timeou