Celery and pulp_streamer not working in fresh install Katello 3.5 and Foreman 1.16

Support
1
In a fresh install on CentOS 7.4 pulp is not working.
The webui is working , but when I try to add a yum repository to a product the following message is displayed:
"There was an issue with the backend service pulp: 500 Internal Server Error"

The smartproxy is running on the same server as foreman , iptables and selinux disabled

Running the foreman-service status I see the following errors.

/usr/sbin/service-wait pulp_resource_manager status
● pulp_resource_manager.service - Pulp Resource Manager
   Loaded: loaded (/usr/lib/systemd/system/pulp_resource_manager.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Sat 2017-12-09 22:29:35 CET; 1h 26min ago
  Process: 1186 ExecStart=/usr/bin/celery worker -A pulp.server.async.app -n resource_manager@%%h -Q resource_manager -c 1 --events --umask 18 --pidfile=/var/run/pulp/resource_manager.pid (code=exited, st atus=1/FAILURE)
Main PID: 1186 (code=exited, status=1/FAILURE)

Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: File
"/usr/lib/python2.7/site-packages/pulp/plugins/loader/manager.py", line 9, in <module>
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: from
pulp.server.db.model import ContentUnit
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: File
"/usr/lib/python2.7/site-packages/pulp/server/db/model/__init__.py", line 33, in <module>
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: from
pulp.server.webservices.views import serializers
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: File
"/usr/lib/python2.7/site-packages/pulp/server/webservices/views/serializers/__init__.py", line 4, in <module>
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: from
django.core.urlresolvers import reverse
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: ImportError: No module named django.core.urlresolvers
Dec 09 22:29:35 v1c2c02.mst.proxy.nl systemd[1]:
pulp_resource_manager.service: main process exited, code=exited, status=1/FAILURE
Dec 09 22:29:35 v1c2c02.mst.proxy.nl systemd[1]: Unit
pulp_resource_manager.service entered failed state.
Dec 09 22:29:35 v1c2c02.mst.proxy.nl systemd[1]:
pulp_resource_manager.service failed.
/usr/sbin/service-wait pulp_streamer status
● pulp_streamer.service - The Pulp lazy content loading streamer    Loaded: loaded (/usr/lib/systemd/system/pulp_streamer.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Sat 2017-12-09 22:29:36 CET; 1h 26min ago
  Process: 1193 ExecStart=/usr/bin/pulp_streamer --nodaemon --syslog --prefix=pulp_streamer --pidfile= --python
/usr/share/pulp/wsgi/streamer.tac (code=exited, status=1/FAILURE) Main PID: 1193 (code=exited, status=1/FAILURE)

Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: from pulp.server.db.model import Worker, ReservedResource, TaskStatus, \ Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: File "/usr/lib/python2.7/site-packages/pulp/server/db/model/__init__.py", line 33, in <module>
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: from pulp.server.webservices.views import serializers
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/serializers/__init__.py", line 4, in <module>
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: from django.core.urlresolvers import reverse
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]:
exceptions.ImportError: No module named django.core.urlresolvers Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: Failed to load application: No module named django.core.urlresolvers
Dec 09 22:29:36 v1c2c02.mst.proxy.nl systemd[1]: pulp_streamer.service: main process exited, code=exited, status=1/FAILURE
Dec 09 22:29:36 v1c2c02.mst.proxy.nl systemd[1]: Unit pulp_streamer.service entered failed state.
Dec 09 22:29:36 v1c2c02.mst.proxy.nl systemd[1]: pulp_streamer.service failed.

Systemctl for the pulp services:
● pulp_celerybeat.service                                      loaded failed failed Pulp's Celerybeat
● pulp_resource_manager.service                                      loaded failed failed Pulp Resource Manager
● pulp_streamer.service                                      loaded failed failed The Pulp lazy content loading streamer
● pulp_worker-0.service                                      loaded failed failed Pulp Worker #0
● pulp_worker-1.service                                      loaded failed failed Pulp Worker #1
● pulp_worker-2.service                                      loaded failed failed Pulp Worker #2
● pulp_worker-3.service                                      loaded failed failed Pulp Worker #3
  pulp_workers.service                                       loaded active exited Pulp Celery Workers

Regards.
Mike Hulsman
2

I found the solution for this.

When installing with: foreman-installer --scenario katello the
rpm python-django16-1.6.11.6-6.el7.noarch is installed.
That is given the error exceptions.ImportError: No module named
django.core.urlresolvers

When you manually install the rpm python-django-1.6.11.6-1.el7.noarch all
the pulp workers are starting and no 500 Internal Server Errors appear.

Regard.
Mike Hulsman

···

On Sunday, December 10, 2017 at 10:15:23 AM UTC+1, Mike Hulsman wrote:

In a fresh install on CentOS 7.4 pulp is not working.
The webui is working , but when I try to add a yum repository to a product
the following message is displayed:
“There was an issue with the backend service pulp: 500 Internal Server
Error”

The smartproxy is running on the same server as foreman , iptables and
selinux disabled

Running the foreman-service status I see the following errors.

/usr/sbin/service-wait pulp_resource_manager status
● pulp_resource_manager.service - Pulp Resource Manager
Loaded: loaded (/usr/lib/systemd/system/pulp_resource_manager.service;
enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Sat 2017-12-09 22:29:35 CET;
1h 26min ago
Process: 1186 ExecStart=/usr/bin/celery worker -A pulp.server.async.app
-n resource_manager@%%h -Q resource_manager -c 1 --events --umask 18
–pidfile=/var/run/pulp/resource_manager.pid (code=exited, st
atus=1/FAILURE)
Main PID: 1186 (code=exited, status=1/FAILURE)

Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: File
"/usr/lib/python2.7/site-packages/pulp/plugins/loader/manager.py", line 9,
in
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: from
pulp.server.db.model import ContentUnit
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: File
"/usr/lib/python2.7/site-packages/pulp/server/db/model/init.py", line
33, in
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: from
pulp.server.webservices.views import serializers
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: File
"/usr/lib/python2.7/site-packages/pulp/server/webservices/views/serializers/init.py",
line 4, in
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: from
django.core.urlresolvers import reverse
Dec 09 22:29:35 v1c2c02.mst.proxy.nl celery[1186]: ImportError: No module
named django.core.urlresolvers
Dec 09 22:29:35 v1c2c02.mst.proxy.nl systemd[1]:
pulp_resource_manager.service: main process exited, code=exited,
status=1/FAILURE
Dec 09 22:29:35 v1c2c02.mst.proxy.nl systemd[1]: Unit
pulp_resource_manager.service entered failed state.
Dec 09 22:29:35 v1c2c02.mst.proxy.nl systemd[1]:
pulp_resource_manager.service failed.
/usr/sbin/service-wait pulp_streamer status
● pulp_streamer.service - The Pulp lazy content loading streamer
Loaded: loaded (/usr/lib/systemd/system/pulp_streamer.service; enabled;
vendor preset: disabled)
Active: failed (Result: exit-code) since Sat 2017-12-09 22:29:36 CET;
1h 26min ago
Process: 1193 ExecStart=/usr/bin/pulp_streamer --nodaemon --syslog
–prefix=pulp_streamer --pidfile= --python
/usr/share/pulp/wsgi/streamer.tac (code=exited, status=1/FAILURE)
Main PID: 1193 (code=exited, status=1/FAILURE)

Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: from
pulp.server.db.model import Worker, ReservedResource, TaskStatus,
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: File
"/usr/lib/python2.7/site-packages/pulp/server/db/model/init.py", line
33, in
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: from
pulp.server.webservices.views import serializers
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: File
"/usr/lib/python2.7/site-packages/pulp/server/webservices/views/serializers/init.py",
line 4, in
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: from
django.core.urlresolvers import reverse
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]:
exceptions.ImportError: No module named django.core.urlresolvers
Dec 09 22:29:36 v1c2c02.mst.proxy.nl pulp_streamer[1193]: Failed to load
application: No module named django.core.urlresolvers
Dec 09 22:29:36 v1c2c02.mst.proxy.nl systemd[1]: pulp_streamer.service:
main process exited, code=exited, status=1/FAILURE
Dec 09 22:29:36 v1c2c02.mst.proxy.nl systemd[1]: Unit
pulp_streamer.service entered failed state.
Dec 09 22:29:36 v1c2c02.mst.proxy.nl systemd[1]: pulp_streamer.service
failed.

Systemctl for the pulp services:
● pulp_celerybeat.service
loaded failed failed Pulp’s
Celerybeat
● pulp_resource_manager.service
loaded failed failed Pulp
Resource Manager
● pulp_streamer.service
loaded failed failed The
Pulp lazy content loading streamer
● pulp_worker-0.service
loaded failed failed Pulp
Worker #0
● pulp_worker-1.service
loaded failed failed Pulp
Worker #1
● pulp_worker-2.service
loaded failed failed Pulp
Worker #2
● pulp_worker-3.service
loaded failed failed Pulp
Worker #3
pulp_workers.service
loaded active exited Pulp
Celery Workers

Regards.
Mike Hulsman