Problem:
When syncing a Smart Proxy it seems that /run/pulpcore-content is filling up and breaking the sync. From what I have seen, it’s all RPMs named tmp<randomid>
Is this something wrong with my Foreman Server?
Expected outcome: Sync completes without services crashing on server while syncing because /run spills over
Foreman and Proxy versions:
Foreman 2.1
Katello 3.16
Foreman and Proxy plugin versions:
Distribution and version:
CentOS 7
Other relevant data:
/run on the main server or on the proxy? It shouldn’t fill up in either case, just wondering where to look.
On the main server, I have a lot of issues syncing the proxy in general, all attempts (even after removing all LCE’s, products etc multiple times) fail with errors like these:
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) Task pulp.server.managers.repo.sync.sync[d7ec2a86-a334-40f6-ab86-9a03ba4fad1c] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) Traceback (most recent call last):
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) R = retval = fun(*args, **kwargs)
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 688, in __call__
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) return super(Task, self).__call__(*args, **kwargs)
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 110, in __call__
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) return super(PulpTask, self).__call__(*args, **kwargs)
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) return self.run(*args, **kwargs)
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 854, in sync
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response'))
Dec 07 01:57:05 deploy.lorenson.corp pulp[1886]: celery.app.trace:ERROR: [d7ec2a86] (1886-17248) PulpExecutionException: Importer indicated a failed response
The only ‘error’ I can find are these that some URLs that want to be synced don’t exist, which is expected as these repo’s do not have treeinfo:
Dec 07 01:55:59 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download failed: Download of https://deploy.admin.corp/pulp/repos/LC-corporate/LC-Corporate/COV_CentOS7-ForemanProxy/custom/Foreman-Server-EL7/Foreman-Server-EL7-Foreman-Base/treeinfo failed with code 404: Not Found
Funny thing is, I tried to reproduce this, but for some reason I can’t now… As mentioned I reinstalled the proxy a few times.
Not sure if the two are connected, but for completeness sake:
I originally created a Foreman config with a single Organization and a bunch of products. Now I want to add a second Organization with the exact same set of products and sync them to a Proxy which is only connected to the second Organization.