Katello smart proxy content sync error

Hi ,
I have a katello server ( kat_server) and smart proxy (proxy_server) setup using the latest version , both servers are CentOS 7.8 with latest updates. But when I do content sync on katello server, it showed

kat_server > hammer proxy content synchronize --id=2
[…] [100%]
Error: PLP0000: Importer indicated a failed response
PLP0000: Importer indicated a failed response
PLP0000: Importer indicated a failed response
PLP0000: Importer indicated a failed response
PLP0000: Importer indicated a failed response

on the client that connect to the smart proxy server , "yum repolist " showed
https://proxy_server/pulp/repos/org_name/prod/org-CentOS-7/custom/CentOS-7/CentOS-7-os/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found

kat_server > rpm -q foreman foreman-proxy katello
foreman-2.2.0-0.31.rc3.el7.noarch
foreman-proxy-2.2.0-0.5.rc3.el7.noarch
katello-3.17.0-0.1.rc1.el7.noarch

proxy_server > rpm -q foreman-proxy foreman-proxy-content
foreman-proxy-2.2.0-0.5.rc3.el7.noarch
foreman-proxy-content-3.17.0-0.1.rc1.el7.noarch

Appreciate the help.

Can you send me the journalctl output after the sync on the kat_server?

Actually foreman-debug from the server would be better.

@Partha_Aji

I have a similar problem, please find the foreman-debug at http://debugs.theforeman.org/foreman-debug-FPOZo.tar.xz

Foreman Version: 2.1.4
Katello Version: 3.16.2

I have tried the following scenario’s:

  1. Syncing to a Smart Proxy in a different organization (with products shared among both)
  2. Syncing to a Smart Proxy in the same organization.

The problem seems to be limited only to composite content views if I grep the task error tab output, not ‘regular’ content views.

I also attempted to manually sync a repo via pulp-admin, but this is as verbose as it gets:

[root@deploy admin]# pulp-admin -v -u admin -p $pulpAdminPassword rpm repo sync run --force-full --repo-id 3-COV_CentOS8-Base-Production-d5fdb37d-a607-46a3-bacb-ff5b57c30603
+----------------------------------------------------------------------+
Synchronizing Repository
[3-COV_CentOS8-Base-Production-d5fdb37d-a607-46a3-bacb-ff5b57c30603]
+----------------------------------------------------------------------+

The following sync configuration options will be used:

Force Full:  True


This command may be exited via ctrl+c without affecting the request.


Downloading metadata...
[|]
... completed

Downloading repository content...
[|]

Task Failed

Importer indicated a failed response

Output from journald during the sync

Dec 07 11:14:15 deploy.lorenson.corp pulp[1034]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[a5ed4678-ecf4-4ace-a4de-64ad99bfa47e]
Dec 07 11:14:15 deploy.lorenson.corp pulp[1104]: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.sync.sync[830aaf75-9103-4d91-8506-3b10b6d91490]
Dec 07 11:14:15 deploy.lorenson.corp pulp[1891]: celery.app.trace:INFO: [a5ed4678] Task pulp.server.async.tasks._queue_reserved_task[a5ed4678-ecf4-4ace-a4de-64ad99bfa47e] succeeded in 0.010678214996s: None
Dec 07 11:14:15 deploy.lorenson.corp pulp[1104]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[0dcdcb98-77f7-47ca-b329-33d00e4695cc]
Dec 07 11:14:15 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Downloading metadata from https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/.
Dec 07 11:14:15 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:15 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/repomd.xml.
Dec 07 11:14:16 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Parsing metadata.
Dec 07 11:14:16 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Downloading metadata from https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/.
Dec 07 11:14:16 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:16 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/repomd.xml.
Dec 07 11:14:17 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Parsing metadata.
Dec 07 11:14:17 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Downloading metadata from https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/.
Dec 07 11:14:17 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:17 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/repomd.xml.
Dec 07 11:14:18 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Parsing metadata.
Dec 07 11:14:18 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Downloading metadata from https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/.
Dec 07 11:14:18 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:18 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/repomd.xml.
Dec 07 11:14:18 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:18.789383 +0100 SERVER (info) [C14133] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Parsing metadata.
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: pulp.server.controllers.repository:INFO: [830aaf75] Fully resyncing due to use of force_full in config
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Downloading metadata files.
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/dca6721829d82dbf845720c910de68f8d1ba90b4f0ea4792dab251781533e0ce-comps.xml.
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/c0cace4d6bd977ad29096c46467682b30b7ef65aff60fe7f7238096f9003d898-updateinfo.xml.gz.
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): deploy.admin.corp
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/667e850af80b8f7b69b39dc141e1e995780b7cb81a2d3086881e5252f68ecefd-modules.yaml.
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/987c01d322b242690f68881aa5a49978477bb67279a21b393fcce182e9bf547d-primary.xml.gz.
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/f4bc9fffee7711e8cc05a48be75d2ccc46b007636c510bb7ba99356eba51f0d3-other.xml.gz.
Dec 07 11:14:19 deploy.lorenson.corp pulp[1885]: nectar.downloaders.threaded:INFO: Download succeeded: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/repodata/ef817782d51807d2a0bcc3915fad913c169c3c3a0fe3bc1fc30752c0da311f45-filelists.xml.gz.
Dec 07 11:14:20 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Generating metadata databases.
Dec 07 11:14:23 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:23.796502 +0100 SERVER (info) [C14134] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:28 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Determining which units need to be downloaded.
Dec 07 11:14:28 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:28.802370 +0100 SERVER (info) [C14135] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:33 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:33.808740 +0100 SERVER (info) [C14136] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:38 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:38.814673 +0100 SERVER (info) [C14137] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:43 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:43.820733 +0100 SERVER (info) [C14138] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:48 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:48.827981 +0100 SERVER (info) [C14139] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:53 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:53.832848 +0100 SERVER (info) [C14140] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:14:57 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:INFO: [830aaf75] Downloading 0 RPMs.
Dec 07 11:14:58 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:14:58.842189 +0100 SERVER (info) [C14141] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:15:03 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:15:03.847798 +0100 SERVER (info) [C14142] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:15:04 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.repomd.alternate:INFO: [830aaf75] The content container reported: {'downloads': {}, 'total_sources': 0} for base URL: https://deploy.admin.corp/pulp/repos/Admin/Production/COV_CentOS8-Base/custom/CentOS8/CentOS8-AppStream/
Dec 07 11:15:04 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.purge:INFO: [830aaf75] Removing missing units.
Dec 07 11:15:08 deploy.lorenson.corp qdrouterd[1024]: 2020-12-07 11:15:08.855931 +0100 SERVER (info) [C14143] Connection to deploy.admin.corp:5646 failed: proton:io No route to host - disconnected deploy.admin.corp:5646
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208) 'NoneType' object has no attribute 'findall'
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208) Traceback (most recent call last):
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 294, in run
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)     self.update_content(metadata_files, url)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 627, in update_content
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)     purge.purge_unwanted_units(metadata_files, self.conduit, self.config, catalog)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/purge.py", line 46, in purge_unwanted_units
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)     remove_missing_groups(metadata_files, conduit)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/purge.py", line 165, in remove_missing_groups
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)     remote_named_tuples = get_remote_units(file_function, group.GROUP_TAG, process_func)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/purge.py", line 277, in get_remote_units
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)     for unit in package_info_generator:
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 64, in package_list_generator
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)     package_info = process_func(element)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/repomd/group.py", line 32, in process_group_element
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208)     packagelist.findall('packagereq'))
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp_rpm.plugins.importers.yum.sync:ERROR: [830aaf75] (1885-58208) AttributeError: 'NoneType' object has no attribute 'findall'
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: pulp.server.async.tasks:INFO: [830aaf75] Task failed : [830aaf75-9103-4d91-8506-3b10b6d91490]
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208) Task pulp.server.managers.repo.sync.sync[830aaf75-9103-4d91-8506-3b10b6d91490] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208) Traceback (most recent call last):
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)     R = retval = fun(*args, **kwargs)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 688, in __call__
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)     return super(Task, self).__call__(*args, **kwargs)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 110, in __call__
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)     return super(PulpTask, self).__call__(*args, **kwargs)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)     return self.run(*args, **kwargs)
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 854, in sync
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208)     raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response'))
Dec 07 11:15:12 deploy.lorenson.corp pulp[1885]: celery.app.trace:ERROR: [830aaf75] (1885-58208) PulpExecutionException: Importer indicated a failed response

There is another request open for exactly the same issue:
https://community.theforeman.org/t/smart-proxy-synchronize-always-fails-at-the-same-repository/21371

If you search through /v/l/m on the smart proxy server, you will find a python backtrace at the time of the error. In my case it is always during “pulp: pulp_rpm.plugins.importers.yum.purge:INFO: [fa7ed02d] Removing missing units”
The backtrace looks like this:

    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456) 'NoneType' object has no attribute 'findall'
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456) Traceback (most recent call last):
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 294, in run
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)     self.update_content(metadata_files, url)
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 627, in update_content
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)     purge.purge_unwanted_units(metadata_files, self.conduit, self.config, catalog)
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/purge.py", line 46, in purge_unwanted_units
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)     remove_missing_groups(metadata_files, conduit)
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/purge.py", line 165, in remove_missing_groups
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)     remote_named_tuples = get_remote_units(file_function, group.GROUP_TAG, process_func)
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/purge.py", line 277, in get_remote_units
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)     for unit in package_info_generator:
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 64, in package_list_generator
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)     package_info = process_func(element)
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/repomd/group.py", line 32, in process_group_element
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456)     packagelist.findall('packagereq'))
    Dec  4 14:28:44 smartproxy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fa7ed02d] (3958-15456) AttributeError: 'NoneType' object has no attribute 'findall'
    Dec  4 14:28:44 smartproxy pulp: pulp.server.async.tasks:INFO: [fa7ed02d] Task failed : [fa7ed02d-03de-45dd-96e0-4f74e20c386c]
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456) Task pulp.server.managers.repo.sync.sync[fa7ed02d-03de-45dd-96e0-4f74e20c386c] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456) Traceback (most recent call last):
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)     R = retval = fun(*args, **kwargs)
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 688, in __call__
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)     return super(Task, self).__call__(*args, **kwargs)
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 110, in __call__
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)     return super(PulpTask, self).__call__(*args, **kwargs)
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)     return self.run(*args, **kwargs)
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 854, in sync
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456)     raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response'))
    Dec  4 14:28:44 smartproxy pulp: celery.app.trace:ERROR: [fa7ed02d] (3958-15456) PulpExecutionException: Importer indicated a failed response

Which leads to the PLP0000 error. You should see above the back trace which repository it tried to sync. In my case its always failing at CentOS 7 and CentOS 8 AppStream.

Yes, you’re right, it is the exact same message, it’s also the one I’ve pasted from the system’s journal in my previous post.

@katello I think this is right up your alley :slight_smile:

After updating to Katello 3.18, the problem still persists, no proxy will be synced (and this is all from a fresh install)

@rbremer

Can you test this too, it seems to fix it!

  1. Open the offending CV
  2. On the published version, click the arrow and select ‘Regenerate repository metadata’
  3. Sync the proxy

I did that after reading this: https://access.redhat.com/solutions/3909111

Never mind, I cheered too soon, I forgot I unassociated the Lifecycle from the proxy… :frowning:

Hehe, I was hoping there for a second :slight_smile: