Foreman 2.5 / Katello 4.1 upgrade FAILED in [pulpcore-manager migrate --noinput] due pulpcore VersionConflict

sasskinn12 · October 14, 2021, 11:30am

Problem:
Hi i have a problem with katello upgrade. Seems like i tried almost everything but still with no luck.
The problem i guess is related to pulpcore-manager which is called by installer. The command fails:

2021-10-14 14:15:26 [NOTICE] [configure] Starting system configuration.
2021-10-14 14:15:41 [NOTICE] [configure] 250 configuration steps out of 2090 steps complete.
2021-10-14 14:15:50 [NOTICE] [configure] 500 configuration steps out of 2090 steps complete.
2021-10-14 14:15:55 [NOTICE] [configure] 750 configuration steps out of 2092 steps complete.
2021-10-14 14:15:59 [NOTICE] [configure] 1250 configuration steps out of 2101 steps complete.
2021-10-14 14:17:22 [NOTICE] [configure] 1500 configuration steps out of 2102 steps complete.
2021-10-14 14:17:22 [NOTICE] [configure] 1750 configuration steps out of 2102 steps complete.
2021-10-14 14:17:24 [ERROR ] [configure] 'pulpcore-manager migrate --noinput' returned 1 instead of one of [0]
2021-10-14 14:17:24 [ERROR ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns: change from 'notrun' to ['0'] failed: 'pulpcore-manager migrate --noinput' returned 1 instead of one of [0]
2021-10-14 14:17:24 [NOTICE] [configure] 2000 configuration steps out of 2102 steps complete.
2021-10-14 14:17:26 [NOTICE] [configure] System configuration has finished.

  There were errors detected during install.
  Please address the errors and re-run the installer to ensure the system is properly configured.
  Failing to do so is likely to result in broken functionality.

  The full log is at /var/log/foreman-installer/katello.log

When i try to run it manually i get

[root@katello site-packages]# pulpcore-manager migrate --noinput
Traceback (most recent call last):
  File "/bin/pulpcore-manager", line 11, in <module>
    load_entry_point('pulpcore==3.14.7', 'console_scripts', 'pulpcore-manager')()
  File "/usr/lib/python3.6/site-packages/pulpcore/app/manage.py", line 11, in manage
    execute_from_command_line(sys.argv)
  File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
    utility.execute()
  File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 325, in execute
    settings.INSTALLED_APPS
  File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 79, in __getattr__
    self._setup(name)
  File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 66, in _setup
    self._wrapped = Settings(settings_module)
  File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 157, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
  File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/usr/lib/python3.6/site-packages/pulpcore/app/settings.py", line 84, in <module>
    plugin_app_config = entry_point.load()
  File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2317, in load
    self.require(*args, **kwargs)
  File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2340, in require
    items = working_set.resolve(reqs, env, installer, extras=self.extras)
  File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 779, in resolve
    raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.VersionConflict: (pulpcore 3.14.7 (/usr/lib/python3.6/site-packages), Requirement.parse('pulpcore<3.10,>=3.6'))

Which is hard to understand because i checked that ALL dependencies and correct versions should be installed on the system.
Event if i just run command

[root@katello site-packages]# python3 /usr/lib/python3.6/site-packages/pulpcore/app/manage.py
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/pulpcore/app/manage.py", line 15, in <module>
    manage()
  File "/usr/lib/python3.6/site-packages/pulpcore/app/manage.py", line 11, in manage
    execute_from_command_line(sys.argv)
  File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
    utility.execute()
  File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 325, in execute
    settings.INSTALLED_APPS
  File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 79, in __getattr__
    self._setup(name)
  File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 66, in _setup
    self._wrapped = Settings(settings_module)
  File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 157, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
  File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/usr/lib/python3.6/site-packages/pulpcore/app/settings.py", line 84, in <module>
    plugin_app_config = entry_point.load()
  File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2317, in load
    self.require(*args, **kwargs)
  File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2340, in require
    items = working_set.resolve(reqs, env, installer, extras=self.extras)
  File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 779, in resolve
    raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.VersionConflict: (pulpcore 3.14.7 (/usr/lib/python3.6/site-packages), Requirement.parse('pulpcore<3.10,>=3.6'))

It will give me same error messange about version conflict.
Could somebody maybe suggest how to fix that problem
Thanks a lot !!!

Upgrade failed.
Expected outcome:
Katello upgrade is successfull.
Foreman and Proxy versions:
Foreman: foreman-2.5.3-1.el7.noarch

Foreman and Proxy plugin versions:
Katello: katello-4.1.4-1.el7.noarch
Distribution and version:
CentOS Linux release 7.9.2009 (Core)
Other relevant data:
Installer LOG

2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]: Starting to evaluate the resource (1991 of 2102)
2021-10-14 14:17:23 [DEBUG ] [configure] Exec[pulpcore-manager migrate --noinput](provider=posix): Executing check 'pulpcore-manager migrate --plan | grep "No planned migration operations"'
2021-10-14 14:17:23 [DEBUG ] [configure] Executing with uid=pulp: 'pulpcore-manager migrate --plan | grep "No planned migration operations"'
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless: Traceback (most recent call last):
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/bin/pulpcore-manager", line 11, in <module>
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     load_entry_point('pulpcore==3.14.7', 'console_scripts', 'pulpcore-manager')()
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/pulpcore/app/manage.py", line 11, in manage
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     execute_from_command_line(sys.argv)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_c
ommand_line
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     utility.execute()
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 325, in execute
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     settings.INSTALLED_APPS
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 79, in __getattr__
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     self._setup(name)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 66, in _setup
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     self._wrapped = Settings(settings_module)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 157, in __init__
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     mod = importlib.import_module(self.SETTINGS_MODULE)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     return _bootstrap._gcd_import(name[level:], package, level)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/pulpcore/app/settings.py", line 84, in <module>
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     plugin_app_config = entry_point.load()
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2317, in load
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     self.require(*args, **kwargs)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2340, in require
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     items = working_set.resolve(reqs, env, installer, extras=self.extras)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:   File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 779, in resolve
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless:     raise VersionConflict(dist, req).with_context(dependent_req)
2021-10-14 14:17:23 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/unless: pkg_resources.VersionConflict: (pulpcore 3.14.7 (/usr/lib/python3.6/site-packages), Requirement.parse('pu
lpcore<3.10,>=3.6'))
2021-10-14 14:17:23 [DEBUG ] [configure] Exec[pulpcore-manager migrate --noinput](provider=posix): Executing 'pulpcore-manager migrate --noinput'
2021-10-14 14:17:23 [DEBUG ] [configure] Executing with uid=pulp: 'pulpcore-manager migrate --noinput'
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns: Traceback (most recent call last):
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/bin/pulpcore-manager", line 11, in <module>
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     load_entry_point('pulpcore==3.14.7', 'console_scripts', 'pulpcore-manager')()
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/pulpcore/app/manage.py", line 11, in manage
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     execute_from_command_line(sys.argv)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_
command_line
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     utility.execute()
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/django/core/management/__init__.py", line 325, in execute
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     settings.INSTALLED_APPS
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 79, in __getattr__
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     self._setup(name)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 66, in _setup
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     self._wrapped = Settings(settings_module)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/django/conf/__init__.py", line 157, in __init__
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     mod = importlib.import_module(self.SETTINGS_MODULE)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     return _bootstrap._gcd_import(name[level:], package, level)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/pulpcore/app/settings.py", line 84, in <module>
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     plugin_app_config = entry_point.load()
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2317, in load
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     self.require(*args, **kwargs)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2340, in require
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     items = working_set.resolve(reqs, env, installer, extras=self.extras)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:   File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 779, in resolve
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns:     raise VersionConflict(dist, req).with_context(dependent_req)
2021-10-14 14:17:24 [INFO  ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns: pkg_resources.VersionConflict: (pulpcore 3.14.7 (/usr/lib/python3.6/site-packages), Requirement.parse('p
ulpcore<3.10,>=3.6'))
2021-10-14 14:17:24 [ERROR ] [configure] 'pulpcore-manager migrate --noinput' returned 1 instead of one of [0]
2021-10-14 14:17:24 [ERROR ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]/returns: change from 'notrun' to ['0'] failed: 'pulpcore-manager migrate --noinput' returned 1 instead of one of
[0]
2021-10-14 14:17:24 [DEBUG ] [configure] /Stage[main]/Pulpcore::Database/Pulpcore::Admin[migrate --noinput]/Exec[pulpcore-manager migrate --noinput]: Evaluated in 1.13 seconds

ekohl · October 14, 2021, 1:37pm

Looks like you have Pulpcore 3.14 installed but some plugin that doesn’t support that. I don’t know which package it exactly is.

Is there anything that shows up in yum update?

sasskinn12 · October 14, 2021, 1:51pm

Thanks for you answer. @ekohl . No yum update does not giving me anything for an update
What do you mean by “plugin”? Foreman plugin or python module? Is it possible to identify this plugin somehow? cause i have no idea which one it could be and does not know how

ekohl · October 14, 2021, 4:23pm

In this case it’s a Pulpcore plugin (which is written in Python). I think you can list them with rpm -qa | grep pulp.

Mamba · October 15, 2021, 6:31am

Two things:

1. What do you get if you run this?

find /usr/lib/python3.6/site-packages -type f -exec grep -H "pulpcore<3.10,>=3.6" {} \;

Also,

For fun, I did some digging around the Index of /pulpcore repos.

I was looking for a file that might trigger this

pkg_resources.VersionConflict: (pulpcore 3.14.7 (/usr/lib/python3.6/site-packages), Requirement.parse('pulpcore<3.10,>=3.6'))

When I went back to the 3.9 repo, I got a hit on this file

./usr/lib/python3.6/site-packages/pulp_2to3_migration-0.6.0-py3.6.egg-info/requires.txt:pulpcore<3.10,>=3.6

Which would have come from python3-pulp-2to3-migration-0.6.0-2.el7.noarch.rpm

If your repos are setup correctly you shouldn’t have a problem because this package would have been updated, but still I’m curious:

2. What version of “python3-pulp-2to3-migration” do you have installed?

sasskinn12 · October 15, 2021, 11:28am

Hi, thanks for reply!
Seems this does not helped to identify plugin with not compatible version.

Sadly but command has not found anything here.

[root@katello ~]# find /usr/lib/python3.6/site-packages -type f -exec grep -H "pulpcore<3.10,>=3.6" {} \;
[root@katello ~]#

[root@katello /]# ls -ld /usr/lib/python3.6/site-packages/pulp*
drwxr-xr-x.  6 root root 102 Oct 14 11:55 /usr/lib/python3.6/site-packages/pulp_2to3_migration
drwxr-xr-x.  2 root root 134 Oct 15 14:09 /usr/lib/python3.6/site-packages/pulp_2to3_migration-0.12.0-py3.6.egg-info
drwxr-xr-x.  5 root root  68 Oct 15 14:04 /usr/lib/python3.6/site-packages/pulp_ansible
drwxr-xr-x.  2 root root 134 Oct 15 14:04 /usr/lib/python3.6/site-packages/pulp_ansible-0.9.0-py3.6.egg-info
drwxr-xr-x.  5 root root  68 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulp_certguard
drwxr-xr-x.  2 root root 134 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulp_certguard-1.4.0-py3.6.egg-info
drwxr-xr-x.  5 root root  88 Oct 14 11:55 /usr/lib/python3.6/site-packages/pulp_container
drwxr-xr-x.  2 root root 134 Oct 14 11:55 /usr/lib/python3.6/site-packages/pulp_container-2.8.1-py3.6.egg-info
drwxr-xr-x. 12 root root 213 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulpcore
drwxr-xr-x.  2 root root 134 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulpcore-3.14.7-py3.6.egg-info
drwxr-xr-x.  5 root root  68 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulp_deb
drwxr-xr-x.  2 root root 134 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulp_deb-2.14.1-py3.6.egg-info
drwxr-xr-x.  5 root root  87 Oct 14 11:55 /usr/lib/python3.6/site-packages/pulp_file
drwxr-xr-x.  2 root root 134 Oct 14 11:55 /usr/lib/python3.6/site-packages/pulp_file-1.8.2-py3.6.egg-info
drwxr-xr-x.  5 root root  68 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulp_rpm
drwxr-xr-x.  2 root root 134 Oct 14 11:54 /usr/lib/python3.6/site-packages/pulp_rpm-3.14.5-py3.6.egg-info

[root@katello /]# rpm -q python3-pulp-2to3-migration
python3-pulp-2to3-migration-0.12.0-1.el7.noarch

I will try to scan/find/grep whole “/” for this depenency (thanks for the tip) and see how it goes. The dependency should be marked somewhere in files…

sasskinn12 · October 18, 2021, 8:32am

Seems like indeed problem was related to python3-pulp-2to3-migration plugin. Where it was installed using pip3 python installer not yum.

[root@katello ]# pip3 uninstall pulp-2to3-migration

After removing all pulpcore and it’s plugins using yum and pip3 and reinstalling them from scratch using yum. Everything is working fine. Thanks for help, problem solved.