Unable to Sync Debian Packages

karthickitslm · April 30, 2021, 2:17pm

Hello Team,

I’m trying to synchronize Debian Repository and I’m not able to get the packages.

Version Info is as follows:

Foreman-tasks : 3.0.5
foreman_remote_execution: 4.2.2
katello : 3.18.2.1
Version 2.3.3

I got the below error message:

Cannot create repository version. The path for file ‘dists/buster’ overlaps: dists/buster/Release, dists/buster/InRelease, dists/buster/Release.gpg.

If some of the settings related to gpg is changed then I’m getting the sync status as “Success” but none of the packages are published in “Foreman”.

At the same time, it works all fine with Ubuntu “Bionic”.

I have another server with the following version in which I’m successfully able to sync Debian packages without any problem.

Foreman-tasks : 3.0.2
foreman_remote_execution: 4.2.1
katello : 3.18.0
Version 2.3.1

Is there a way to downgrade the versions as above without reinstalling Foreman ??

Please advise. Appreciate your help.

Thanks.

quba42 · April 30, 2021, 2:37pm

This is a known bug in pulp_deb: Issue #8410: syncing deb-repos in pulp 3 fails with "The path for file... overlaps" - Debian Support - Pulp

It should be fixed with pulp_deb version 2.9.1, 2.10.1, or 2.11.1.

We are working on getting these versions into Katello (either Katello 3.18.3 or 3.18.4 will contain a fixed version).

karthickitslm · May 3, 2021, 6:32am

Hello @quba42,

Thanks for your update.

Please let me know if there is an option downgrade the version or you recommend to make a fresh installation with the appropriate versions.

quba42 · May 3, 2021, 12:03pm

So the fix is now available in the repository used by Katello 4.0: https://yum.theforeman.org/pulpcore/3.9/el7/x86_64/python3-pulp-deb-2.9.1-1.el7.noarch.rpm

You could either upgrade to Katello 4.0, or you need to wait until Katello 3.18.4 is released (we are planning to include the fix in that release as well).

You could try manually installing the package I have linked to above on your Katello 3.18.2.1 installation (make sure you run foreman-installer afterwards to make sure all Pulp migrations are applied). However this option is risky, since I cannot guarantee there won’t be a incompatibility between the API bindings included in Katello 3.18.2.1 and version 2.9.1 of python3-pulp-deb. If this is a critical system it is better to wait for the Katello 3.18.4 release.

karthickitslm · May 3, 2021, 12:05pm

Hello @quba42,

Thanks.

laimsi · May 5, 2021, 5:53pm

Hello karthickitslm

I’m running Katello 4.0.0-1 but still can’t sync Debian 10 repositories:
Below what i’m using to configure Debian 10 repositories:

Debian 10 main:
- URL: http://ftp.debian.org/debian/
- Releases: buster
- Component: main
- Architecture: amd64
Debian 10 security:
- URL: http://deb.debian.org/debian-security/
- Releases: buster/updates
- Component: main
- Architecture: amd64
Debian 10 updates:
- URL: http://ftp.debian.org/debian/
- Releases: buster-updates
- Component: main
- Architecture: amd64

Can you share your Debian repositories configuration.

Thanks for your help

quba42 · May 6, 2021, 7:47am

and one more time my answer on the other thread: Subscription Manager for Debian & Ubuntu on apt.atix.de - #32 by quba42

laimsi · May 6, 2021, 8:31am

Hello mcorr & quba42,

Thanks for your reply and sorry for duplicating the topics,

I added more information and logs under Subscription Manager for Debian & Ubuntu on apt.atix.de

quba42 Ubuntu 20.04 sync is working just fine, I’m facing this sync issue only With Debian 10.

Thanks !

Regard,

karthickitslm · May 10, 2021, 2:03pm

Hello @quba42,

Thanks for your update. I’m executing the following commands.

==
yum -y localinstall https://yum.theforeman.org/releases/2.3/el7/x86_64/foreman-release.rpm
yum -y install epel-release centos-release-scl-rh
yum update
yum -y localinstall https://yum.puppet.com/puppet6-release-el-7.noarch.rpm
yum -y localinstall https://fedorapeople.org/groups/katello/releases/yum/4.0/katello/el7/x86_64/katello-4.0.0-1.el7.noarch.rpm

I’m getting the following error message.

==
Error: Package: katello-4.0.0-1.el7.noarch (/katello-4.0.0-1.el7.noarch)
Requires: candlepin-selinux >= 2.0
Error: Package: katello-4.0.0-1.el7.noarch (/katello-4.0.0-1.el7.noarch)
Requires: katello-common = 4.0.0-1.el7
Error: Package: katello-4.0.0-1.el7.noarch (/katello-4.0.0-1.el7.noarch)
Requires: candlepin >= 2.0
Error: Package: katello-4.0.0-1.el7.noarch (/katello-4.0.0-1.el7.noarch)
Requires: tfm-rubygem-hammer_cli_katello
Error: Package: katello-4.0.0-1.el7.noarch (/katello-4.0.0-1.el7.noarch)
Requires: tfm-rubygem-katello

Please advise, thanks.

karthickitslm · May 11, 2021, 10:34am

Hello @quba42,

Can you please advise, thanks.

quba42 · May 11, 2021, 12:57pm

I am no expert in yum usage and I am not sure I understand exactly what you are trying to upgrade to what.

I am also afraid we have found another bug in all current pulp_deb releases that is causing a lot of Debian repos to fail to sync.
Until there is a fix for this bug, there isn’t much we can do to get pulp_deb working fully.
You can watch for progress on this latest bug here: Issue #8671: Sync with Main Debian Repo fails on a translation file - Debian Support - Pulp

karthickitslm · May 13, 2021, 10:48am

Hello @quba42,

Thanks for your update.

It really helps to understand things.

karthickitslm · May 19, 2021, 11:06am

Hello All,

Can someone please advise which version of Katello is recommended to install as I already tried with 2 versions and its not working as expected.

I’m referring to the below URL:

https://theforeman.org/plugins/katello/3.18/installation/index.html

Any suggestions would be really helpful, thanks.

karthickitslm · May 24, 2021, 5:17am

Hello All,

Can someone please advise which version of Katello is recommended to install as I already tried with 2 versions and its not working as expected.

I’m referring to the below URL:

https://theforeman.org/plugins/katello/3.18/installation/index.html

Any suggestions would be really helpful, thanks.

karthickitslm · May 25, 2021, 6:47am

Hello All,

Any ETA on when this issue will be resolved ?

Thanks.

karthickitslm · May 31, 2021, 6:47am

Hello @quba42,

I could notice that the status as “Closed”.

https://pulp.plan.io/issues/8671

Please let me know if that means that the issue reported above is resolved now.

Thanks.

quba42 · May 31, 2021, 7:23am

The following pulp_deb versions can no longer fail on translation files during sync: 2.13.0, 2.12.1, 2.11.2, 2.10.2, and 2.9.2.

I believe the fixed versions are available for Katello versions greater than 4.0.1.
It is also planned to add a fixed version to the Katello 3.18.4 release, but that has not yet been released.

karthickitslm · May 31, 2021, 7:44am

Hello @quba42,

Thanks a lot for your update.

karthickitslm · May 31, 2021, 7:55am

Hello @quba42,

I’m trying to follow the instructions on the following link.

https://theforeman.org/plugins/katello/3.18/installation/index.html

But when I select the version 4.0 in the dropdown in the top left corner the page is not loading.

Can you please advise me on this.

Thanks.

kobena · May 31, 2021, 8:21am

Hi @karthickitslm,

The documentation page for Katello 4 is now there : Installing Foreman 2.4 server with Katello 4.0 plugin on Enterprise Linux.

You can use Katello 3.18 to manage Debian repositories, but you have to apply some fixes.

Make a new Katello 3.18 installation
Update python3-pulp-deb from 2.7 to to 2.9 : https://yum.theforeman.org/pulpcore/3.9/el7/x86_64/python3-pulp-deb-2.9.2-1.el7.noarch.rpm
Then apply this fix (manually) : Fixes #32393 - Add deb structured mode publishing by m-bucher · Pull Request #9306 · Katello/katello · GitHub.

it works for me (debian 10 + subscription manager).

Hope it helps.