Debian main sync fail with Error: 403 message=Forbidden

Hello team,

Debian main repository sync stops and fail with error below

hammer repository synchronize --id 1
[..........................................................................................................................................] [100%
Total steps: 20209/20209
--------------------------------
Associating Content: 20005/20005
Downloading Artifacts: 202/202
Un-Associating Content: 0/0
Update PackageIndex units: 1/1
Update ReleaseFile units: 1/1
Error: 403, message='Forbidden', url=URL('http://ftp.debian.org/debian/pool/main/i/inetsim/inetsim_1.2.7+dfsg.1-1_all.deb')

Below Debian main repository configuration :

debian main repository:
Upstream URL: Index of /debian
Releases: buster
Components: main
Architectures: amd64

[root@forman ~]# hammer repository info --id 1
Id:                 1
Name:               Debian 10 main
Label:              Debian_10_main
Description:
Organization:       My_Organization
Red Hat Repository: no
Content Type:       deb
Mirror on Sync:     yes
Url:                http://ftp.debian.org/debian/
Publish Via HTTP:   yes
Published At:       https://localhost/pulp/content/My_Organization/Library/custom/Debian_10/Debian_10_main/
Relative Path:      My_Organization/Library/custom/Debian_10/Debian_10_main
Download Policy:
HTTP Proxy:
    Id:                1
    Name:              myproxy.mydomain.net
    HTTP Proxy Policy: use_selected_http_proxy
Product:
    Id:   1
    Name: DEBIAN 10
GPG Key:
    Id:   2
    Name: GPG-KEY-DEB-10-MAIN
Sync:
    Status:         Warning
    Last Sync Date: 1 minute
Created:            2021/05/03 10:19:55
Updated:            2021/05/08 16:47:51

========================================================================

Info agout Forman/Katello version :

In attachement file all Installed Packages.

This issue looks similar to issue :
Is it possible to ignore/skip the file .treeinfo at the top of a remote YUM repository? - Support - TheForeman

Thanks for your help.Forman_Packages_list.log (9.7 KB)

Since the package that is supposedly “Forbidden 403” downloads just fine for me, I am wondering if there is any chance this is actually something to do with the HTTP proxy being used? If so then there really isn’t much Pulp/Katello/Foreman can do.

Can you test if you can manually download the package (http://ftp.debian.org/debian/pool/main/i/inetsim/inetsim_1.2.7+dfsg.1-1_all.deb) on your Katello installation?

Hello @quba42,

After using a different proxy I’m not facing error 403 any more (thanks for your help).

But now I have this new error :

Cannot create repository version. The path for file 'dists/buster' overlaps: dists/buster/Release, dists/buster/InRelease, dists/buster/Release.gpg.

Any idea?

Regards,

Yes, this is a known bug, that should be fixed with pulp_deb versions 2.9.1, 2.10.1, 2.11.1.
The fixed version should be packaged and available for Katello starting with the Katello 3.18.4 and 4.0.1 releases (not yet released).

If you are on Katello 4.0.0 the updated pulp_deb package is actually available now (See: https://yum.theforeman.org/pulpcore/3.9/el7/x86_64/python3-pulp-deb-2.9.1-1.el7.noarch.rpm. It should be installable with yum update)

You could try installing this package, but I cannot guarantee there won’t be any API binding incompatibilities with Katello versions before 3.18.4 and 4.0.1!

Hello @quba42,

Issue fixed after package python3-pulp-deb upgrade to python3-pulp-deb-2.9.1-1.el7.noarch.rpm with yum update .

Now I’m able to sync Debian 10 main repo :slight_smile:

Thanks for your help and your time.

Regards,