Problem:
I am unable to subscribe to grafana repository in dockerhub. I just now upgraded from katello 2 to katello 3.17. Expected outcome:
Repository should sync Foreman and Proxy versions:
2.2.3 Foreman and Proxy plugin versions:
Distribution and version:
RHEL 7 Other relevant data:
Error message: the server returns an error
HTTP status code: 403
Response headers: {"date"=>"Tue, 21 Sep 2021 13:39:20 GMT", "server"=>"gunicorn/20.0.4", "content-type"=>"application/json", "vary"=>"Accept,Cookie", "allow"=>"GET, PATCH, DELETE, HEAD, OPTIONS", "x-frame-options"=>"SAMEORIGIN", "content-length"=>"63", "via"=>"1.1 ingbtcpic6vl232.code1.emi.com", "connection"=>"close"}
Response body: {"detail":"You do not have permission to perform this action."}undefined method `each' for nil:NilClass
Dockerhub introduced rate limiting some months ago, so it’s possible that you’re experiencing that. Did the error occur immediately, or have you already been syncing some Docker content?
By the way, I would recommend that you go up to Katello 3.18. Katello 3.18 is the last release to support Pulp 2, so it received quite a bit more attention than Katello 3.17.
Here are the instructions: Foreman :: Plugin Manuals
Note that you can ignore the migration steps until you want to upgrade to Pulp 3 (unless you already did on your upgrade up to 3.17).
Can you show me what you are entering in for the upstream url and repository names? Also, on your primary smart proxy’s Services tab, can you paste me everything that’s under “Content”? That would be the smart proxy with the same hostname as your Katello server, in case you have multiple.
Try this: systemctl restart pulpcore* --all
If the pulpcore services aren’t all running successfully, there should be an error in /var/log/messages. I’d like to see that if so.
[root@ingbtcpic6vl232 ~]# sudo pip3 list | grep pulp
DEPRECATION: The default format will switch to columns in the future. You can use --format=(legacy|columns) (or define a format=(legacy|columns) in your pip.conf under the [list] section) to disable this warning.
pulp-2to3-migration (0.11.4)
pulp-certguard (1.0.3)
pulp-container (2.1.2)
pulp-file (1.3.0)
pulp-rpm (3.11.2)
pulpcore (3.7.8)
Do you need all tags for the Grafana repo? Can you try only syncing the latest tag? You can do so by setting the repository’s “Limit Sync Tags” to “latest” (or whatever tags you need). That should reduce the amount of downloads.
The tip I received from the Pulp team was that Pulpcore 3.14 carried improvements for retrying downloads that should help. Not to mention that the Pulpcore from Katello 3.17 has the old tasking system which didn’t work so well.
Since you’ve already migrated partially to Pulp 3, I would recommend to continue upgrading up to Katello 4.1 so that you receive the best version of Pulp 3.
First, it might be good to bring up a small test Katello 4.1 system to double check that it does indeed fix your syncing issue. I was able to sync Alpine myself, but I’m not sure if you were trying to sync a bunch of Docker repos at once. If you haven’t done this before, Forklift makes it easy. It’ll create a small VM for you and install Katello 4.1 on it.
If you are really stuck on the syncing issue and 4.1 definitely fixes it, feel free to upgrade keeping in mind the EPEL workaround from above.
If you prefer the absolute safest route with no workarounds, then I would wait for Katello 4.0.3 and 4.1.4 to be released before upgrading.