Error response from daemon: pull access denied for abc-production-airo-airo-keycloak, repository does not exist or may require ‘docker login’: denied: requested access to the resource is denied
Is your setup a fresh install since 3.15? If not, have you run the content migration steps?
Since Katello 3.15, fresh installs use Pulp 3 rather than Pulp 2 to manage container content. This means that docker/podman workflows are a bit different:
You no longer need to access the registry on port 5000. We use the default now, 443, so you can omit the port field altogether.
You must docker/podman login first. docker login <hostname> is all you need. You’ll be asked to enter your Foreman username and password.
Error response from daemon: pull access denied for abc-production-airo-airo-keycloak, repository does not exist or may require ‘docker login’: denied: requested access to the resource is denied
Apologies for the delay in responding. It’s expected that you should put the hostname in your docker pull command. docker pull fountain2.abc.com/abc-production-airo-airo-keycloak:v8 was correct.
Can you see your docker image if you do docker search fountain2.abc.com/ ?
Can you show me your Pulp 3 versions? sudo pip3 list | grep pulp
You mentioned you upgraded foreman, how did you do so?
Apologies for the delay in responding. It’s expected that you should put the hostname in your docker pull command. docker pull fountain2.abc.com/abc-production-airo-airo-keycloak:v8 was correct.
Yes it was correct and as you see in my previous post it was working.
[root@fountain2 fountain]# sudo pip3 list | grep pulp
DEPRECATION: The default format will switch to columns in the future. You can use --format=(legacy|columns) (or define a format=(legacy|columns) in your pip.conf under the [list] section) to disable this warning.
pulp-2to3-migration (0.5.0)
pulp-certguard (1.0.2)
pulp-container (2.0.1)
pulp-file (1.2.0)
pulp-rpm (3.6.2)
pulpcore (3.6.3)
You mentioned you upgraded foreman, how did you do so?
also if image is not there it give Error response from daemon: error parsing HTTP 404 response body: invalid character ‘:’ after top-level value: “404: Not Found” instead unknown not found.
I was able to reproduce your error parsing HTTP 404 response body: invalid character ':' after top-level value: "404: Not Found" issue. I’ll be looking into it.
Good to know about REGISTRY_HTTP_RELATIVEURLS, I hadn’t seen that before now.
I can’t say for sure yet what’s going on with the docker pull issue. I wasn’t able to reproduce the problem on the latest Katello 3.18 RC. This may be an issue with Pulp 3 rather than Katello.
If you are really stuck and need a workaround ASAP, I’d suggest that you revert back to Pulp 2 for Docker content. It requires some resetting of your content, but here it is:
Delete all docker repos and delete all content view versions that have docker content in them.
Alternatively, you could also do a full foreman-installer reset.
Run foreman-installer --katello-use-pulp-2-for-docker 1
I was able to fix the issue as well by upgrading to the latest Katello 3.18 RC, but that comes with its own risks since it’s a release candidate.
If you want to avoid deleting entire content views, the minimum would be to delete all docker repos and delete all content view versions that contain docker content.
Are you reverting because you decided you do want to be on Pulp 3 after all?
To upgrade, you follow these instructions: Foreman :: Plugin Manuals
If you upgrade using the instructions there, your Katello server will be on Foreman 2.3 and Katello 3.18. Both will be updated.
Note that upgrading to an RC is always a risk because it is considered “unstable”. The least “risky” route would be to revert to Pulp 2 instead. I would recommend you try using Docker on Pulp 2 before upgrading Katello to 3.18. Upgrading is easy, but downgrading is not in case you hit a new bug.