As You can see, I’m only able to list a few packages availables. Some usefull informations:
If I create a repository with public streams, onto the server, then I see the correct number of packages
I had a try to create a different content view, destroy and synchronize again the repos and product, regenerate metadatas either on CV or on repos, present to different VM and physical servers, but nothing has changed so far.
I am seeing the same behavior. Foreman 1.24/Katello 3.14. AppStream shows 5532 pkgs in repo but the client only shows 940. I noticed this when I couldn’t install git. The repo sync’d to the foreman box OK (advanced sync completes with no errors). There does appear to be something amiss here.
I am seeing this too against 8 and 8.1 RHEL repos. I can see the data downloaded from Redhat is correct, but many packages are missing from the content views I have generated as seen by the client ( although all looks OK when viewing the details in Foreman UI)
This is expected behavior with RHEL 8 Appstream, Centos 8 Appstream, and Fedora Appstream repos. These appstream repositories use a new feature of dnf called ‘modules’. Read more about them here:
Think about modules as ‘sub’ repositories that have to be enabled in order to gain access to their content. This allows for multiple versions of the same software package to be available and install-able.
As an example, I am missing packages for sysstat and git ( @WScottB also mentioned this ). It is not clear to me how this is related to install modules from the Appstream. I plan to spend more time later this week. Perhaps enabling debug in Pulp might help.
I added back the public AppStream repo in addition to my enabled subscription with AppStream and ran dnf list (with grep -i appstream and sed to replace our company name). Here is an example of what shows up from katello vs what shows up from public repo with no module specifications (sticking with the git example):
It took a while to dig into this, and i got some help from the pulp team (thanks a ton to them!)
I found a few things:
this only happens within a content view. If you just subscribe to “Library”, the problem isn’t seen.
The problem is happening due to copying of contents incorrectly at publish time. I’ve tracked it down to a pulp bug: https://pulp.plan.io/issues/5942
The problem would happen currently regardless of whether or not you are using Content view filters
I imagine it will be a while before the pulp team is able to deliver a full fix for this issue, in the mean time we could fairly easy code fix this for content view publishes that do NOT involve filters (on the appstream repo).
Would that be helpful?
A full fix that also fixes it for filtered-publishes would require a pulp fix.
Success! I first used the Default Organization View, with Library which worked. I then tried your patch, published a new view and promoted it. This too worked successfully and I am able to install the required packages.
Thank you very much for taking the time to look at this!