Can't access packages available in CentOS 7 base

Support
1

Problem:
Foreman/Katello main server + 4 Smart Proxies in other geo locations

My CentOS 7 product with 3 repos (base, extras, updates) is sync’ed daily with CentOS 7 upstream repos.
Upon publishing a view and promoting life cycles which then triggers a sync with the smart proxies there are rpm packages I can’t see eventhough they are in the CentOS 7 base repo…
Specifically anything related to “pcre2” (There might be others but I need this one hence my focus on it)

# yum search pcre2
Loaded plugins: enabled_repos_upload, fastestmirror, package_upload, product-id, search-disabled-repos, subscription-manager, tracer_upload
Loading mirror speeds from cached hostfile
Warning: No matches found for: pcre2
No matches found
Uploading Enabled Repositories Report
Loaded plugins: fastestmirror, product-id, subscription-manager

# yum search pcre
Loaded plugins: enabled_repos_upload, fastestmirror, package_upload, product-id, search-disabled-repos, subscription-manager, tracer_upload
Loading mirror speeds from cached hostfile
========================================================================================================= N/S matched: pcre ==========================================================================================================
anope-pcre.x86_64 : PCRE regular expression module Anope IRC services
ghc-pcre-light-devel.x86_64 : Haskell pcre-light library development files
ocaml-pcre.x86_64 : Perl compatibility regular expressions (PCRE) for OCaml
ocaml-pcre-devel.x86_64 : Development files for ocaml-pcre
php-composer-pcre.noarch : PCRE wrapping library version 1
php-composer-pcre3.noarch : PCRE wrapping library version 3
ghc-pcre-light.x86_64 : Perl5 compatible regular expression library
opensips-regex.x86_64 : RegExp via PCRE library
pcre.x86_64 : Perl-compatible regular expression library

  Name and summary matches only, use "search all" for everything.
Uploading Enabled Repositories Report
Loaded plugins: fastestmirror, product-id, subscription-manager

Expected outcome:
I’m expecting to see those in my search and they should be available to install…

pcre2-10.23-2.el7.i686
pcre2-10.23-2.el7.x86_64
pcre2-devel-10.23-2.el7.i686
pcre2-devel-10.23-2.el7.x86_64
pcre2-static-10.23-2.el7.i686
pcre2-static-10.23-2.el7.x86_64
pcre2-tools-10.23-2.el7.x86_64
pcre2-utf16-10.23-2.el7.i686
pcre2-utf16-10.23-2.el7.x86_64
pcre2-utf32-10.23-2.el7.i686
pcre2-utf32-10.23-2.el7.x86_64

I have this issue with VMs connected to main Foreman/Katello server and connected to Smart Proxies.
I’ve checked and double checked my activation keys (subs & repo sets), my content views (repos). I’ve published my views and promoted my life cycles several times. Waited for Smart Proxies sync (no errors). Still having the problem…

Foreman and Proxy versions:
Foreman 3.3.0 + Katello 4.5.0 + Pulpcore 3.18 + Puppet 7

Foreman and Proxy plugin versions:
Foreman 3.3.0 + Katello 4.5.0 + Pulpcore 3.18 + Puppet 7

Distribution and version:
CentOS 7.9.2009
Kernel 3.10.0-1160.71.1.el7.x86_6

Other relevant data:

2

Check the foreman task page for any errors during sync, publish, promote or proxy sync.

Also verify that host has access to the repository with yum repolist -v. It shows everything about all repositories accessible.

3

Ok so

yum repolist -v.

only list the CentOS 7 updates repo and the other 2 (base + extras) don’t show!!
So that explains the problem but I can’t see any task errors that would explain this…

4

Hard to tell without seeing the actual output of yum repolist…

yum repolist shows you the URL where content is downloaded. That should point to your content proxy.

You can check available repositories on the content proxy via the url https://content-proxy.example.com/pub/content/

You can also check subscription-manager identity to see which environment is used.

Finally subscription-manager repos shows all repositories accessible by the client through current subscriptions, environment and content-view.

5

https://content-proxy.example.com/pulp/content/

XXX_DevOps/Library/c7-devops-view/custom/c7-codeit/c7-codeit-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-docker-ce/c7-docker-ce-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-curator-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-epel/c7-epel-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-foreman-katello-client-3_3/c7-foreman-katello-client-3_3-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-google-chrome/c7-google-chrome-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-grafana/c7-grafana-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-hashicorp/c7-hashicorp-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-jenkins-lts/c7-jenkins-lts-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-mariadb/c7-mariadb-10_5-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-mongodb-5_0/c7-mongodb-5_0-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-nodesource/c7-nodesource-14-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-qpid-copr/c7-qpid-copr-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-rabbitmq-erlang/c7-rabbitmq-erlang-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-rabbitmq-server/c7-rabbitmq-server-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-remi/c7-remi-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-salt-py3/c7-salt-py3-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-scl/c7-scl-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-tickstack/c7-tickstack-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-wandisco/c7-wandisco-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-yarn-v1/c7-yarn-v1-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-zabbix-lts/c7-zabbix-4_0-lts-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7/c7-base-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7/c7-extras-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7/c7-updates-repo/

26 repos.

However

yum repolist -v

list only 24 (c7 base + c7 extras missing)

subscription-manager repos

list only 24 (c7 base + c7 extras missing)

VMs have been registered

subscription-manager register --org='XXX_DevOps' --activationkey='c7-devops-key' --force ; rm -f /etc/pki/product/* ; cp /etc/pki/entitlement/* /etc/pki/product/ ; rm -f /var/log/*-20* ; yum clean all ; yum update
6

Without seeing the output of those commands is hard to guess.

You have posted the URLs for the library environment but mentioned before that you are using life cycle environments. subscription identity and repos would tell which environment you are actually using…

Your registration is evil. I don’t understand why you would do what do…

7

Not sure what you think is evil.

Lifecycle
https://content-proxy.example.com/lifecycle_environments/2/repositories?page=1&per_page=200

Name	Product	Content View
c7-base-repo	c7	c7-devops-view
c7-codeit-repo	c7-codeit	c7-devops-view
c7-docker-ce-repo	c7-docker-ce	c7-devops-view
c7-elasticsearch-curator-repo	c7-elasticsearch	c7-devops-view
c7-elasticsearch-repo	c7-elasticsearch	c7-devops-view
c7-epel-repo	c7-epel	c7-devops-view
c7-extras-repo	c7	c7-devops-view
c7-foreman-katello-client-3_3-repo	c7-foreman-katello-client-3_3	c7-devops-view
c7-google-chrome-repo	c7-google-chrome	c7-devops-view
c7-grafana-repo	c7-grafana	c7-devops-view
c7-hashicorp-repo	c7-hashicorp	c7-devops-view
c7-jenkins-lts-repo	c7-jenkins-lts	c7-devops-view
c7-mariadb-10_5-repo	c7-mariadb	c7-devops-view
c7-mongodb-5_0-repo	c7-mongodb-5_0	c7-devops-view
c7-nodesource-14-repo	c7-nodesource	c7-devops-view
c7-qpid-copr-repo	c7-qpid-copr	c7-devops-view
c7-rabbitmq-erlang-repo	c7-rabbitmq-erlang	c7-devops-view
c7-rabbitmq-server-repo	c7-rabbitmq-server	c7-devops-view
c7-remi-repo	c7-remi	c7-devops-view
c7-salt-py3-repo	c7-salt-py3	c7-devops-view
c7-scl-repo	c7-scl	c7-devops-view
c7-tickstack-repo	c7-tickstack	c7-devops-view
c7-updates-repo	c7	c7-devops-view
c7-wandisco-repo	c7-wandisco	c7-devops-view
c7-yarn-v1-repo	c7-yarn-v1	c7-devops-view
c7-zabbix-4_0-lts-repo	c7-zabbix-lts	c7-devops-view

The lifecycle shows 26 repos

# subscription-manager identity
system identity: 9dd2f85a-0d2d-42ef-baaa-bbf08eba1a18
name: dev01.xxx
org name: XXX DevOps
org ID: XXX_DevOps
environment name: devops/c7-devops-view

c7 base and c7 extras refuse to show up eventhough they are everywhere. Activation keys, Content View, Life Cycle…

8

That command:

force register and moving entitlements around isn’t good.

Before you listed

[quote=“fred_demarcy, post:5, topic:29918”]
https://content-proxy.example.com/pulp/content/

XXX_DevOps/Library/c7-devops-view/custom/c7-codeit/c7-codeit-repo/
XXX_DevOps/Library/c7-devops-view/custom/c7-docker-ce/c7-docker-ce-repo/
...

[/quote] ```

which are Library environment. Your client is in devops environment. If the URLs above are all those on your content proxy, then the client cannot possibly connected to the content proxy. But unfortunately, you didn’t show yum repolist -v output nor subscription-manager repos, thus it’s not possible to tell.

Nor is your lifecycle listing particularly helpful at this point because it doesn’t show whether lifecycle environment 2 is actually devops or not.

And most importantly: the URL there is https://content-proxy.example.com/lifecycle_environments/2/repositories?page=1&per_page=200 which can’t be right, because the UI runs on the foreman/katello main server and not on the content-proxy. Which makes me wonder, whether that listing in post 5 with the Library environment is really from our content proxy or whether it’s not really from your main server.

So basically, all your information doesn’t seem to fit together and you have unfortunately omitted crucial information which would show exactly what your client uses.

I would suggest to start over and ask you to show

# yum repolist -v
# subscription-manager repos
# subscription-manager identity

If you change labels or URLs make sure to use consistent and reasonable names instead and don’t mix up main server with content proxies…

9

Hopefully that makes more sense.

# yum repolist -v
Loading "enabled_repos_upload" plugin
Loading "fastestmirror" plugin
Loading "package_upload" plugin
Loading "product-id" plugin
Loading "search-disabled-repos" plugin
Loading "subscription-manager" plugin
Loading "tracer_upload" plugin
Updating Subscription Management repositories.
Config time: 0.743
Yum version: 3.4.3
Loading mirror speeds from cached hostfile
Setting up Package Sacks
pkgsack time: 0.026
Repo-id      : XXX_DevOps_c7-codeit_c7-codeit-repo
Repo-name    : c7-codeit-repo
Repo-revision: 1659624923
Repo-updated : Thu Aug  4 14:55:23 2022
Repo-pkgs    : 435
Repo-size    : 297 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-codeit/c7-codeit-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-docker-ce_c7-docker-ce-repo
Repo-name    : c7-docker-ce-repo
Repo-revision: 1660020017
Repo-updated : Tue Aug  9 04:40:16 2022
Repo-pkgs    : 164
Repo-size    : 3.7 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-docker-ce/c7-docker-ce-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-elasticsearch_c7-elasticsearch-curator-repo
Repo-name    : c7-elasticsearch-curator-repo
Repo-revision: 1659624700
Repo-updated : Thu Aug  4 14:51:40 2022
Repo-pkgs    : 27
Repo-size    : 391 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-curator-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-elasticsearch_c7-elasticsearch-repo
Repo-name    : c7-elasticsearch-repo
Repo-revision: 1659625369
Repo-updated : Thu Aug  4 15:02:43 2022
Repo-pkgs    : 1,010
Repo-size    : 79 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-excluded: 366
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-epel_c7-epel-repo
Repo-name    : c7-epel-repo
Repo-revision: 1660278501
Repo-updated : Fri Aug 12 04:28:18 2022
Repo-pkgs    : 16,586
Repo-size    : 27 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-epel/c7-epel-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-foreman-katello-client-3_3_c7-foreman-katello-client-3_3-repo
Repo-name    : c7-foreman-katello-client-3_3-repo
Repo-revision: 1659624660
Repo-updated : Thu Aug  4 14:51:00 2022
Repo-pkgs    : 14
Repo-size    : 14 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-foreman-katello-client-3_3/c7-foreman-katello-client-3_3-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-google-chrome_c7-google-chrome-repo
Repo-name    : c7-google-chrome-repo
Repo-revision: 1660198222
Repo-updated : Thu Aug 11 06:10:22 2022
Repo-pkgs    : 3
Repo-size    : 264 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-google-chrome/c7-google-chrome-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-grafana_c7-grafana-repo
Repo-name    : c7-grafana-repo
Repo-revision: 1660194963
Repo-updated : Thu Aug 11 05:16:02 2022
Repo-pkgs    : 207
Repo-size    : 11 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-grafana/c7-grafana-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-excluded: 338
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-hashicorp_c7-hashicorp-repo
Repo-name    : c7-hashicorp-repo
Repo-revision: 1660281668
Repo-updated : Fri Aug 12 05:21:08 2022
Repo-pkgs    : 830
Repo-size    : 29 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-hashicorp/c7-hashicorp-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-jenkins-lts_c7-jenkins-lts-repo
Repo-name    : c7-jenkins-lts-repo
Repo-revision: 1660192541
Repo-updated : Thu Aug 11 04:35:41 2022
Repo-pkgs    : 136
Repo-size    : 8.4 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-jenkins-lts/c7-jenkins-lts-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-mariadb_c7-mariadb-10_5-repo
Repo-name    : c7-mariadb-10_5-repo
Repo-revision: 1659624902
Repo-updated : Thu Aug  4 14:55:02 2022
Repo-pkgs    : 96
Repo-size    : 1.7 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-mariadb/c7-mariadb-10_5-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-excluded: 3
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-mongodb-5_0_c7-mongodb-5_0-repo
Repo-name    : c7-mongodb-5_0-repo
Repo-revision: 1659625408
Repo-updated : Thu Aug  4 15:03:28 2022
Repo-pkgs    : 155
Repo-size    : 2.9 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-mongodb-5_0/c7-mongodb-5_0-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-nodesource_c7-nodesource-14-repo
Repo-name    : c7-nodesource-14-repo
Repo-revision: 1659624616
Repo-updated : Thu Aug  4 14:50:16 2022
Repo-pkgs    : 121
Repo-size    : 1.5 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-nodesource/c7-nodesource-14-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-qpid-copr_c7-qpid-copr-repo
Repo-name    : c7-qpid-copr-repo
Repo-revision: 1659624906
Repo-updated : Thu Aug  4 14:55:05 2022
Repo-pkgs    : 14
Repo-size    : 5.7 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-qpid-copr/c7-qpid-copr-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-excluded: 2
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-rabbitmq-erlang_c7-rabbitmq-erlang-repo
Repo-name    : c7-rabbitmq-erlang-repo
Repo-revision: 1659624872
Repo-updated : Thu Aug  4 14:54:32 2022
Repo-pkgs    : 47
Repo-size    : 871 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-rabbitmq-erlang/c7-rabbitmq-erlang-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-rabbitmq-server_c7-rabbitmq-server-repo
Repo-name    : c7-rabbitmq-server-repo
Repo-revision: 1659625385
Repo-updated : Thu Aug  4 15:03:05 2022
Repo-pkgs    : 98
Repo-size    : 1.1 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-rabbitmq-server/c7-rabbitmq-server-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-remi_c7-remi-repo
Repo-name    : c7-remi-repo
Repo-revision: 1660278708
Repo-updated : Fri Aug 12 04:31:47 2022
Repo-pkgs    : 7,631
Repo-size    : 1.5 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-remi/c7-remi-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-salt-py3_c7-salt-py3-repo
Repo-name    : c7-salt-py3-repo
Repo-revision: 1659625373
Repo-updated : Thu Aug  4 15:02:53 2022
Repo-pkgs    : 79
Repo-size    : 42 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-salt-py3/c7-salt-py3-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-excluded: 19
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-scl_c7-scl-repo
Repo-name    : c7-scl-repo
Repo-revision: 1659625416
Repo-updated : Thu Aug  4 15:03:33 2022
Repo-pkgs    : 8,024
Repo-size    : 8.5 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-scl/c7-scl-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-tickstack_c7-tickstack-repo
Repo-name    : c7-tickstack-repo
Repo-revision: 1659624898
Repo-updated : Thu Aug  4 14:54:58 2022
Repo-pkgs    : 270
Repo-size    : 6.2 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-tickstack/c7-tickstack-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:36 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-wandisco_c7-wandisco-repo
Repo-name    : c7-wandisco-repo
Repo-revision: 1659625082
Repo-updated : Thu Aug  4 14:58:02 2022
Repo-pkgs    : 390
Repo-size    : 1.0 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-wandisco/c7-wandisco-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:37 2022)
  Filter     : read-only:present
Repo-excluded: 33
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-yarn-v1_c7-yarn-v1-repo
Repo-name    : c7-yarn-v1-repo
Repo-revision: 1659625378
Repo-updated : Thu Aug  4 15:02:58 2022
Repo-pkgs    : 56
Repo-size    : 89 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-yarn-v1/c7-yarn-v1-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:37 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7-zabbix-lts_c7-zabbix-4_0-lts-repo
Repo-name    : c7-zabbix-4_0-lts-repo
Repo-revision: 1659624691
Repo-updated : Thu Aug  4 14:51:30 2022
Repo-pkgs    : 614
Repo-size    : 525 M
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-zabbix-lts/c7-zabbix-4_0-lts-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:37 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

Repo-id      : XXX_DevOps_c7_c7-updates-repo
Repo-name    : c7-updates-repo
Repo-revision: 1660298104
Repo-updated : Fri Aug 12 09:55:02 2022
Repo-pkgs    : 4,101
Repo-size    : 27 G
Repo-baseurl : https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7/c7-updates-repo/
Repo-expire  : 1 second(s) (last: Fri Aug 12 16:02:37 2022)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/redhat.repo

repolist: 41,108
Uploading Enabled Repositories Report
Loaded plugins: fastestmirror, product-id, subscription-manager

# subscription-manager identity
system identity: 9dd2f85a-0d2d-42ef-baaa-bbf08eba1a18
name: dev01.devops.xxx
org name: XXX DevOps
org ID: XXX_DevOps
environment name: devops/c7-devops-view

# subscription-manager repos
+----------------------------------------------------------+
    Available Repositories in /etc/yum.repos.d/redhat.repo
+----------------------------------------------------------+
Repo ID:   XXX_DevOps_c7-google-chrome_c7-google-chrome-repo
Repo Name: c7-google-chrome-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-google-chrome/c7-google-chrome-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-codeit_c7-codeit-repo
Repo Name: c7-codeit-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-codeit/c7-codeit-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-rabbitmq-server_c7-rabbitmq-server-repo
Repo Name: c7-rabbitmq-server-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-rabbitmq-server/c7-rabbitmq-server-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-scl_c7-scl-repo
Repo Name: c7-scl-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-scl/c7-scl-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-zabbix-lts_c7-zabbix-4_0-lts-repo
Repo Name: c7-zabbix-4_0-lts-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-zabbix-lts/c7-zabbix-4_0-lts-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-hashicorp_c7-hashicorp-repo
Repo Name: c7-hashicorp-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-hashicorp/c7-hashicorp-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-mongodb-5_0_c7-mongodb-5_0-repo
Repo Name: c7-mongodb-5_0-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-mongodb-5_0/c7-mongodb-5_0-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-yarn-v1_c7-yarn-v1-repo
Repo Name: c7-yarn-v1-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-yarn-v1/c7-yarn-v1-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-remi_c7-remi-repo
Repo Name: c7-remi-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-remi/c7-remi-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-nodesource_c7-nodesource-14-repo
Repo Name: c7-nodesource-14-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-nodesource/c7-nodesource-14-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-foreman-katello-client-3_3_c7-foreman-katello-client-3_3-repo
Repo Name: c7-foreman-katello-client-3_3-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-foreman-katello-client-3_3/c7-foreman-katello-client-3_3-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-salt-py3_c7-salt-py3-repo
Repo Name: c7-salt-py3-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-salt-py3/c7-salt-py3-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-jenkins-lts_c7-jenkins-lts-repo
Repo Name: c7-jenkins-lts-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-jenkins-lts/c7-jenkins-lts-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-mariadb_c7-mariadb-10_5-repo
Repo Name: c7-mariadb-10_5-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-mariadb/c7-mariadb-10_5-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-elasticsearch_c7-elasticsearch-repo
Repo Name: c7-elasticsearch-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-epel_c7-epel-repo
Repo Name: c7-epel-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-epel/c7-epel-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-docker-ce_c7-docker-ce-repo
Repo Name: c7-docker-ce-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-docker-ce/c7-docker-ce-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-wandisco_c7-wandisco-repo
Repo Name: c7-wandisco-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-wandisco/c7-wandisco-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-elasticsearch_c7-elasticsearch-curator-repo
Repo Name: c7-elasticsearch-curator-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-curator-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7_c7-updates-repo
Repo Name: c7-updates-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7/c7-updates-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-grafana_c7-grafana-repo
Repo Name: c7-grafana-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-grafana/c7-grafana-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-rabbitmq-erlang_c7-rabbitmq-erlang-repo
Repo Name: c7-rabbitmq-erlang-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-rabbitmq-erlang/c7-rabbitmq-erlang-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-qpid-copr_c7-qpid-copr-repo
Repo Name: c7-qpid-copr-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-qpid-copr/c7-qpid-copr-repo
Enabled:   1

Repo ID:   XXX_DevOps_c7-tickstack_c7-tickstack-repo
Repo Name: c7-tickstack-repo
Repo URL:  https://foremankatello01.devops.xxx/pulp/content/XXX_DevOps/devops/c7-devops-view/custom/c7-tickstack/c7-tickstack-repo
Enabled:   1

For now I’m looking at a VM which takes its content from the main Foreman/Katello server which is also in itself a content proxy.
Let’s put aside the 4x Smart Proxies in other locations.
To keep it simpler (if it can be…)

10

O.K. That looks good. The client is connected to foremankatello01.devops on lifecycle environment devops and content view c7-devops-view.

I haven’t checked the complete list but you wrote before that c7-extras-repo and c7-base-repo are missing.

You can check the pulp content if the repositories are there at all. Open https://foremankatello01.devops.xxx/pulp/content/ and look for

XXX_DevOps/devops/c7-devops-view/custom/c7/c7-base-repo/

and

XXX_DevOps/devops/c7-devops-view/custom/c7/c7-extras-repo/

If they are both in the latest published and promoted version of the content view they should be there.

Also verify they are in the latest version through the ui, i.e. go to https://foremankatello01.devops.xxx/content_views. Click on the content view c7-devops-view to see the versions of the content view as well as the assignments of versions to environments. Click on the version number of the version which is in environment devops and click on Repositories to see a list of repositories which are included in the content view version.

This should be the same list of repositories as you have seen before through pulp, i.e. all listed repositories starting with XXX_DevOps/devops/c7-devops-view/custom/.

So check the list from the pulp/content for the missing repos as well as the content view version’s repositories if they both in include base and extras repos.

According to repolist and subscription-manager repos they should be missing from both.

11

Thanks @gvde for taking the time to help. Much appreciated.

https://foremankatello01.devops.xxx/pulp/content/

XXX_DevOps/devops/c7-devops-view/custom/c7-codeit/c7-codeit-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-docker-ce/c7-docker-ce-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-curator-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-elasticsearch/c7-elasticsearch-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-epel/c7-epel-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-foreman-katello-client-3_3/c7-foreman-katello-client-3_3-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-google-chrome/c7-google-chrome-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-grafana/c7-grafana-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-hashicorp/c7-hashicorp-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-jenkins-lts/c7-jenkins-lts-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-mariadb/c7-mariadb-10_5-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-mongodb-5_0/c7-mongodb-5_0-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-nodesource/c7-nodesource-14-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-qpid-copr/c7-qpid-copr-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-rabbitmq-erlang/c7-rabbitmq-erlang-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-rabbitmq-server/c7-rabbitmq-server-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-remi/c7-remi-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-salt-py3/c7-salt-py3-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-scl/c7-scl-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-tickstack/c7-tickstack-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-wandisco/c7-wandisco-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-yarn-v1/c7-yarn-v1-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7-zabbix-lts/c7-zabbix-4_0-lts-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7/c7-base-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7/c7-extras-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7/c7-updates-repo/
...
and many more for other content views

For c7-devops-view
https://iomforemankatello01.devops.csr.pstars/content_views/2#/repositories
26 repos added incl. c7-base-repo, c7-extras-repo and c7-updates-repo

c7-devops-view
Version 42.0 with Environmnents: Library, devops

c2-base-repo & c7-extras-repo are not missing from anywhere…
The checks you describe I’ve done them many times over… :frowning:
Yet yum repolist & subscription-manager repos are missing them…

My installation of Foreman/Katello + Smart Proxies was done in April 2021 and has gone through multiple upgrades (I tend to keep up to date with latest). Never seen this problem before - It’s baffling…

The only think I’ve done recently (post upgrade to Foreman 3.3.0 / Katello 4.5.0) for the CentOS 7 product and the 3 repos in it is to change the Upstream URL.

I’m now using

https://www.mirrorservice.org/sites/mirror.centos.org/

for all 3 repos.
Before I was using:

https://mirror.bytemark.co.uk/centos/

Could that have disrupted something??

12

O.K. That looks all correct. All I can suggest is to check the URLs on the server

XXX_DevOps/devops/c7-devops-view/custom/c7/c7-base-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7/c7-updates-repo/

to see if the repository is O.K. You could as a test put those URLs into a test repo file to see if the repository metadata etc. is good and working.

Otherwise, everything is as it should be and the repositories should show up on the client. Could be a bug then but that would be something for the devs. I wouldn’t even be sure if that could be a katello, pulp or candlepin issue here…

13

Creating repo files for

XXX_DevOps/devops/c7-devops-view/custom/c7/c7-base-repo/
XXX_DevOps/devops/c7-devops-view/custom/c7/c7-updates-repo/

works so why they don’t end up in redhat.repo as they should is still a mystery…

14

That could be a bug with candlepin. Maybe the @katello developers can help…

15

Checking the entitlement for my product c7:

# rct cat-cert /etc/pki/entitlement/1223977598242046956.pem | grep Label
	Label: XXX_DevOps_c7_c7-updates-repo

As per this post The /etc/yum.repos.d/redhat.repo is missed on CentOS 7 after registering on Foreman server - #3 by rakis I was expecting to see

Label: XXX_DevOps_c7_c7-base-repo
Label: XXX_DevOps_c7_c7-extras-repo

in there as well.

16

I also have reverted to sync’ing from

https://mirror.bytemark.co.uk/centos/

And changed the Mirroring Policy to “Complete Mirroring” from “Content Only” for all 3x CentOS 7 repos but same issue.

Also tried

subscription-manager refresh --force

No change…

17

Manually adding 2x sections for c7-base-repo and c7-extras-repo in the redhat.repo fixes the problem but I don’t like it…

18

Hi @fred_demarcy,

This community thread may be of help to you, particularly this comment: Most repos from content view no longer appear on hosts - #7 by wbclark

Let us know if you have any questions about what’s there.

19

I ended up with similar solution - all repos in Foreman looks OK, but redhat.repo is empty regardless of the settings (Complete Mirroring/Content Only).
I have created the Ansible role and manage all repos manually.

20

Hi @iballou

# foreman-rake console
'ErbParser' is ignored.
'RubyParser' is ignored.
Loading production environment (Rails 6.0.4.7)
irb(main):001:0> product = Katello::Product.find_by_name('c7')
=> #<Katello::Product id: 9, name: "c7", description: "CentOS 7 product", cp_id: "577537497763", multiplier: nil, provider_id: 1, created_at: "2021-05-05 15:55:34", updated_at: "2021-05-05 15:55:34", gpg_key_id: 7, sync_plan_...

Ok so Product ID = 9

irb(main):002:0> root = Katello::RootRepository.find(9)
Traceback (most recent call last):
        2: from lib/tasks/console.rake:5:in `block in <top (required)>'
        1: from (irb):2
ActiveRecord::RecordNotFound (Couldn't find Katello::RootRepository with 'id'=9)