Client cannot see all repo by "yum repolist" although client subscribed content view have them

[andyhycheung]

Problem:
Client cannot see all repo by “yum repolist” although client subscribed content view have them

Client output:
Subscirbed Contentview: cv_all
Environment: Library

[root@hk3cvdv00487 ~]# yum repolist
Loaded plugins: enabled_repos_upload, package_upload, product-id, search-disabled-repos, subscription-manager,
               : tracer_upload
repo id repo name status
!p_epel_7_repo_epel_7_rpms repo_epel_7_rpms 12,843
!p_katello_3_8_repo_katello_3_8_client repo_katello_3_8_client 26
!p_rhel_7_repo_rhel_7_server_extras_rpms repo_rhel_7_server_extras_rpms 1,014
repolist: 13,883
Uploading Enabled Repositories Report
Loaded plugins: product-id, subscription-manager
Loaded plugins: product-id, subscription-manager
Loaded plugins: product-id, subsBcription-manager
 
[root@hk3cvdv00487 ~]# subscription-manager identity
system identity: f20ea903-b32b-452c-92ae-3f086aaa2faa
name: hk3cvdv00487
org name: org
org ID: org
environment name: Library/cv_all

On server side:

From the info above, those 2 repositories highlighted in yellow are missing. Those 2 repositories cant be present to all clients in any content views. Not sure if it belongs to which process issue.

Expected outcome:
All repositories in content view can be present to subscribed clients

Foreman and Proxy versions:
Foreman and Proxy plugin versions:
Foreman Version 1.19.1
Bastion Version 6.1.11
Foreman-tasks 0.13.4
Foreman_docker 4.1.0
Foreman_remote_execution 1.5.6
Katello 3.8.1
Master/Proxy OS version: rhel 7.6
Client Host OS version: rhel 7.6

Other relevant data:
/var/log/rhsm/rhsm.log from client side when pressing yum repolist:

[root@hk3cvdv00487 rhsm]# tail -f  rhsm.log
2018-12-04 17:40:46,307 [WARNING] yum:13229:Dummy-1 @logutil.py:141 - logging already initialized
2018-12-04 17:40:46,309 [INFO] yum:13229:Dummy-1 @connection.py:871 - Connection built: host=hk3cvdv00483 port=443 handler=/rhsm auth=identity_cert ca_dir=/etc/rhsm/ca/ insecure=False
2018-12-04 17:40:46,309 [INFO] yum:13229:Dummy-1 @connection.py:871 - Connection built: host=hk3cvdv00483 port=443 handler=/rhsm auth=identity_cert ca_dir=/etc/rhsm/ca/ insecure=False
2018-12-04 17:40:46,393 [INFO] yum:13229:Dummy-1 @connection.py:588 - Response: status=200, request="GET /rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/certificates/serials"
2018-12-04 17:40:46,393 [INFO] yum:13229:Dummy-1 @entcertlib.py:131 - certs updated:
Total updates: 0
Found (local) serial# [45113519903603474L, 1411344925668220104L, 3668462751145143202L]
Expected (UEP) serial# [45113519903603474, 1411344925668220104, 3668462751145143202]
Added (new)
  <NONE>
Deleted (rogue):
  <NONE>
2018-12-04 17:40:46,433 [INFO] yum:13229:Dummy-1 @connection.py:588 - Response: status=200, request="GET /rhsm/status"
2018-12-04 17:40:46,471 [INFO] yum:13229:Dummy-1 @connection.py:588 - Response: status=200, request="GET /rhsm/"
2018-12-04 17:40:46,520 [INFO] yum:13229:Dummy-1 @connection.py:588 - Response: status=200, request="GET /rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/content_overrides"
2018-12-04 17:40:46,533 [INFO] yum:13229:Dummy-1 @repolib.py:494 - repos updated: Repo updates

Total repo updates: 3
Updated
    [id:p_rhel_7_repo_rhel_7_server_extras_rpms repo_rhel_7_server_extras_rpms]
    [id:p_epel_7_repo_epel_7_rpms repo_epel_7_rpms]
    [id:p_katello_3_8_repo_katello_3_8_client repo_katello_3_8_client]
Added (new)
    <NONE>
Deleted
    <NONE>

/var/log/foreman/production.log from server when pressing yum repolist:

2018-12-04T17:44:20 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/certificates/serials" for 10.222.182.253 at 2018-12-04 17:44:20 +0800
2018-12-04T17:44:20 [I|app|fa165] Processing by Katello::Api::Rhsm::CandlepinProxiesController#serials as JSON
2018-12-04T17:44:20 [I|app|fa165]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:20 [I|app|fa165] Completed 200 OK in 60ms (Views: 0.2ms | ActiveRecord: 4.0ms)
2018-12-04T17:44:20 [I|app|] Started GET "/rhsm/status" for 10.222.182.253 at 2018-12-04 17:44:20 +0800
2018-12-04T17:44:20 [I|app|89bb3] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2018-12-04T17:44:20 [I|app|89bb3] Completed 200 OK in 15ms (Views: 0.3ms | ActiveRecord: 1.3ms)
2018-12-04T17:44:20 [I|app|] Started GET "/rhsm/" for 10.222.182.253 at 2018-12-04 17:44:20 +0800
2018-12-04T17:44:20 [I|app|d5f77] Processing by Katello::Api::V2::RootController#rhsm_resource_list as JSON
2018-12-04T17:44:20 [I|app|d5f77]   Parameters: {"root"=>{}}
2018-12-04T17:44:20 [I|app|d5f77]   Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection
2018-12-04T17:44:20 [I|app|d5f77]   Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection (1.4ms)
2018-12-04T17:44:20 [I|app|d5f77] Completed 200 OK in 13ms (Views: 2.1ms | ActiveRecord: 1.4ms)
2018-12-04T17:44:20 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/content_overrides" for 10.222.182.253 at 2018-12-04 17:44:20 +0800
2018-12-04T17:44:20 [I|app|94905] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2018-12-04T17:44:20 [I|app|94905]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:20 [I|app|94905] Current user set to f20ea903-b32b-452c-92ae-3f086aaa2faa (regular)
2018-12-04T17:44:20 [I|app|94905] Completed 200 OK in 20ms (Views: 0.1ms | ActiveRecord: 1.7ms)
2018-12-04T17:44:20 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/certificates/serials" for 10.222.182.253 at 2018-12-04 17:44:20 +0800
2018-12-04T17:44:20 [I|app|dc542] Processing by Katello::Api::Rhsm::CandlepinProxiesController#serials as JSON
2018-12-04T17:44:20 [I|app|dc542]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:20 [I|app|dc542] Completed 200 OK in 46ms (Views: 0.2ms | ActiveRecord: 3.3ms)
2018-12-04T17:44:20 [I|app|] Started GET "/rhsm/status" for 10.222.182.253 at 2018-12-04 17:44:20 +0800
2018-12-04T17:44:20 [I|app|ce3fc] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2018-12-04T17:44:20 [I|app|ce3fc] Completed 200 OK in 14ms (Views: 0.3ms | ActiveRecord: 1.4ms)
2018-12-04T17:44:20 [I|app|] Started GET "/rhsm/" for 10.222.182.253 at 2018-12-04 17:44:20 +0800
2018-12-04T17:44:20 [I|app|bc6f5] Processing by Katello::Api::V2::RootController#rhsm_resource_list as JSON
2018-12-04T17:44:20 [I|app|bc6f5]   Parameters: {"root"=>{}}
2018-12-04T17:44:20 [I|app|bc6f5]   Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection
2018-12-04T17:44:20 [I|app|bc6f5]   Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection (1.3ms)
2018-12-04T17:44:20 [I|app|bc6f5] Completed 200 OK in 12ms (Views: 2.0ms | ActiveRecord: 1.4ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/content_overrides" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|a5856] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2018-12-04T17:44:21 [I|app|a5856]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:21 [I|app|a5856] Current user set to f20ea903-b32b-452c-92ae-3f086aaa2faa (regular)
2018-12-04T17:44:21 [I|app|a5856] Completed 200 OK in 23ms (Views: 0.1ms | ActiveRecord: 1.9ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/certificates/serials" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|1a230] Processing by Katello::Api::Rhsm::CandlepinProxiesController#serials as JSON
2018-12-04T17:44:21 [I|app|1a230]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:21 [I|app|1a230] Completed 200 OK in 60ms (Views: 0.2ms | ActiveRecord: 4.5ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/status" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|4d78f] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2018-12-04T17:44:21 [I|app|4d78f] Completed 200 OK in 16ms (Views: 0.3ms | ActiveRecord: 2.0ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|2e455] Processing by Katello::Api::V2::RootController#rhsm_resource_list as JSON
2018-12-04T17:44:21 [I|app|2e455]   Parameters: {"root"=>{}}
2018-12-04T17:44:21 [I|app|2e455]   Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection
2018-12-04T17:44:21 [I|app|2e455]   Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection (1.3ms)
2018-12-04T17:44:21 [I|app|2e455] Completed 200 OK in 12ms (Views: 2.0ms | ActiveRecord: 1.3ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/content_overrides" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|6d2c9] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2018-12-04T17:44:21 [I|app|6d2c9]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:21 [I|app|6d2c9] Current user set to f20ea903-b32b-452c-92ae-3f086aaa2faa (regular)
2018-12-04T17:44:21 [I|app|6d2c9] Completed 200 OK in 21ms (Views: 0.1ms | ActiveRecord: 1.7ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/certificates/serials" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|49457] Processing by Katello::Api::Rhsm::CandlepinProxiesController#serials as JSON
2018-12-04T17:44:21 [I|app|49457]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:21 [I|app|49457] Completed 200 OK in 48ms (Views: 0.2ms | ActiveRecord: 3.3ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/status" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|72baf] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2018-12-04T17:44:21 [I|app|72baf] Completed 200 OK in 15ms (Views: 0.3ms | ActiveRecord: 1.3ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|c6d78] Processing by Katello::Api::V2::RootController#rhsm_resource_list as JSON
2018-12-04T17:44:21 [I|app|c6d78]   Parameters: {"root"=>{}}
2018-12-04T17:44:21 [I|app|c6d78]   Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection
2018-12-04T17:44:21 [I|app|c6d78]   Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.8.1/app/views/katello/api/v2/root/resource_list.json.rabl within katello/api/v2/layouts/collection (1.4ms)
2018-12-04T17:44:21 [I|app|c6d78] Completed 200 OK in 12ms (Views: 2.1ms | ActiveRecord: 1.3ms)
2018-12-04T17:44:21 [I|app|] Started GET "/rhsm/consumers/f20ea903-b32b-452c-92ae-3f086aaa2faa/content_overrides" for 10.222.182.253 at 2018-12-04 17:44:21 +0800
2018-12-04T17:44:21 [I|app|716ac] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2018-12-04T17:44:21 [I|app|716ac]   Parameters: {"id"=>"f20ea903-b32b-452c-92ae-3f086aaa2faa"}
2018-12-04T17:44:21 [I|app|716ac] Current user set to f20ea903-b32b-452c-92ae-3f086aaa2faa (regular)
2018-12-04T17:44:21 [I|app|716ac] Completed 200 OK in 22ms (Views: 0.1ms | ActiveRecord: 1.8ms)

[James_Shewey]

What is the entitlement status of hk3cvdv00487? Is it showing enetitled?

Also, try:

• Run auto-attach
• subscription-manager refresh
• yum clean all
• yum repolist

I’ve typically found that sequence necessary when making these types of changes.

[andyhycheung]

Thanks. I have tried, even un-register and re-register it but still no luck.
Thew wiriest thing I hit is only 1 repo (repo_rhel_7_server_extras_rpms) of same product is accessible but the other 2 repos (repo_rhel_7_server_optional_rpms and repo_rhel_7_server_rpms) of that product are inaccessible via content view.

[akolomitz]

Was this ever resolved? I am facing this exact same issue but I have no idea why. I have a product for Influx Data with 2 repositories for EL 6 and EL 7. However when I subscription-manager refresh on my client hosts, the EL 7 repo gets deleted. It shows up in /var/log/rhsm/rhsm.log as being deleted too and then the number of repos assigned to the server decreases by one.

Deleted
[InfluxDB_InfluxDB_Stable_EL7_X86_64]
2019-09-17 12:01:34,863 [INFO] subscription-manager:53242:MainThread @managercli.py:638 - Refreshed local data

I have confirmed that the server is still subscribed to the product with subscription-manager list --consumed:

Subscription Name: InfluxDB
Provides: InfluxDB
SKU: 15131974172122180121402
Contract:
Account:
Serial: 6593461678746576803
Pool ID: 8a21b4d160464710016051983728395c
Provides Management: No
Active: True
Quantity Used: 1
Service Level:
Service Type:
Status Details: Subscription is current
Subscription Type: Standard
Starts: 12/13/2017
Ends: 12/06/2047
System Type: Physical

However now when I do subscription-manager repos --list, I only have the EL6 repo available instead of both EL6 and EL7:

subscription-manager repos --list | grep Influx
Repo ID: InfluxDB_InfluxDB_Stable_EL6_X86_64
Repo Name: InfluxDB Stable EL6 X86_64
Repo URL: https://capsuleurl/pulp/repos/Default_Organization/environment/CentOS_7_Composite/custom/InfluxDB/InfluxDB_Stable_EL6_X86_64

[sajha]

@akolomitz, from the URL looks like the host is registered to a smart proxy? Also, is the capsule added to the environment that the repo/content-view is in?

[akolomitz]

Yes, this host is registered to a smart proxy, and yes, the repo/CV share the same environments as the smart proxy.

[sajha]

@akolomitz: When the host registered, it had access to both repos but a sub-man refresh removed the repo. If you registered through an activation key, could you check if any content overrides exist on the key?

[akolomitz]

That is why this is so frustrating @sajha. I verified that the activation key has the correct product subscriptions. Also, I am looking at one of the content hosts that should have the repo. It is properly subscribed to the Influx product and it has the EL7 repo overridden to enabled and the EL6 repo overridden to disabled, as this is a Cent 7 host. However, when I do a subscription-manager repos --list | grep Influx, I only get the EL6 repo, which is disabled.

[sajha]

Could you check to see if the content view with the repos has any filters which might be excluding the repo from the CV? Also check if the CV is attached to the activation key used to register the host.

[pjayKHV]

Good day… Did you have any luck fixing this issue? I am facing something very similar…

[Julie]

Same for me, with my Production Foreman (1.23.1) and POC Foreman (1.24.0).
My old repositories (publish before upgrade 1.22 -> 1.23) seems worked but not on new repos (publish since 1.23).

[Julie]

I tried with clients directly attached to CV and not CCV way, but same result … nothing happend

[pjayKHV]

CentOS host cannot subscribe to repositories

Problem: Our organization wants to use Katello for Patch & Configuration Management of its CentOS 7 VMs (Hyper-V). After installing Katello (on a fresh CentOS 7.7.1908), we try to add an host (also a fresh CentOS 7.7.1908) to be managed. Registering goes well: [root@sobsl03 consumer]# subscription-manager register --org="Default_Organization" --activationkey="Non Production" The system has been registered with ID: 435d1f2d-b671-4788-a797-04ba61db171a The registered system name is: sobsl03.euro…

https://bugzilla.redhat.com/show_bug.cgi?id=1789654#c4

Fixes #28714 - Limit the certificate end date to late 2049

Custom products created after 01 January 2020 cannot be attached to client on...

This solved my issue…))

[Julie]

THX GUY !!!

I love u sooooooooo much