Problem:
Appologies for very long post but there’s no short way to describe the very odd issue I’m experiencing.
I’m having problem with subscribing 3 specific physical servers (will stick to only 2 of them for the sake of easier / shorter reproduction of the issue). It’s a clean, recently set up environment, and all other 100 server subscriptions work nicely. But when I try to subscribe these 2 specific servers – subscribing one of them to the environment generates no problems at first, but as soon I go on trying to subscribe the second one I’ll get the error message:
"HTTP error (404 - Not Found): Consumer with id #######-####-####-####-###### could not be found."
What I was able to observe is following:
- register node1 = no problems
- register node2 = error above appears. Node won’t get subscription.
- node2 does, however, appear on Content Hosts list with ‘unknown subscription status’.
- node2 row in Content Hosts list shows “Registered: July 20, 2022 at 11:15 AM”, while it actually was registered July 20, 2022 at 05:44 PM. This will always be the case for failed subscription for the node - it will show “date of registration at 11:15 AM”. (please note - ntp is properly setup on all involved components).
- deleting / re-registering node 2 = the problem repeats itself
- node1 is still subscribed at this point but when typing ‘subscription-manager identity’ the hostname presented in the output shows node2 !!!
Additionally:
- deleting both nodes from the system, and then trying registering node2 first will work!
- but then all I described above will affect node1 instead when trying to register it
I have even tried to:
- register node1 – no problems
- register multiple random nodes after that – no problems
- then try with node2 – I get the same problem as before
So, basically, when it comes to these specific two nodes, just like a quote from an old cult movie said: “There can be only one!”
I decided to remove these two from the main server, reinstall OS (Centos7) on them, and set up identical, clean, alternative Foreman environment. The same problem appeared at once. All registration steps / outputs / logs during reproduction of the problem is attached in ‘Other relevant data’ - section.
It should be also stated that these nodes even “misbehaved” earlier on an older Foreman (1.20.1) / Katello (3.10.0) platform. But there they could at least “coexist”. Sporadically one would be getting “This system is not yet registered” – error when trying to do yum updates, but re-registration would solve it for a while until it reappeared. But on the much never and clean platform the problem is worse as described earlier which makes me believe something could be wrong with these specific servers, hardware, even though it doesn’t make much sense.
Expected outcome:
Ability to normally register even affected nodes.
Foreman and Proxy plugin versions:
Foreman 3.1.3
Katello 4.3.1
Distribution and version:
Rocky Linux 8.6
Other relevant data:
Reproducing the issue with two affected nodes. fresh install of Centos7 and registering them to a new fresh Foreman.
- Registering host1
[root@host1 ]# subscription-manager register --organization='MYORG' --activationkey='server-prod-7'
[root@host1 ]# subscription-manager identity
system identity: 07877e68-0704-4768-b218-40a0dff608dd
name: host1.domain.xx
org name: MYORG
org ID: MYORG
environment name: Production/server-centos7
- After registering host1 one can see in local database that the host is present
foreman=# select * from hosts where name = 'host1.domain.xx';
-[ RECORD 1 ]--------+---------------------------------
id | 2
name | host1.domain.xx
last_compile | 2022-07-20 15:34:21
last_report |
updated_at | 2022-07-20 15:34:31.26925
created_at | 2022-07-20 15:34:17.546021
root_pass |
architecture_id | 1
operatingsystem_id | 2
ptable_id |
medium_id |
build | f
comment |
disk |
installed_at |
model_id | 2
hostgroup_id |
owner_id | 1
owner_type | User
enabled | t
puppet_ca_proxy_id |
managed | f
use_image |
image_file |
uuid |
compute_resource_id |
puppet_proxy_id |
certname |
image_id |
organization_id | 1
location_id | 2
type | Host::Managed
otp |
realm_id |
compute_profile_id |
provision_method |
grub_pass |
global_status | 0
lookup_value_matcher | fqdn=host1.domain.xx
pxe_loader |
initiated_at |
build_errors |
- As it is in cp_consumer candlepin database table
candlepin=# select * from cp_consumer where name='host1.domain.xx';
-[ RECORD 1 ]-------------+-----------------------------------------------------------------
id | 8a999f96821c38e901821c3edfac0023
created | 2022-07-20 15:34:18.796+00
updated | 2022-07-20 15:34:29.858+00
autoheal | t
entitlementstatus | valid
name | host1.domain.xx
servicelevel |
username | foreman_admin
uuid | 07877e68-0704-4768-b218-40a0dff608dd
environment_id | b41aebad5500746c046bbdcc6f582d16
consumer_idcert_id | 8a999f96821c38e901821c3ee5310027
keypair_id | 8a999f96821c38e901821c3ee4bb0026
owner_id | 8a999f96821ae33d01821aeadb820001
type_id | 1000
releasever |
compliancestatushash | 191e9b00fd4c1f5a5f12457c18b81fbe7c0b24ce2892a6e80722aa67a572c3dd
annotations |
lastcheckin |
cont_acc_cert_id |
content_access_mode |
entitlement_count | 5
sp_role |
sp_usage |
sp_status | not specified
sp_status_hash |
rh_cloud_profile_modified | 2022-07-20 15:34:21.08+00
sp_service_type |
- Going on with with registration of host 2 vill result in failure.
[root@host2 ]# subscription-manager register --organization='MYORG' --activationkey='server-prod-7'
HTTP error (404 - Not Found): Consumer with id 396fb987-9848-4816-b931-2953e9a8fe48 could not be found.
[root@host2 ]# subscription-manager identity
This system is not yet registered. Try 'subscription-manager register --help' for more information.
- Going back to host1 and listing subscription details. NOTE the name change to host2.domain.xx
[root@host1 ]# subscription-manager identity
system identity: 07877e68-0704-4768-b218-40a0dff608dd
name: host2.domain.xx
org name: MYORG
org ID: MYORG
environment name: Production/server-centos7
- and, indeed, inspecting cp_consumer database one cannot found host1.domain.xx anymore
candlepin=# select * from cp_consumer where name='host1.domain.xx';
(0 rows)
- but host2.domain.xx is found in table row that is used for host1 (see id and uuid columns) !
candlepin=# select * from cp_consumer where name='host2.domain.xx';
-[ RECORD 1 ]-------------+-----------------------------------------------------------------
id | 8a999f96821c38e901821c3edfac0023
created | 2022-07-20 15:34:18.796+00
updated | 2022-07-20 15:44:53.758+00
autoheal | t
entitlementstatus | valid
name | host2.domain.xx
servicelevel |
username | foreman_admin
uuid | 07877e68-0704-4768-b218-40a0dff608dd
environment_id | b41aebad5500746c046bbdcc6f582d16
consumer_idcert_id | 8a999f96821c38e901821c488fb6002d
keypair_id | 8a999f96821c38e901821c3ee4bb0026
owner_id | 8a999f96821ae33d01821aeadb820001
type_id | 1000
releasever |
compliancestatushash | 05d4892e0de2b9696840da55ee345dd493e5ccbcc184153237da670929217d2d
annotations |
lastcheckin |
cont_acc_cert_id |
content_access_mode |
entitlement_count | 5
sp_role |
sp_usage |
sp_status | not specified
sp_status_hash |
rh_cloud_profile_modified | 2022-07-20 15:44:53.517+00
sp_service_type |
Pasting what i believe is full registration flow logs for both host1 and host2
Also, the bottom, found row in pulp logs that clearly says “Updating consumer name: host1.domain.xx → host2.domain.xx”.
2022-07-20T15:34:17 [I|app|ce6b34ee] Started POST "/rhsm/consumers?owner=MYORG&activation_keys=server-prod-7" for 10.100.23.32 at 2022-07-20 15:34:17 +0000
2022-07-20T15:34:17 [I|app|ce6b34ee] Processing by Katello::Api::Rhsm::CandlepinProxiesController#consumer_activate as JSON
2022-07-20T15:34:17 [I|app|ce6b34ee] Parameters: {"name"=>"host1.domain.xx", "contentTags"=>[], "serviceLevel"=>"", "usage"=>"", "role"=>"", "facts"=>"[FILTERED]", "addOns"=>[], "type"=>"system", "owner"=>"MYORG", "activation_keys"=>"server-prod-7"}
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on mac
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on ip
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on type Nic::Managed
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on name host1.domain.xx
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on host_id 2
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on subnet_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on domain_id 1
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on attrs {}
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on provider
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on username
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on password [redacted]
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on virtual false
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on link true
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on identifier
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on tag
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on attached_to
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on managed true
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on mode balance-rr
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on attached_devices
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on bond_options
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on primary true
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on provision true
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on compute_attributes {}
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on execution true
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on ip6
2022-07-20T15:34:17 [I|aud|ce6b34ee] Nic::Managed (2) create event on subnet6_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on name host1.domain.xx
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on root_pass
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on architecture_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on operatingsystem_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on ptable_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on medium_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on build false
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on comment
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on disk
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on installed_at
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on model_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on hostgroup_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on owner_id 1
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on owner_type User
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on enabled true
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on puppet_ca_proxy_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on managed false
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on use_image
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on image_file
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on uuid
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on compute_resource_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on puppet_proxy_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on certname
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on image_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on organization_id 1
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on location_id 2
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on otp
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on realm_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on compute_profile_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on provision_method
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on grub_pass
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on pxe_loader
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on initiated_at
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (2) create event on build_errors
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on host_id 2
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on uuid 07877e68-0704-4768-b218-40a0dff608dd
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on content_view_id 6
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on lifecycle_environment_id 3
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on kickstart_repository_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on content_source_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on installable_security_errata_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on installable_enhancement_errata_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on installable_bugfix_errata_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on applicable_rpm_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on upgradable_rpm_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on applicable_module_stream_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on upgradable_module_stream_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on applicable_deb_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on upgradable_deb_count 0
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on host_id 2
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on uuid 07877e68-0704-4768-b218-40a0dff608dd
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on service_level
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on release_version
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on autoheal false
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on registered_at 2022-07-20 09:15:35 UTC
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on registered_through
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on user_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on hypervisor false
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on hypervisor_host_id
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on purpose_usage
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on purpose_role
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on dmi_uuid Not Settable
2022-07-20T15:34:17 [I|aud|ce6b34ee] Host::Base (1) create event on pool_ids []
2022-07-20T15:34:25 [I|app|ce6b34ee] Import facts for 'host1.domain.xx' completed. Added: 213, Updated: 0, Deleted 0 facts
2022-07-20T15:34:25 [I|aud|ce6b34ee] Model (2) create event on name X10DRi
2022-07-20T15:34:25 [I|aud|ce6b34ee] Model (2) create event on info
2022-07-20T15:34:25 [I|aud|ce6b34ee] Model (2) create event on vendor_class
2022-07-20T15:34:25 [I|aud|ce6b34ee] Model (2) create event on hardware_model
2022-07-20T15:34:25 [I|aud|ce6b34ee] Nic::Managed (2) update event on mac , 3c:fd:fe:af:df:28
2022-07-20T15:34:25 [I|aud|ce6b34ee] Nic::Managed (2) update event on virtual false, true
2022-07-20T15:34:25 [I|aud|ce6b34ee] Nic::Managed (2) update event on identifier , team0.100
2022-07-20T15:34:25 [I|aud|ce6b34ee] Nic::Managed (2) update event on tag , 100
2022-07-20T15:34:25 [I|aud|ce6b34ee] Nic::Managed (2) update event on attached_to , team0
2022-07-20T15:34:25 [I|aud|ce6b34ee] Host::Base (2) update event on architecture_id , 1
2022-07-20T15:34:25 [I|aud|ce6b34ee] Host::Base (2) update event on operatingsystem_id , 2
2022-07-20T15:34:25 [I|aud|ce6b34ee] Host::Base (2) update event on model_id , 2
2022-07-20T15:34:25 [I|aud|ce6b34ee] Host::Base (1) update event on autoheal false, true
2022-07-20T15:34:25 [I|aud|ce6b34ee] Host::Base (1) update event on registered_at 2022-07-20 09:15:35 UTC, 2022-07-20 15:34:18 UTC
2022-07-20T15:34:26 [I|aud|ce6b34ee] Host::Base (1) update event on registered_through , foreman.domain.xx
2022-07-20T15:34:26 [I|app|ce6b34ee] Completed 200 OK in 9059ms (Views: 5.0ms | ActiveRecord: 3157.1ms | Allocations: 546483)
2022-07-20T15:44:52 [I|app|a31ff48d] Started POST "/rhsm/consumers?owner=MYORG&activation_keys=server-prod-7" for 10.100.23.33 at 2022-07-20 15:44:52 +0000
2022-07-20T15:44:52 [I|app|a31ff48d] Processing by Katello::Api::Rhsm::CandlepinProxiesController#consumer_activate as JSON
2022-07-20T15:44:52 [I|app|a31ff48d] Parameters: {"name"=>"host2.domain.xx", "contentTags"=>[], "serviceLevel"=>"", "usage"=>"", "role"=>"", "facts"=>"[FILTERED]", "addOns"=>[], "type"=>"system", "owner"=>"MYORG", "activation_keys"=>"server-prod-7"}
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on mac
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on ip
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on type Nic::Managed
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on name host2.domain.xx
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on host_id 3
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on subnet_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on domain_id 1
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on attrs {}
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on provider
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on username
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on password [redacted]
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on virtual false
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on link true
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on identifier
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on tag
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on attached_to
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on managed true
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on mode balance-rr
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on attached_devices
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on bond_options
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on primary true
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on provision true
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on compute_attributes {}
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on execution true
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on ip6
2022-07-20T15:44:52 [I|aud|a31ff48d] Nic::Managed (10) create event on subnet6_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on name host2.domain.xx
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on root_pass
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on architecture_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on operatingsystem_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on ptable_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on medium_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on build false
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on comment
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on disk
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on installed_at
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on model_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on hostgroup_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on owner_id 1
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on owner_type User
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on enabled true
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on puppet_ca_proxy_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on managed false
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on use_image
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on image_file
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on uuid
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on compute_resource_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on puppet_proxy_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on certname
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on image_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on organization_id 1
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on location_id 2
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on otp
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on realm_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on compute_profile_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on provision_method
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on grub_pass
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on pxe_loader
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on initiated_at
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (3) create event on build_errors
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on host_id 3
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on uuid 396fb987-9848-4816-b931-2953e9a8fe48
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on content_view_id 6
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on lifecycle_environment_id 3
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on kickstart_repository_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on content_source_id
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on installable_security_errata_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on installable_enhancement_errata_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on installable_bugfix_errata_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on applicable_rpm_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on upgradable_rpm_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on applicable_module_stream_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on upgradable_module_stream_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on applicable_deb_count 0
2022-07-20T15:44:52 [I|aud|a31ff48d] Host::Base (2) create event on upgradable_deb_count 0
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on host_id 3
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on uuid 396fb987-9848-4816-b931-2953e9a8fe48
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on service_level
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on release_version
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on autoheal false
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on registered_at 2022-07-20 09:15:35 UTC
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on registered_through
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on user_id
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on hypervisor false
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on hypervisor_host_id
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on purpose_usage
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on purpose_role
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on dmi_uuid Not Settable
2022-07-20T15:44:53 [I|aud|a31ff48d] Host::Base (2) create event on pool_ids []
2022-07-20T15:44:54 [I|app|a31ff48d] Import facts for 'host2.domain.xx' completed. Added: 213, Updated: 0, Deleted 0 facts
2022-07-20T15:44:55 [I|aud|a31ff48d] Nic::Managed (10) update event on mac , 3c:fd:fe:af:eb:50
2022-07-20T15:44:55 [I|aud|a31ff48d] Nic::Managed (10) update event on virtual false, true
2022-07-20T15:44:55 [I|aud|a31ff48d] Nic::Managed (10) update event on identifier , team0.100
2022-07-20T15:44:55 [I|aud|a31ff48d] Nic::Managed (10) update event on tag , 100
2022-07-20T15:44:55 [I|aud|a31ff48d] Nic::Managed (10) update event on attached_to , team0
2022-07-20T15:44:55 [I|aud|a31ff48d] Host::Base (3) update event on architecture_id , 1
2022-07-20T15:44:55 [I|aud|a31ff48d] Host::Base (3) update event on operatingsystem_id , 2
2022-07-20T15:44:55 [I|aud|a31ff48d] Host::Base (3) update event on model_id , 2
2022-07-20T15:44:55 [E|app|a31ff48d] RestClient::NotFound: Katello::Resources::Candlepin::Consumer: 404 Not Found {"displayMessage":"Consumer with id 396fb987-9848-4816-b931-2953e9a8fe48 could not be found.","requestUuid":"bb66280d-3f46-44c8-8176-34f74282b8bc"} (GET /candlepin/consumers/396fb987-9848-4816-b931-2953e9a8fe48)
a31ff48d | Body: {"displayMessage":"Consumer with id 396fb987-9848-4816-b931-2953e9a8fe48 could not be found.","requestUuid":"bb66280d-3f46-44c8-8176-34f74282b8bc"}
a31ff48d |
2022-07-20T15:44:55 [E|app|a31ff48d] /usr/share/gems/gems/katello-4.3.1/app/controllers/katello/api/rhsm/candlepin_proxies_controller.rb:242:in `consumer_activate'
2022-07-20T15:44:55 [I|app|a31ff48d] Rendering text template
2022-07-20T15:44:55 [I|app|a31ff48d] Rendered text template (Duration: 0.1ms | Allocations: 2)
2022-07-20T15:44:55 [I|app|a31ff48d] Completed 404 Not Found in 3320ms (Views: 1.7ms | ActiveRecord: 828.1ms | Allocations: 409094)
2022-07-20 15:44:53,334 [thread=https-jsse-nio-127.0.0.1-23443-exec-9] [req=f98dc918-0418-4acf-ae72-2c0fef847d2c, org=, csid=a31ff48d-f623-4a52-9cf6-c65864804ec9] INFO org.candlepin.servlet.filter.logging.LoggingFilter - Request: verb=POST, uri=/candlepin/environments/b41aebad5500746c046bbdcc6f582d16/consumers/?activation_keys=c6787387-2b9d-484e-a9be-1afa578f2fb0
2022-07-20 15:44:53,516 [thread=https-jsse-nio-127.0.0.1-23443-exec-9] [req=f98dc918-0418-4acf-ae72-2c0fef847d2c, org=, csid=a31ff48d-f623-4a52-9cf6-c65864804ec9] INFO org.candlepin.resource.ConsumerResource - Updating facts.
2022-07-20 15:44:53,518 [thread=https-jsse-nio-127.0.0.1-23443-exec-9] [req=f98dc918-0418-4acf-ae72-2c0fef847d2c, org=, csid=a31ff48d-f623-4a52-9cf6-c65864804ec9] INFO org.candlepin.resource.ConsumerResource - Updating consumer name: host1.domain.xx -> host2.domain.xx
2022-07-20 15:44:53,798 [thread=https-jsse-nio-127.0.0.1-23443-exec-9] [req=f98dc918-0418-4acf-ae72-2c0fef847d2c, org=, csid=a31ff48d-f623-4a52-9cf6-c65864804ec9] INFO org.candlepin.servlet.filter.logging.LoggingFilter - Response: status=200, content-type="application/json", time=464```