Hello,
Since I updated to foreman 3.14 and katello 4.16 I have this error with hammer:
hammer host update --name server.domain.com --hostgroup HG_RH9_TEST
Could not update the host:
500 Internal Server Error
With the GUI I can change without any pb the hostgroup.
Can you help me to solve this please ?
Currently the hammer errors with host update are not propagated correctly; Fixes #38291 - fix hammer host update error messages by jeremylenz · Pull Request #638 · theforeman/hammer-cli-foreman · GitHub should fix that with the next Hammer release.
For now you can check /var/log/foreman/production.log and find the “Completed 500 Internal Server Error.” Directly above that there should be a backtrace with what the actual error was.
Hello Jeremy,
Here bellow the logs, let me know your observations 
2025-03-28T15:04:14 [E|app|d4e90b80] ProxyAPI::ProxyException: ERF12-1985 [ProxyAPI::ProxyException]: Unable to query monitoring host object for Sever.domain.com: Icinga server ‘icinga2.localdomain’ is unknown ([RestClient::ServiceUnavailable]: 503 Service Unavailable) for proxy https://Sever.domain.com:9090/monitoring
d4e90b80 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/lib/proxy_api/monitoring.rb:49:in rescue in query_host' d4e90b80 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/lib/proxy_api/monitoring.rb:44:in query_host’
d4e90b80 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/services/monitoring.rb:52:in query_host' d4e90b80 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/models/concerns/orchestration/monitoring.rb:88:in monitoring_object’
d4e90b80 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/models/concerns/orchestration/monitoring.rb:17:in queue_monitoring' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:400:in block in make_lambda’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:247:in block in halting' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:599:in block in invoke_after’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:599:in each' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:599:in invoke_after’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:108:in run_callbacks' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:929:in _run_validation_callbacks’
d4e90b80 | /usr/share/gems/gems/activemodel-7.0.8.7/lib/active_model/validations/callbacks.rb:115:in run_validations!' d4e90b80 | /usr/share/gems/gems/activemodel-7.0.8.7/lib/active_model/validations.rb:337:in valid?’
d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/validations.rb:68:in valid?' d4e90b80 | /usr/share/foreman/app/models/concerns/orchestration.rb:83:in valid?’
d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/validations.rb:84:in perform_validations' d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/validations.rb:47:in save’
d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:298:in block in save' d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:354:in block in with_transaction_returning_status’
d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/abstract/transaction.rb:319:in block in within_new_transaction' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in handle_interrupt’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in block in synchronize' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in handle_interrupt’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in synchronize' d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/abstract/transaction.rb:317:in within_new_transaction’
d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/abstract/database_statements.rb:316:in transaction' d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:350:in with_transaction_returning_status’
d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:298:in save' d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/suppressor.rb:50:in save’
d4e90b80 | /usr/share/foreman/app/controllers/api/v2/hosts_controller.rb:163:in update' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/basic_implicit_render.rb:6:in send_action’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/base.rb:215:in process_action' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/rendering.rb:165:in process_action’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/callbacks.rb:234:in block in process_action' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:118:in block in run_callbacks’
d4e90b80 | /usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in set_timezone' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
d4e90b80 | /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in clear_thread' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
d4e90b80 | /usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in set_topbar_sweeper_controller' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
d4e90b80 | /usr/share/gems/gems/audited-5.8.0/lib/audited/sweeper.rb:16:in around' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
d4e90b80 | /usr/share/gems/gems/audited-5.8.0/lib/audited/sweeper.rb:16:in around' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:138:in run_callbacks' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/callbacks.rb:233:in process_action’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/rescue.rb:23:in process_action' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/instrumentation.rb:67:in block in process_action’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/notifications.rb:206:in block in instrument' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/notifications/instrumenter.rb:24:in instrument’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/notifications.rb:206:in instrument' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/instrumentation.rb:66:in process_action’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/params_wrapper.rb:259:in process_action' d4e90b80 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/railties/controller_runtime.rb:27:in process_action’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/base.rb:151:in process' d4e90b80 | /usr/share/gems/gems/actionview-7.0.8.7/lib/action_view/rendering.rb:39:in process’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal.rb:188:in dispatch' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal.rb:251:in dispatch’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/route_set.rb:49:in dispatch' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/route_set.rb:32:in serve’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/mapper.rb:18:in block in <class:Constraints>' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/mapper.rb:48:in serve’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/journey/router.rb:50:in block in serve' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/journey/router.rb:32:in each’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/journey/router.rb:32:in serve' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/route_set.rb:852:in call’
d4e90b80 | /usr/share/gems/gems/katello-4.16.0/lib/katello/middleware/organization_created_enforcer.rb:18:in call' d4e90b80 | /usr/share/gems/gems/katello-4.16.0/lib/katello/middleware/event_daemon.rb:10:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
d4e90b80 | /usr/share/gems/gems/apipie-dsl-2.6.2/lib/apipie_dsl/static_dispatcher.rb:67:in call' d4e90b80 | /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/static_dispatcher.rb:74:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' d4e90b80 | /usr/share/foreman/lib/foreman/middleware/libvirt_connection_cleaner.rb:9:in call’
d4e90b80 | /usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in call' d4e90b80 | /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/middleware/checksum_in_headers.rb:27:in call’
d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/tempfile_reaper.rb:15:in call' d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/etag.rb:27:in call’
d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/conditional_get.rb:40:in call' d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/head.rb:12:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/http/permissions_policy.rb:38:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/http/content_security_policy.rb:39:in call’
d4e90b80 | /usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in call' d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/session/abstract/id.rb:266:in context’
d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/session/abstract/id.rb:260:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/cookies.rb:704:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/callbacks.rb:27:in block in call' d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:99:in run_callbacks’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/callbacks.rb:26:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/debug_exceptions.rb:28:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/show_exceptions.rb:29:in call' d4e90b80 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/rack/logger.rb:40:in call_app’
d4e90b80 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/rack/logger.rb:27:in call' d4e90b80 | /usr/share/gems/gems/sprockets-rails-3.5.2/lib/sprockets/rails/quiet_assets.rb:17:in call’
d4e90b80 | /usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/remote_ip.rb:93:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/request_id.rb:26:in call' d4e90b80 | /usr/share/gems/gems/katello-4.16.0/lib/katello/prevent_json_parsing.rb:12:in call’
d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/method_override.rb:24:in call' d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/runtime.rb:22:in call’
d4e90b80 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/executor.rb:14:in call’
d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/sendfile.rb:110:in call' d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/ssl.rb:77:in call’
d4e90b80 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/host_authorization.rb:131:in call' d4e90b80 | /usr/share/gems/gems/secure_headers-6.7.0/lib/secure_headers/middleware.rb:11:in call’
d4e90b80 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/engine.rb:530:in call' d4e90b80 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/railtie.rb:226:in public_send’
d4e90b80 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/railtie.rb:226:in method_missing' d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/urlmap.rb:74:in block in call’
d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/urlmap.rb:58:in each' d4e90b80 | /usr/share/gems/gems/rack-2.2.4/lib/rack/urlmap.rb:58:in call’
d4e90b80 | /usr/share/gems/gems/puma-6.6.0/lib/puma/configuration.rb:279:in call' d4e90b80 | /usr/share/gems/gems/puma-6.6.0/lib/puma/request.rb:99:in block in handle_request’
d4e90b80 | /usr/share/gems/gems/puma-6.6.0/lib/puma/thread_pool.rb:390:in with_force_shutdown' d4e90b80 | /usr/share/gems/gems/puma-6.6.0/lib/puma/request.rb:98:in handle_request’
d4e90b80 | /usr/share/gems/gems/puma-6.6.0/lib/puma/server.rb:472:in process_client' d4e90b80 | /usr/share/gems/gems/puma-6.6.0/lib/puma/server.rb:254:in block in run’
d4e90b80 | /usr/share/gems/gems/puma-6.6.0/lib/puma/thread_pool.rb:167:in block in spawn_thread' d4e90b80 | /usr/share/gems/gems/logging-2.4.0/lib/logging/diagnostic_context.rb:474:in block in create_with_logging_context’
2025-03-28T15:04:14 [I|app|d4e90b80] Completed 500 Internal Server Error in 259ms (Views: 0.2ms | ActiveRecord: 26.9ms | Allocations: 44049)
2025-03-28T15:05:15 [I|app|20f9b7b0] Started GET “/rhsm/” for 192.168.214.216 at 2025-03-28 15:05:15 +0100
2025-03-28T15:05:15 [I|app|20f9b7b0] Processing by Katello::Api::V2::RootController#rhsm_resource_list as JSON
2025-03-28T15:05:15 [I|app|20f9b7b0] Parameters: {“root”=>{}}
2025-03-28T15:05:15 [I|app|20f9b7b0] Completed 200 OK in 4ms (Views: 0.4ms | ActiveRecord: 1.6ms | Allocations: 1522)
2025-03-28T15:05:15 [I|app|0351bca7] Started GET “/rhsm/consumers/d07c51f3-e99d-4c1f-b20d-9d3602a223ef/certificates/serials” for 192.168.214.216 at 2025-03-28 15:05:15 +0100
2025-03-28T15:05:15 [I|app|0351bca7] Processing by Katello::Api::Rhsm::CandlepinProxiesController#serials as JSON
2025-03-28T15:05:15 [I|app|0351bca7] Parameters: {“id”=>“d07c51f3-e99d-4c1f-b20d-9d3602a223ef”}
2025-03-28T15:05:15 [I|app|0351bca7] Completed 200 OK in 26ms (Views: 0.4ms | ActiveRecord: 4.9ms | Allocations: 5690)
2025-03-28T15:05:15 [I|app|3a015215] Started GET “/rhsm/status” for 192.168.214.216 at 2025-03-28 15:05:15 +0100
2025-03-28T15:05:15 [I|app|3a015215] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2025-03-28T15:05:15 [I|app|3a015215] Completed 200 OK in 20ms (Views: 0.2ms | ActiveRecord: 7.5ms | Allocations: 7471)
2025-03-28T15:05:15 [I|app|e8467e21] Started GET “/rhsm/consumers/d07c51f3-e99d-4c1f-b20d-9d3602a223ef/accessible_content” for 192.168.214.216 at 2025-03-28 15:05:15 +0100
2025-03-28T15:05:15 [I|app|e8467e21] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2025-03-28T15:05:15 [I|app|e8467e21] Parameters: {“id”=>“d07c51f3-e99d-4c1f-b20d-9d3602a223ef”}
2025-03-28T15:05:15 [I|app|e8467e21] Completed 304 Not Modified in 12ms (Views: 0.1ms | ActiveRecord: 1.2ms | Allocations: 4721)
2025-03-28T15:05:15 [I|app|1f8df735] Started GET “/rhsm/consumers/d07c51f3-e99d-4c1f-b20d-9d3602a223ef” for 192.168.214.216 at 2025-03-28 15:05:15 +0100
2025-03-28T15:05:15 [I|app|1f8df735] Processing by Katello::Api::Rhsm::CandlepinProxiesController#consumer_show as JSON
2025-03-28T15:05:15 [I|app|1f8df735] Parameters: {“id”=>“d07c51f3-e99d-4c1f-b20d-9d3602a223ef”}
2025-03-28T15:05:15 [I|app|1f8df735] Completed 200 OK in 21ms (Views: 1.3ms | ActiveRecord: 2.6ms | Allocations: 9050)
2025-03-28T15:05:15 [I|app|f3b35021] Started GET “/rhsm/consumers/d07c51f3-e99d-4c1f-b20d-9d3602a223ef/content_overrides” for 192.168.214.216 at 2025-03-28 15:05:15 +0100
2025-03-28T15:05:15 [I|app|f3b35021] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2025-03-28T15:05:15 [I|app|f3b35021] Parameters: {“id”=>“d07c51f3-e99d-4c1f-b20d-9d3602a223ef”}
2025-03-28T15:05:15 [I|app|f3b35021] Completed 200 OK in 12ms (Views: 0.1ms | ActiveRecord: 1.3ms | Allocations: 4788)
2025-03-28T15:05:19 [I|app|87f2b990] Started GET “/rhsm/consumers/d07c51f3-e99d-4c1f-b20d-9d3602a223ef” for 192.168.214.216 at 2025-03-28 15:05:19 +0100
2025-03-28T15:05:19 [I|app|87f2b990] Processing by Katello::Api::Rhsm::CandlepinProxiesController#consumer_show as JSON
2025-03-28T15:05:19 [I|app|87f2b990] Parameters: {“id”=>“d07c51f3-e99d-4c1f-b20d-9d3602a223ef”}
2025-03-28T15:05:19 [I|app|87f2b990] Completed 200 OK in 19ms (Views: 1.6ms | ActiveRecord: 2.1ms | Allocations: 8942)
2025-03-28T15:06:12 [I|app|e3feb711] Started GET “/rhsm/consumers/c7512fa6-5e02-485a-ba62-468f22b6b5f5/certificates/serials” for 192.168.214.217 at 2025-03-28 15:06:12 +0100
2025-03-28T15:06:12 [I|app|e3feb711] Processing by Katello::Api::Rhsm::CandlepinProxiesController#serials as JSON
2025-03-28T15:06:12 [I|app|e3feb711] Parameters: {“id”=>“c7512fa6-5e02-485a-ba62-468f22b6b5f5”}
2025-03-28T15:06:12 [I|app|e3feb711] Completed 200 OK in 26ms (Views: 0.2ms | ActiveRecord: 7.5ms | Allocations: 5678)
2025-03-28T15:06:12 [I|app|58dd9037] Started GET “/rhsm/status” for 192.168.214.217 at 2025-03-28 15:06:12 +0100
2025-03-28T15:06:12 [I|app|58dd9037] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2025-03-28T15:06:12 [I|app|58dd9037] Completed 200 OK in 13ms (Views: 0.2ms | ActiveRecord: 4.3ms | Allocations: 4589)
2025-03-28T15:06:12 [I|app|91726d94] Started GET “/rhsm/consumers/c7512fa6-5e02-485a-ba62-468f22b6b5f5/accessible_content” for 192.168.214.217 at 2025-03-28 15:06:12 +0100
2025-03-28T15:06:12 [I|app|91726d94] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2025-03-28T15:06:12 [I|app|91726d94] Parameters: {“id”=>“c7512fa6-5e02-485a-ba62-468f22b6b5f5”}
2025-03-28T15:06:12 [I|app|91726d94] Completed 304 Not Modified in 13ms (Views: 0.1ms | ActiveRecord: 4.1ms | Allocations: 4704)
2025-03-28T15:06:12 [I|app|5b351aed] Started GET “/rhsm/consumers/c7512fa6-5e02-485a-ba62-468f22b6b5f5/content_overrides” for 192.168.214.217 at 2025-03-28 15:06:12 +0100
2025-03-28T15:06:12 [I|app|5b351aed] Processing by Katello::Api::Rhsm::CandlepinProxiesController#get as JSON
2025-03-28T15:06:12 [I|app|5b351aed] Parameters: {“id”=>“c7512fa6-5e02-485a-ba62-468f22b6b5f5”}
2025-03-28T15:06:12 [I|app|5b351aed] Completed 200 OK in 14ms (Views: 0.1ms | ActiveRecord: 4.1ms | Allocations: 4782)
2025-03-28T15:07:13 [I|app|96227f15] Started GET “/apidoc/apipie_checksum” for 192.168.214.210 at 2025-03-28 15:07:13 +0100
2025-03-28T15:07:13 [I|app|96227f15] Processing by Apipie::ApipiesController#apipie_checksum as JSON
2025-03-28T15:07:13 [I|app|96227f15] Parameters: {“apipy”=>{}}
2025-03-28T15:07:13 [I|app|96227f15] Rendered /usr/share/gems/gems/apipie-rails-1.4.2/app/views/apipie/apipies/apipie_checksum.json.erb (Duration: 0.1ms | Allocations: 33)
2025-03-28T15:07:13 [I|app|96227f15] Completed 200 OK in 1ms (Views: 0.9ms | ActiveRecord: 0.0ms | Allocations: 622)
2025-03-28T15:07:13 [I|app|f591a14a] Started GET “/api/hostgroups?search=name+%3D+%22HG_RH9_TEST%22&per_page=1000&page=1” for 192.168.214.210 at 2025-03-28 15:07:13 +0100
2025-03-28T15:07:13 [I|app|f591a14a] Processing by Api::V2::HostgroupsController#index as JSON
2025-03-28T15:07:13 [I|app|f591a14a] Parameters: {“search”=>“name = "HG_RH9_TEST"”, “per_page”=>“1000”, “page”=>“1”, “apiv”=>“v2”, “hostgroup”=>{}}
2025-03-28T15:07:13 [I|app|f591a14a] Authorized user admin(Admin User)
2025-03-28T15:07:13 [I|app|f591a14a] Rendered api/v2/hostgroups/index.json.rabl within api/v2/layouts/index_layout (Duration: 5.8ms | Allocations: 3741)
2025-03-28T15:07:13 [I|app|f591a14a] Rendered layout api/v2/layouts/index_layout.json.erb (Duration: 7.6ms | Allocations: 4849)
2025-03-28T15:07:13 [I|app|f591a14a] Completed 200 OK in 156ms (Views: 9.3ms | ActiveRecord: 11.9ms | Allocations: 15206)
2025-03-28T15:07:14 [I|app|df43abbb] Started GET “/api/hosts?search=name+%3D+%22Sever.domain.com%22&per_page=1000&page=1” for 192.168.214.210 at 2025-03-28 15:07:14 +0100
2025-03-28T15:07:14 [I|app|df43abbb] Processing by Api::V2::HostsController#index as JSON
2025-03-28T15:07:14 [I|app|df43abbb] Parameters: {“search”=>“name = "Sever.domain.com"”, “per_page”=>“1000”, “page”=>“1”, “apiv”=>“v2”, “host”=>{}}
2025-03-28T15:07:14 [I|app|df43abbb] Authorized user admin(Admin User)
2025-03-28T15:07:14 [I|app|df43abbb] Rendered api/v2/hosts/index.json.rabl within api/v2/layouts/index_layout (Duration: 27.4ms | Allocations: 15608)
2025-03-28T15:07:14 [I|app|df43abbb] Rendered layout api/v2/layouts/index_layout.json.erb (Duration: 28.8ms | Allocations: 16297)
2025-03-28T15:07:14 [I|app|df43abbb] Completed 200 OK in 186ms (Views: 23.9ms | ActiveRecord: 24.2ms | Allocations: 35301)
2025-03-28T15:07:14 [I|app|f906d758] Started PUT “/api/hosts/151” for 192.168.214.210 at 2025-03-28 15:07:14 +0100
2025-03-28T15:07:14 [I|app|f906d758] Processing by Api::V2::HostsController#update as JSON
2025-03-28T15:07:14 [I|app|f906d758] Parameters: {“host”=>{“name”=>“Sever.domain.com”, “hostgroup_id”=>5, “content_facet_attributes”=>{}, “subscription_facet_attributes”=>{}}, “apiv”=>“v2”, “id”=>“151”}
2025-03-28T15:07:14 [I|app|f906d758] Authorized user admin(Admin User)
2025-03-28T15:07:14 [E|app|f906d758] ProxyAPI::ProxyException: ERF12-1985 [ProxyAPI::ProxyException]: Unable to query monitoring host object for Sever.domain.com: Icinga server ‘icinga2.localdomain’ is unknown ([RestClient::ServiceUnavailable]: 503 Service Unavailable) for proxy https://Sever.domain.com:9090/monitoring
f906d758 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/lib/proxy_api/monitoring.rb:49:in rescue in query_host' f906d758 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/lib/proxy_api/monitoring.rb:44:in query_host’
f906d758 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/services/monitoring.rb:52:in query_host' f906d758 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/models/concerns/orchestration/monitoring.rb:88:in monitoring_object’
f906d758 | /usr/share/gems/gems/foreman_monitoring-3.2.0/app/models/concerns/orchestration/monitoring.rb:17:in queue_monitoring' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:400:in block in make_lambda’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:247:in block in halting' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:599:in block in invoke_after’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:599:in each' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:599:in invoke_after’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:108:in run_callbacks' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:929:in _run_validation_callbacks’
f906d758 | /usr/share/gems/gems/activemodel-7.0.8.7/lib/active_model/validations/callbacks.rb:115:in run_validations!' f906d758 | /usr/share/gems/gems/activemodel-7.0.8.7/lib/active_model/validations.rb:337:in valid?’
f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/validations.rb:68:in valid?' f906d758 | /usr/share/foreman/app/models/concerns/orchestration.rb:83:in valid?’
f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/validations.rb:84:in perform_validations' f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/validations.rb:47:in save’
f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:298:in block in save' f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:354:in block in with_transaction_returning_status’
f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/abstract/transaction.rb:319:in block in within_new_transaction' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in handle_interrupt’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in block in synchronize' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in handle_interrupt’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in synchronize' f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/abstract/transaction.rb:317:in within_new_transaction’
f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/abstract/database_statements.rb:316:in transaction' f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:350:in with_transaction_returning_status’
f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/transactions.rb:298:in save' f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/suppressor.rb:50:in save’
f906d758 | /usr/share/foreman/app/controllers/api/v2/hosts_controller.rb:163:in update' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/basic_implicit_render.rb:6:in send_action’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/base.rb:215:in process_action' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/rendering.rb:165:in process_action’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/callbacks.rb:234:in block in process_action' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:118:in block in run_callbacks’
f906d758 | /usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in set_timezone' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
f906d758 | /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in clear_thread' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
f906d758 | /usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in set_topbar_sweeper_controller' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
f906d758 | /usr/share/gems/gems/audited-5.8.0/lib/audited/sweeper.rb:16:in around' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
f906d758 | /usr/share/gems/gems/audited-5.8.0/lib/audited/sweeper.rb:16:in around' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:127:in block in run_callbacks’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:138:in run_callbacks' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/callbacks.rb:233:in process_action’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/rescue.rb:23:in process_action' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/instrumentation.rb:67:in block in process_action’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/notifications.rb:206:in block in instrument' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/notifications/instrumenter.rb:24:in instrument’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/notifications.rb:206:in instrument' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/instrumentation.rb:66:in process_action’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal/params_wrapper.rb:259:in process_action' f906d758 | /usr/share/gems/gems/activerecord-7.0.8.7/lib/active_record/railties/controller_runtime.rb:27:in process_action’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/abstract_controller/base.rb:151:in process' f906d758 | /usr/share/gems/gems/actionview-7.0.8.7/lib/action_view/rendering.rb:39:in process’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal.rb:188:in dispatch' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_controller/metal.rb:251:in dispatch’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/route_set.rb:49:in dispatch' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/route_set.rb:32:in serve’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/mapper.rb:18:in block in <class:Constraints>' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/mapper.rb:48:in serve’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/journey/router.rb:50:in block in serve' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/journey/router.rb:32:in each’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/journey/router.rb:32:in serve' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/routing/route_set.rb:852:in call’
f906d758 | /usr/share/gems/gems/katello-4.16.0/lib/katello/middleware/organization_created_enforcer.rb:18:in call' f906d758 | /usr/share/gems/gems/katello-4.16.0/lib/katello/middleware/event_daemon.rb:10:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
f906d758 | /usr/share/gems/gems/apipie-dsl-2.6.2/lib/apipie_dsl/static_dispatcher.rb:67:in call' f906d758 | /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/static_dispatcher.rb:74:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/static.rb:23:in call' f906d758 | /usr/share/foreman/lib/foreman/middleware/libvirt_connection_cleaner.rb:9:in call’
f906d758 | /usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in call' f906d758 | /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/middleware/checksum_in_headers.rb:27:in call’
f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/tempfile_reaper.rb:15:in call' f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/etag.rb:27:in call’
f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/conditional_get.rb:40:in call' f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/head.rb:12:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/http/permissions_policy.rb:38:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/http/content_security_policy.rb:39:in call’
f906d758 | /usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in call' f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/session/abstract/id.rb:266:in context’
f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/session/abstract/id.rb:260:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/cookies.rb:704:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/callbacks.rb:27:in block in call' f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/callbacks.rb:99:in run_callbacks’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/callbacks.rb:26:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/debug_exceptions.rb:28:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/show_exceptions.rb:29:in call' f906d758 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/rack/logger.rb:40:in call_app’
f906d758 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/rack/logger.rb:27:in call' f906d758 | /usr/share/gems/gems/sprockets-rails-3.5.2/lib/sprockets/rails/quiet_assets.rb:17:in call’
f906d758 | /usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/remote_ip.rb:93:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/request_id.rb:26:in call' f906d758 | /usr/share/gems/gems/katello-4.16.0/lib/katello/prevent_json_parsing.rb:12:in call’
f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/method_override.rb:24:in call' f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/runtime.rb:22:in call’
f906d758 | /usr/share/gems/gems/activesupport-7.0.8.7/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/executor.rb:14:in call’
f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/sendfile.rb:110:in call' f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/ssl.rb:77:in call’
f906d758 | /usr/share/gems/gems/actionpack-7.0.8.7/lib/action_dispatch/middleware/host_authorization.rb:131:in call' f906d758 | /usr/share/gems/gems/secure_headers-6.7.0/lib/secure_headers/middleware.rb:11:in call’
f906d758 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/engine.rb:530:in call' f906d758 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/railtie.rb:226:in public_send’
f906d758 | /usr/share/gems/gems/railties-7.0.8.7/lib/rails/railtie.rb:226:in method_missing' f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/urlmap.rb:74:in block in call’
f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/urlmap.rb:58:in each' f906d758 | /usr/share/gems/gems/rack-2.2.4/lib/rack/urlmap.rb:58:in call’
f906d758 | /usr/share/gems/gems/puma-6.6.0/lib/puma/configuration.rb:279:in call' f906d758 | /usr/share/gems/gems/puma-6.6.0/lib/puma/request.rb:99:in block in handle_request’
f906d758 | /usr/share/gems/gems/puma-6.6.0/lib/puma/thread_pool.rb:390:in with_force_shutdown' f906d758 | /usr/share/gems/gems/puma-6.6.0/lib/puma/request.rb:98:in handle_request’
f906d758 | /usr/share/gems/gems/puma-6.6.0/lib/puma/server.rb:472:in process_client' f906d758 | /usr/share/gems/gems/puma-6.6.0/lib/puma/server.rb:254:in block in run’
f906d758 | /usr/share/gems/gems/puma-6.6.0/lib/puma/thread_pool.rb:167:in block in spawn_thread' f906d758 | /usr/share/gems/gems/logging-2.4.0/lib/logging/diagnostic_context.rb:474:in block in create_with_logging_context’
2025-03-28T15:07:14 [I|app|f906d758] Completed 500 Internal Server Error in 258ms (Views: 0.2ms | ActiveRecord: 21.6ms | Allocations: 49881)
Is there any workaround waiting for the next hammer release ?
Only to look at the log files.
It seems there is some issue with foreman_monitoring, but I’m not sure why. Will have to wait for other replies here.