Problem:
The ‘Last Report’ field is blank for a number of hosts. Upon further investigation the debug logs show the following (see other relevant data’). The hosts have been deleted within Foreman, the certificates revoked/cleaned via ‘pupperserver ca’ and the Puppet Agent reinstalled on the offending machines to no available. Your help would be appreciated.
Expected outcome:
The report(s) are processed and the ‘Last Report’ field is updated.
Foreman and Proxy versions:
- foreman-dynflow-sidekiq-2.1.4-1.el8.noarch
- foreman-release-2.1.4-1.el8.noarch
- rubygem-foreman_maintain-0.6.9-1.el8.noarch
- foreman-2.1.4-1.el8.noarch
- foreman-postgresql-2.1.4-1.el8.noarch
- foreman-debug-2.1.4-1.el8.noarch
- foreman-selinux-2.1.4-1.el8.noarch
- foreman-installer-2.1.4-1.el8.noarch
- foreman-service-2.1.4-1.el8.noarch
- foreman-proxy-2.1.4-1.el8.noarch
- foreman-cli-2.1.4-1.el8.noarch
Distribution and version:
- CentOS Linux release 8.2.2004 (Core)
Other relevant data:
2020-11-20T12:21:17 [D|app|4902a0b8] Backtrace for 'Action failed' error (ActiveRecord::AssociationTypeMismatch): Host::Managed(#47222304019520) expected, got #<Host::Base id: 49, name: "myserver.hostname.tld", last_compile: nil, last_report: nil, updated_at: "2020-11-03 16:45:54", created_at: "2020-11-03 16:45:41", root_pass: nil, architecture_id: 1, operatingsystem_id: 7, environment_id: 13, ptable_id: nil, medium_id: nil, build: false, comment: nil, disk: nil, installed_at: nil, model_id: 10, hostgroup_id: nil, owner_id: nil, owner_type: nil, enabled: true, puppet_ca_proxy_id: 2, managed: false, use_image: nil, image_file: nil, uuid: nil, compute_resource_id: nil, puppet_proxy_id: 2, certname: "myserver.hostname.tld", image_id: nil, organization_id: nil, location_id: nil, type: nil, otp: nil, realm_id: nil, compute_profile_id: nil, provision_method: nil, grub_pass: "", global_status: 0, lookup_value_matcher: [FILTERED], pxe_loader: nil, initiated_at: nil, build_errors: nil> which is an instance of Host::Base(#47222306019100)
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/associations/association.rb:283:in `raise_on_type_mismatch!'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/associations/belongs_to_association.rb:66:in `replace'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/associations/singular_association.rb:17:in `writer'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/associations/builder/association.rb:108:in `host='
/usr/share/gems/gems/activemodel-6.0.3.1/lib/active_model/attribute_assignment.rb:50:in `public_send'
/usr/share/gems/gems/activemodel-6.0.3.1/lib/active_model/attribute_assignment.rb:50:in `_assign_attribute'
/usr/share/gems/gems/activemodel-6.0.3.1/lib/active_model/attribute_assignment.rb:43:in `block in _assign_attributes'
/usr/share/gems/gems/activemodel-6.0.3.1/lib/active_model/attribute_assignment.rb:42:in `each'
/usr/share/gems/gems/activemodel-6.0.3.1/lib/active_model/attribute_assignment.rb:42:in `_assign_attributes'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/attribute_assignment.rb:21:in `_assign_attributes'
/usr/share/gems/gems/activemodel-6.0.3.1/lib/active_model/attribute_assignment.rb:35:in `assign_attributes'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/core.rb:325:in `initialize'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/inheritance.rb:70:in `new'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/inheritance.rb:70:in `new'
/usr/share/foreman/app/models/concerns/foreman/sti.rb:19:in `new'
/usr/share/foreman/app/services/report_importer.rb:154:in `create_report_and_logs'
/usr/share/foreman/app/services/config_report_importer.rb:13:in `create_report_and_logs'
/usr/share/foreman/app/services/report_importer.rb:41:in `block in import'
/usr/share/foreman/app/services/foreman/telemetry_helper.rb:27:in `telemetry_duration_histogram'
/usr/share/foreman/app/services/report_importer.rb:40:in `import'
/usr/share/foreman/app/services/report_importer.rb:22:in `import'
/usr/share/foreman/app/models/config_report.rb:27:in `import'
/usr/share/foreman/app/controllers/api/v2/config_reports_controller.rb:42:in `create'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal/basic_implicit_render.rb:6:in `send_action'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/abstract_controller/base.rb:195:in `process_action'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal/rendering.rb:30:in `process_action'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/abstract_controller/callbacks.rb:42:in `block in process_action'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:112:in `block in run_callbacks'
/usr/share/foreman/app/controllers/api/v2/base_controller.rb:163:in `disable_json_root'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in `set_timezone'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in `clear_thread'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in `set_topbar_sweeper_controller'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in `around'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in `around'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:139:in `run_callbacks'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/abstract_controller/callbacks.rb:41:in `process_action'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal/rescue.rb:22:in `process_action'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal/instrumentation.rb:33:in `block in process_action'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/notifications.rb:180:in `block in instrument'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/notifications/instrumenter.rb:24:in `instrument'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/notifications.rb:180:in `instrument'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal/instrumentation.rb:32:in `process_action'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal/params_wrapper.rb:245:in `process_action'
/usr/share/gems/gems/activerecord-6.0.3.1/lib/active_record/railties/controller_runtime.rb:27:in `process_action'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/abstract_controller/base.rb:136:in `process'
/usr/share/gems/gems/actionview-6.0.3.1/lib/action_view/rendering.rb:39:in `process'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal.rb:190:in `dispatch'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_controller/metal.rb:254:in `dispatch'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/routing/route_set.rb:50:in `dispatch'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/routing/route_set.rb:33:in `serve'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/routing/mapper.rb:18:in `block in <class:Constraints>'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/routing/mapper.rb:48:in `serve'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/journey/router.rb:49:in `block in serve'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/journey/router.rb:32:in `each'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/journey/router.rb:32:in `serve'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/routing/route_set.rb:834:in `call'
/usr/share/gems/gems/apipie-dsl-2.2.2/lib/apipie_dsl/static_dispatcher.rb:67:in `call'
/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/static_dispatcher.rb:66:in `call'
/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/extractor/recorder.rb:137:in `call'
/usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in `call'
/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/middleware/checksum_in_headers.rb:27:in `call'
/usr/share/foreman/lib/foreman/middleware/catch_json_parse_errors.rb:9:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/tempfile_reaper.rb:15:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/etag.rb:27:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/conditional_get.rb:40:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/head.rb:12:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/http/content_security_policy.rb:18:in `call'
/usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/session/abstract/id.rb:266:in `context'
/usr/share/gems/gems/rack-2.2.2/lib/rack/session/abstract/id.rb:260:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/cookies.rb:648:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/callbacks.rb:27:in `block in call'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/callbacks.rb:101:in `run_callbacks'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/callbacks.rb:26:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/actionable_exceptions.rb:17:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/debug_exceptions.rb:32:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/show_exceptions.rb:33:in `call'
/usr/share/gems/gems/railties-6.0.3.1/lib/rails/rack/logger.rb:37:in `call_app'
/usr/share/gems/gems/railties-6.0.3.1/lib/rails/rack/logger.rb:28:in `call'
/usr/share/gems/gems/sprockets-rails-3.2.1/lib/sprockets/rails/quiet_assets.rb:13:in `call'
/usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/remote_ip.rb:81:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/request_id.rb:27:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/method_override.rb:24:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/runtime.rb:22:in `call'
/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/executor.rb:14:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/static.rb:126:in `call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/sendfile.rb:110:in `call'
/usr/share/gems/gems/actionpack-6.0.3.1/lib/action_dispatch/middleware/host_authorization.rb:76:in `call'
/usr/share/gems/gems/secure_headers-6.3.0/lib/secure_headers/middleware.rb:11:in `call'
/usr/share/gems/gems/railties-6.0.3.1/lib/rails/engine.rb:527:in `call'
/usr/share/gems/gems/railties-6.0.3.1/lib/rails/railtie.rb:190:in `public_send'
/usr/share/gems/gems/railties-6.0.3.1/lib/rails/railtie.rb:190:in `method_missing'
/usr/share/gems/gems/rack-2.2.2/lib/rack/urlmap.rb:74:in `block in call'
/usr/share/gems/gems/rack-2.2.2/lib/rack/urlmap.rb:58:in `each'
/usr/share/gems/gems/rack-2.2.2/lib/rack/urlmap.rb:58:in `call'
/usr/share/gems/gems/puma-4.3.3/lib/puma/configuration.rb:228:in `call'
/usr/share/gems/gems/puma-4.3.3/lib/puma/server.rb:682:in `handle_request'
/usr/share/gems/gems/puma-4.3.3/lib/puma/server.rb:472:in `process_client'
/usr/share/gems/gems/puma-4.3.3/lib/puma/server.rb:328:in `block in run'
/usr/share/gems/gems/puma-4.3.3/lib/puma/thread_pool.rb:134:in `block in spawn_thread'
/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
2020-11-20T12:21:17 [I|app|4902a0b8] Rendering api/v2/errors/standard_error.json.rabl within api/v2/layouts/error_layout
2020-11-20T12:21:17 [I|app|4902a0b8] Rendered api/v2/errors/standard_error.json.rabl within api/v2/layouts/error_layout (Duration: 0.3ms | Allocations: 67)
2020-11-20T12:21:17 [I|app|4902a0b8] Completed 500 Internal Server Error in 94ms (Views: 1.0ms | ActiveRecord: 16.1ms | Allocations: 81665)