Foreman 3.1 RC - node.rb after upgrade not working any more

Support
, ,
1

After updating to foreman 3.1 rc2 from 3.1 rc1, puppet can´t execute a puppetrun because the node.rb script on the puppetserver can´t be executed correctly

2021-12-06T23:10:50 [D|app|1786a0fc] Cache write: _session_id:2::1174e22daeb5703bcc8f0acc9a196b0434f1eace8a4a81b96331795b29acea58 ({:expires_in=>86400})
2021-12-06T23:10:50 [I|app|d8f3cd64] Started GET "/node/<nodename>.<domain>?format=yml" for 10.115.155.54 at 2021-12-06 23:10:50 +0100
2021-12-06T23:10:50 [F|app|d8f3cd64]
 d8f3cd64 | ActionController::RoutingError (No route matches [GET] "/node/pp-master-test-02.ict.dev.ttw"):
 d8f3cd64 |
 d8f3cd64 | lib/foreman/middleware/logging_context_request.rb:11:in `call'

Expected outcome:

Outcome should be that with the node.rb script the detection of nodes in puppetdb is working again afterwards foreman is in that case useless.

Foreman and Proxy plugin versions:
foreman 3.1RC2
foreman-proxy
foreman-openscap / scap-client
foreman_proxy::tftp
foreman_proxy::bmc
foreman_proxy::realm
foreman-proxy-discovery
foreman-proxy-dynflow

tfm-rubygem-foreman_memcache-0.1.1-4.fm2_5.el7.noarch
foreman-selinux-3.1.0-0.1.rc2.el7.noarch
tfm-rubygem-foreman_hooks-0.3.17-2.fm2_5.el7.noarch
foreman-dynflow-sidekiq-3.1.0-0.1.rc2.el7.noarch
foreman-service-3.1.0-0.1.rc2.el7.noarch
foreman-3.1.0-0.1.rc2.el7.noarch
tfm-rubygem-foreman_bootdisk-18.0.0-1.fm3_1.el7.noarch
tfm-rubygem-foreman_expire_hosts-7.0.4-2.fm2_5.el7.noarch
tfm-rubygem-foreman-tasks-core-0.3.6-1.fm2_5.el7.noarch
foreman-proxy-3.1.0-0.2.rc2.el7.noarch
tfm-rubygem-foreman-tasks-5.2.0-1.fm3_1.el7.noarch
tfm-rubygem-foreman_monitoring-2.1.0-2.fm2_5.el7.noarch
tfm-rubygem-foreman_discovery-19.0.1-1.fm3_1.el7.noarch
tfm-rubygem-foreman_dhcp_browser-0.0.8-5.fm2_5.el7.noarch
tfm-rubygem-puppetdb_foreman-5.0.0-3.fm2_5.el7.noarch
foreman-libvirt-3.1.0-0.1.rc2.el7.noarch
foreman-debug-3.1.0-0.1.rc2.el7.noarch
tfm-rubygem-foreman_templates-9.1.0-1.fm2_6.el7.noarch
foreman-postgresql-3.1.0-0.1.rc2.el7.noarch
tfm-rubygem-foreman_host_extra_validator-0.1.0-4.fm2_5.el7.noarch
foreman-openstack-3.1.0-0.1.rc2.el7.noarch

Distribution and version:

  • CentOS - 7.9.2009 (x86_64)

Other relevant data:
Puppetserver 7 and foreman 3.1 RC2 are on the same server installed

Additionally it workes before with Foreman 3.1 RC1

2

@ezr-ondrej, maybe you could have an eye on this issue ? :slight_smile:

3

I don’t see tfm-rubygem-foreman_puppet installed. That’s required for that endpoint. I do wonder why it worked with RC1. Was it accidentally removed?

4

@ekohl, you are right it was not installed. I installed it now, but issue remains.
We using the puppetforge moduls and install foreman with puppet.
But as i said before the behaviour is since i updated to 3.1 RC2

[root@pp-master-test-02 foreman]# /etc/puppetlabs/puppet/node.rb pp-master-test-02.ict.dev.ttw
pp-master-test-02.ict.dev.ttw: During the fact upload the server responded with: 500 Internal Server Error. Error is ignored and the execution continues.
{
  "error": {"message":"PG::UndefinedTable: ERROR:  relation \"host_puppet_facets\" does not exist\nLINE 8:  WHERE a.attrelid = '\"host_puppet_facets\"'::regclass\n                            ^\n"}
}
Error retrieving node pp-master-test-02.ict.dev.ttw: Net::HTTPPreconditionFailed
Check Foreman's /var/log/foreman/production.log for more information.


2021-12-07T00:31:37 [I|app|e2d6aae4]   Rendering api/v2/errors/standard_error.json.rabl within api/v2/layouts/error_layout
2021-12-07T00:31:37 [I|app|e2d6aae4]   Rendered api/v2/errors/standard_error.json.rabl within api/v2/layouts/error_layout (Duration: 2.0ms | Allocations: 330)
2021-12-07T00:31:37 [I|app|e2d6aae4] Completed 500 Internal Server Error in 472ms (Views: 11.1ms | ActiveRecord: 88.0ms | Allocations: 106637)
2021-12-07T00:31:39 [D|app|e2d6aae4] Cache write: _session_id:2::63186cf18fca2241822c36b0ffd069c86f7fac194287fdb8d4bfe9f0b4303265 ({:expires_in=>86400})
2021-12-07T00:31:39 [I|app|e2d6aae4] Fork detected, re-connecting child process...
2021-12-07T00:31:39 [D|app|e2d6aae4] #<Dalli::NetworkError: Fork detected, re-connecting child process...>
2021-12-07T00:31:39 [D|app|e2d6aae4] retrying request with new server
2021-12-07T00:31:39 [D|app|e2d6aae4] Dalli::Server#connect pp-master-test-02.ict.dev.ttw:11211
2021-12-07T00:31:39 [I|app|bebcb491] Started GET "/node/pp-client-test-01.ict.dev.ttw?format=yml" for 10.115.155.54 at 2021-12-07 00:31:39 +0100
2021-12-07T00:31:39 [I|app|bebcb491] Processing by HostsController#externalNodes as YML
2021-12-07T00:31:39 [I|app|bebcb491]   Parameters: {"name"=>"pp-client-test-01.ict.dev.ttw"}
2021-12-07T00:31:39 [D|app|bebcb491] Client sent certificate with subject 'pp-master-test-02.ict.dev.ttw' and subject alt names '["puppet", "pp-master-test-02.i
ct.dev.ttw"]'
2021-12-07T00:31:39 [D|app|bebcb491] CN and SANs were extracted from a client certificate.
2021-12-07T00:31:39 [D|app|bebcb491] Verifying request from ["puppet", "pp-master-test-02.ict.dev.ttw"] against ["pp-master-test-02.ict.dev.ttw"]
2021-12-07T00:31:39 [D|app|bebcb491] Client sent certificate with subject 'pp-master-test-02.ict.dev.ttw' and subject alt names '["puppet", "pp-master-test-02.i
ct.dev.ttw"]'
2021-12-07T00:31:39 [D|app|bebcb491] CN and SANs were extracted from a client certificate.
2021-12-07T00:31:39 [D|app|bebcb491] Verifying request from ["puppet", "pp-master-test-02.ict.dev.ttw"] against ["pp-master-test-02.ict.dev.ttw"]
2021-12-07T00:31:39 [W|app|bebcb491] Failed to generate external nodes for pp-client-test-01.ict.dev.ttw
2021-12-07T00:31:39 [I|app|bebcb491] Backtrace for 'Failed to generate external nodes for pp-client-test-01.ict.dev.ttw' error (ActiveRecord::StatementInvalid): PG::UndefinedTable: ERROR:  relation "host_puppet_facets" does not exist
 bebcb491 | LINE 8:  WHERE a.attrelid = '"host_puppet_facets"'::regclass
 bebcb491 |                             ^
 bebcb491 |
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/postgresql/database_statements.rb:65:in `async_exec'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/postgresql/database_statements.rb:65:in `block (2 levels) in query'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/dependencies/interlock.rb:48:in `block in permit_concurrent_loads'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/concurrency/share_lock.rb:187:in `yield_shares'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/dependencies/interlock.rb:47:in `permit_concurrent_loads'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/postgresql/database_statements.rb:64:in `block in query'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract_adapter.rb:722:in `block (2 levels) in log'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in synchronize'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract_adapter.rb:721:in `block in log'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/notifications/instrumenter.rb:24:in `instrument'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract_adapter.rb:712:in `log'
bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/postgresql/database_statements.rb:63:in `query'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/postgresql_adapter.rb:820:in `column_definitions'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract/schema_statements.rb:114:in `columns'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/schema_cache.rb:76:in `columns'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/schema_cache.rb:82:in `columns_hash'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/model_schema.rb:488:in `load_schema!'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/attributes.rb:247:in `load_schema!'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/attribute_decorators.rb:50:in `load_schema!'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/model_schema.rb:478:in `block in load_schema'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/model_schema.rb:475:in `synchronize'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/model_schema.rb:475:in `load_schema'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/model_schema.rb:362:in `attribute_types'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/model_schema.rb:386:in `type_for_attribute'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/table_metadata.rb:33:in `type'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/predicate_builder.rb:51:in `build'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/predicate_builder.rb:109:in `block in expand_from_hash'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/predicate_builder.rb:68:in `each'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/predicate_builder.rb:68:in `flat_map'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/predicate_builder.rb:68:in `expand_from_hash'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/predicate_builder.rb:21:in `build_from_hash'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/where_clause_factory.rb:19:in `build'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/relation/query_methods.rb:656:in `where!'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association_scope.rb:154:in `apply_scope'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association_scope.rb:65:in `last_chain_scope'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association_scope.rb:122:in `add_constraints'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association_scope.rb:29:in `scope'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association_scope.rb:7:in `scope'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association.rb:225:in `association_scope'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association.rb:101:in `scope'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association.rb:204:in `find_target'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/singular_association.rb:39:in `find_target'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association.rb:164:in `load_target'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/association.rb:65:in `reload'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/singular_association.rb:9:in `reader'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/associations/builder/association.rb:100:in `puppet'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_puppet-2.0.0/app/services/foreman_puppet/host_info_providers/config_groups_info.rb:5:in `host_info'
 bebcb491 | /usr/share/foreman/app/models/concerns/host_info_extensions.rb:27:in `block in info'
 bebcb491 | /usr/share/foreman/app/models/concerns/host_info_extensions.rb:25:in `each'
 bebcb491 | /usr/share/foreman/app/models/concerns/host_info_extensions.rb:25:in `info'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_puppet-2.0.0/app/controllers/concerns/foreman_puppet/extensions/hosts_controller_extensions.rb:99:in `block in externalNodes'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/mime_responds.rb:205:in `respond_to'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_puppet-2.0.0/app/controllers/concerns/foreman_puppet/extensions/hosts_controller_extensions.rb:95:in `externalNodes'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/basic_implicit_render.rb:6:in `send_action'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/abstract_controller/base.rb:195:in `process_action'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/rendering.rb:30:in `process_action'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/abstract_controller/callbacks.rb:42:in `block in process_action'
bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/instrumentation.rb:33:in `block in process_action'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/notifications.rb:180:in `block in instrument'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/notifications/instrumenter.rb:24:in `instrument'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/notifications.rb:180:in `instrument'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/instrumentation.rb:32:in `process_action'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/params_wrapper.rb:245:in `process_action'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/railties/controller_runtime.rb:27:in `process_action'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/abstract_controller/base.rb:136:in `process'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionview-6.0.3.7/lib/action_view/rendering.rb:39:in `process'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal.rb:190:in `dispatch'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal.rb:254:in `dispatch'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:50:in `dispatch'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:33:in `serve'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:49:in `block in serve'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in `each'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in `serve'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:834:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-dsl-2.4.0/lib/apipie_dsl/static_dispatcher.rb:67:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/static_dispatcher.rb:66:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/extractor/recorder.rb:137:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in `call'
 bebcb491 | /usr/share/foreman/lib/foreman/middleware/libvirt_connection_cleaner.rb:9:in `call'
 bebcb491 | /usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/middleware/checksum_in_headers.rb:27:in `call'
 bebcb491 | /usr/share/foreman/lib/foreman/middleware/catch_json_parse_errors.rb:9:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/tempfile_reaper.rb:15:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/etag.rb:27:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/conditional_get.rb:27:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/head.rb:12:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/http/content_security_policy.rb:18:in `call'
 bebcb491 | /usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:266:in `context'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:260:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/cookies.rb:648:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/callbacks.rb:27:in `block in call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:101:in `run_callbacks'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/callbacks.rb:26:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/actionable_exceptions.rb:18:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/debug_exceptions.rb:32:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/show_exceptions.rb:33:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.7/lib/rails/rack/logger.rb:37:in `call_app'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.7/lib/rails/rack/logger.rb:28:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/sprockets-rails-3.2.1/lib/sprockets/rails/quiet_assets.rb:13:in `call'
 bebcb491 | /usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/remote_ip.rb:81:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/request_id.rb:27:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/method_override.rb:24:in `call'
bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/runtime.rb:22:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/executor.rb:14:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/sendfile.rb:110:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/host_authorization.rb:76:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/secure_headers-6.3.0/lib/secure_headers/middleware.rb:11:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.7/lib/rails/engine.rb:527:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in `public_send'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in `method_missing'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:74:in `block in call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `each'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/puma-5.5.0/lib/puma/configuration.rb:249:in `call'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/puma-5.5.0/lib/puma/request.rb:77:in `block in handle_request'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/puma-5.5.0/lib/puma/thread_pool.rb:340:in `with_force_shutdown'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/puma-5.5.0/lib/puma/request.rb:76:in `handle_request'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/puma-5.5.0/lib/puma/server.rb:447:in `process_client'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/puma-5.5.0/lib/puma/thread_pool.rb:147:in `block in spawn_thread'
 bebcb491 | /opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
2021-12-07T00:31:39 [I|app|bebcb491]   Rendering text template
2021-12-07T00:31:39 [I|app|bebcb491]   Rendered text template (Duration: 0.0ms | Allocations: 2)
2021-12-07T00:31:39 [I|app|bebcb491] Completed 412 Precondition Failed in 21ms (Views: 1.5ms | ActiveRecord: 3.8ms | Allocations: 4987)
2021-12-07T00:31:39 [D|app|bebcb491] Cache write: _session_id:2::139671f3b066722251b08f7224f88b0afec972b76bae41598a854d2648b5ad48 ({:expires_in=>86400})
2021-12-07T00:31:40 [I|app|4035acd8] Started POST "/api/config_reports" for <ip> at 2021-12-07 00:31:40 +0100
2021-12-07T00:31:40 [I|app|4035acd8] Processing by Api::V2::ConfigReportsController#create as JSON
2021-12-07T00:31:40 [I|app|4035acd8]   Parameters: {"config_report"=>"[FILTERED]", "apiv"=>"v2"}
2021-12-07T00:31:41 [D|app|4035acd8] Client sent certificate with subject 'pp-master-test-02.ict.dev.ttw' and subject alt names '["puppet", "pp-master-test-02.ict.dev.ttw"]'
2021-12-07T00:31:41 [D|app|4035acd8] CN and SANs were extracted from a client certificate.
2021-12-07T00:31:41 [D|app|4035acd8] Verifying request from ["puppet", "pp-master-test-02.ict.dev.ttw"] against ["pp-master-test-02.ict.dev.ttw"]
2021-12-07T00:31:41 [D|app|4035acd8] Processing report: {"host"=>"pp-client-test-01.ict.dev.ttw", "reported_at"=>"2021-12-06 23:31:03 UTC", "status"=>{"applied"=>0, "restarted"=>0, "failed"=>3, "failed_restarts"=>0, "skipped"=>0, "pending"=>0}, "metrics"=>{"resources"=>{"changed"=>0, "corrective_change"=>0, "failed"=>0, "failed_to_restart"=>0, "out_of_sync"=>0, "restarted"=>0, "scheduled"=>0, "skipped"=>0, "total"=>0}, "time"=>{"fact_generation"=>22.206716384738684, "plugin_sync"=>10.05919748172164, "startup_time"=>0.830165178, "total"=>37.339556762}, "changes"=>{"total"=>0}, "events"=>{"failure"=>0, "success"=>0, "total"=>0}}, "logs"=>[{"log"=>{"sources"=>{"source"=>"//pp-client-test-01.ict.dev.ttw/Puppet"}, "messages"=>{"message"=>"Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Failed when searching for node pp-client-test-01.ict.dev.ttw: Failed to find pp-client-test-01.ict.dev.ttw via exec: Execution of '/etc/puppetlabs/puppet/node.rb pp-client-test-01.ict.dev.ttw' returned 1: "}, "level"=>"err"}}, {"log"=>{"sources"=>{"source"=>"//pp-client-test-01.ict.dev.ttw/Puppet"}, "messages"=>{"message"=>"Failed to apply catalog: Got nil value for name"}, "level"=>"err"}}]}
2021-12-07T00:31:41 [I|app|4035acd8] Scanning report with: Foreman::PuppetReportScanner
2021-12-07T00:31:41 [D|app|4035acd8] Changes after reporter specific data added: {"host_id"=>[nil, 2], "reported_at"=>[nil, Mon, 06 Dec 2021 23:31:03 UTC +00:00], "status"=>[nil, 3145728], "metrics"=>[nil, "---\nresources: !ruby/hash:ActiveSupport::HashWithIndifferentAccess\n  changed: 0\n  corrective_change: 0\n  failed: 0\n  failed_to_restart: 0\n  out_of_sync: 0\n  restarted: 0\n  scheduled: 0\n  skipped: 0\n  total: 0\ntime: !ruby/hash:ActiveSupport::HashWithIndifferentAccess\n  fact_generation: 22.206716384738684\n  plugin_sync: 10.05919748172164\n  startup_time: 0.830165178\n  total: 37.339556762\nchanges: !ruby/hash:ActiveSupport::HashWithIndifferentAccess\n  total: 0\nevents: !ruby/hash:ActiveSupport::HashWithIndifferentAccess\n  failure: 0\n  success: 0\n  total: 0\n"], "origin"=>[nil, "Puppet"]}
2021-12-07T00:31:41 [D|app|4035acd8] no owner or recipients for alert on pp-client-test-01.ict.dev.ttw
2021-12-07T00:31:41 [I|app|4035acd8] Imported report for pp-client-test-01.ict.dev.ttw in 98.5 ms, status refreshed in 17.6 ms
2021-12-07T00:31:41 [I|app|4035acd8]   Rendering api/v2/config_reports/create.json.rabl
2021-12-07T00:31:41 [I|app|4035acd8]   Rendered api/v2/config_reports/create.json.rabl (Duration: 7.5ms | Allocations: 1568)
2021-12-07T00:31:41 [D|app|4035acd8] Body: {"metrics":{"resources":{"changed":0,"corrective_change":0,"failed":0,"failed_to_restart":0,"out_of_sync":0,"restarted":0,"scheduled":0,"skipped":0,"total":0},"time":{"fact_generation":22.206716384738684,"plugin_sync":10.05919748172164,"startup_time":0.830165178,"total":37.339556762},"changes":{"total":0},"events":{"failure":0,"success":0,"total":0}},"created_at":"2021-12-06 23:31:41 UTC","updated_at":"2021-12-06 23:31:41 UTC","id":1
2141,"host_id":2,"host_name":"pp-client-test-01.ict.dev.ttw","reported_at":"2021-12-06 23:31:03 UTC","status":{"applied":0,"restarted":0,"failed":3,"failed_restarts":0,"skipped":0,"pending":0},"origin":"Puppet"}
2021-12-07T00:31:41 [I|app|4035acd8] Completed 201 Created in 251ms (Views: 27.4ms | ActiveRecord: 74.0ms | Allocations: 51874)
2021-12-07T00:31:42 [D|app|4035acd8] Cache write: _session_id:2::20f93011213ddac9ef16b90283b42068d0a772755d39c4e3a77253ab0891eb48 ({:expires_in=>86400})
2021-12-07T00:31:42 [I|app|4035acd8] Fork detected, re-connecting child process...
2021-12-07T00:31:42 [D|app|4035acd8] #<Dalli::NetworkError: Fork detected, re-connecting child process...>
2021-12-07T00:31:42 [D|app|4035acd8] retrying request with new server
2021-12-07T00:31:42 [D|app|4035acd8] Dalli::Server#connect pp-master-test-02.ict.dev.ttw:11211
5

Hi @cooler22 :slight_smile:

Have you run foreman-rake db:migrate after the installation of the plugin?
Those tables should be created by that rake task if the plugin is installed.

6

@ekohl - thx for the hint after installation of the package and doing foreman-rake db:migrate and db:seed the foreman-UI appears and i can login. I also can confirm that node.rb-script executions works again.

but its a little bit scary that with change from 3.1 RC1 to RC2 there appears such a significant change that the whole system doesnt work any more.

7

I’m not sure here, but I don’t think the node could have worked in RC1 without the plugin. The code is missing from Foreman core for quite a while. I don’t think we’ve made any drastic changes between RC1 and RC2.

8

as i said, it worked before thats why i am confused, that i updated and then it worked not even more.
but i added that package now to installation routine of our puppet config.

hopefully we will not have such problems with the stable version :slight_smile:

1 Like
9

Indeed, that really should not happen so it’s important to understand why. Is there anything in /var/log? Yum and RPM should log there. How did you upgrade from RC1 to RC2? If you used the installer, is there any log there?

10

Oh, and if you use the Puppet modules directly I would expect that including foreman::plugin::puppet in your manifest should be sufficient.

11

i updated via YUM-update an did after that a puppetrun with no node.rb-script execution. In that it db-migrates the version.

but nice now it is working :slight_smile: