Hi,
Can someone please help. I’m running Katello 4.4.2.2 and Foreman 3.2.1. I’m trying to update the classes in my environments and foreman keeps failing with the error "ERF12-4115 [ProxyAPI::ProxyException]: Unable to get classes from Puppet for development ([RestClient::NotAcceptable]: 406 Not Acceptable) for proxy https://test.local:9093/puppet. Is this a known bug or something related to puppet plugin no longer in the core of foreman by default?
It would seem like out of my two environments - production and development - the error is only triggered by the the development environment as when I import just the production environment it works as expected.
It’s been a while since I have ran an import on the development environment so I’m not sure what could have changed between the last time and now to cause this.
The /etc/puppetlabs/puppetserver/conf.d/auth.conf contents is:
Managed by Puppet
authorization: {
version: 1
allow-header-cert-info: false
rules: [
{
# Allow nodes to retrieve their own catalog
match-request: {
path: “^/puppet/v3/catalog/([^/]+)$”
type: regex
method: [get, post]
}
“allow”: [
“$1”
]
sort-order: 500
name: “puppetlabs v3 catalog from agents”
},
{
# Allow services to retrieve catalogs on behalf of others
match-request: {
path: “^/puppet/v4/catalog/?$”
type: regex
method: post
}
deny: “"
sort-order: 500
name: “puppetlabs v4 catalog for services”
},
{
# Allow nodes to retrieve the certificate they requested earlier
match-request: {
path: “/puppet-ca/v1/certificate/”
type: path
method: get
}
allow-unauthenticated: true
sort-order: 500
name: “puppetlabs certificate”
},
{
# Allow all nodes to access the certificate revocation list
match-request: {
path: “/puppet-ca/v1/certificate_revocation_list/ca”
type: path
method: get
}
allow-unauthenticated: true
sort-order: 500
name: “puppetlabs crl”
},
{
# Allow nodes to request a new certificate
match-request: {
path: “/puppet-ca/v1/certificate_request”
type: path
method: [get, put]
}
allow-unauthenticated: true
sort-order: 500
name: “puppetlabs csr”
},
{
# Allow the CA CLI to access the certificate_status endpoint
match-request: {
path: “/puppet-ca/v1/certificate_status”
type: path
method: [get, put, delete]
}
allow: [
“localhost”,
“test.local”,
{
extensions: {
pp_cli_auth: “true”
}
}
]
sort-order: 500
name: “puppetlabs cert status”
},
{
# Allow the CA CLI to access the certificate_statuses endpoint
match-request: {
path: “/puppet-ca/v1/certificate_statuses”
type: path
method: get
}
allow: [
“localhost”,
“test.local”,
{
extensions: {
pp_cli_auth: “true”
}
}
]
sort-order: 500
name: “puppetlabs cert statuses”
},
{
# Allow authenticated access to the CA expirations endpoint
match-request: {
path: “/puppet-ca/v1/expirations”
type: path
method: get
}
allow: "”
sort-order: 500
name: “puppetlabs CA cert and CRL expirations”
},
{
# Allow the CA CLI to access the certificate clean endpoint
match-request: {
path: “/puppet-ca/v1/clean”
type: path
method: put
}
allow: {
extensions: {
pp_cli_auth: “true”
}
}
sort-order: 500
name: “puppetlabs cert clean”
},
{
# Allow unauthenticated access to the status service endpoint
match-request: {
path: “/status/v1/services”
type: path
method: get
}
allow-unauthenticated: true
sort-order: 500
name: “puppetlabs status service - full”
},
{
match-request: {
path: “/status/v1/simple”
type: path
method: get
}
allow-unauthenticated: true
sort-order: 500
name: “puppetlabs status service - simple”
},
{
match-request: {
path: “/puppet-admin-api/v1/environment-cache”
type: path
method: delete
}
allow: [
“localhost”,
“test.local”,
]
sort-order: 200
name: “environment-cache”
},
{
match-request: {
path: “/puppet-admin-api/v1/jruby-pool”
type: path
method: delete
}
allow: [
“localhost”,
“test.local”,
]
sort-order: 200
name: “jruby-pool”
},
{
match-request: {
path: “/puppet/v3/environments”
type: path
method: get
}
allow: “"
sort-order: 500
name: “puppetlabs environments”
},
{
match-request: {
path: “/puppet/v3/environment_classes”
type: path
method: get
}
allow: "”
sort-order: 500
name: “puppetlabs environment classes”
},
{
# Allow nodes to access all file_bucket_files. Note that access for
# the ‘delete’ method is forbidden by Puppet regardless of the
# configuration of this rule.
match-request: {
path: “/puppet/v3/file_bucket_file”
type: path
method: [get, head, post, put]
}
allow: “"
sort-order: 500
name: “puppetlabs file bucket file”
},
{
# Allow nodes to access all file_content. Note that access for the
# ‘delete’ method is forbidden by Puppet regardless of the
# configuration of this rule.
match-request: {
path: “/puppet/v3/file_content”
type: path
method: [get, post]
}
allow: "”
sort-order: 500
name: “puppetlabs file content”
},
{
# Allow nodes to access all file_metadata. Note that access for the
# ‘delete’ method is forbidden by Puppet regardless of the
# configuration of this rule.
match-request: {
path: “/puppet/v3/file_metadata”
type: path
method: [get, post]
}
allow: “"
sort-order: 500
name: “puppetlabs file metadata”
},
{
# Allow nodes to retrieve only their own node definition
match-request: {
path: “^/puppet/v3/node/([^/]+)$”
type: regex
method: get
}
allow: “$1”
sort-order: 500
name: “puppetlabs node”
},
{
# Allow nodes to store only their own reports
match-request: {
path: “^/puppet/v3/report/([^/]+)$”
type: regex
method: put
}
allow: “$1”
sort-order: 500
name: “puppetlabs report”
},
{
# Allow nodes to update their own facts
match-request: {
path: “^/puppet/v3/facts/([^/]+)$”
type: regex
method: put
}
allow: “$1”
sort-order: 500
name: “puppetlabs facts”
},
{
match-request: {
path: “/puppet/v3/status”
type: path
method: get
}
allow-unauthenticated: true
sort-order: 500
name: “puppetlabs status”
},
{
match-request: {
path: “/puppet/v3/static_file_content”
type: path
method: get
}
allow: "”
sort-order: 500
name: “puppetlabs static file content”
},
{
match-request: {
path: “/puppet/v3/tasks”
type: path
}
allow: “"
sort-order: 500
name: “puppet tasks information”
},
{
# Allow all users access to the experimental endpoint
# which currently only provides a dashboard web ui.
match-request: {
path: “/puppet/experimental”
type: path
}
allow-unauthenticated: true
sort-order: 500
name: “puppetlabs experimental”
},
{
# Deny everything else. This ACL is not strictly
# necessary, but illustrates the default policy
match-request: {
path: “/”
type: path
}
deny: "”
sort-order: 999
name: “puppetlabs deny all”
}
]
}
The following is from production.log:
2023-02-08T09:46:58 [I|app|4c02b915] Started GET “/foreman_puppet/environments/import_environments?proxy=1-test-local” for 192.168.23.104 at 2023-02-08 09:46:58 +0000
2023-02-08T09:46:58 [I|app|4c02b915] Processing by ForemanPuppet::EnvironmentsController#import_environments as HTML
2023-02-08T09:46:58 [I|app|4c02b915] Parameters: {“proxy”=>“1-test-local”}
2023-02-08T09:47:18 [W|app|4c02b915] ProxyAPI operation FAILED
2023-02-08T09:47:18 [I|app|4c02b915] Backtrace for ‘ProxyAPI operation FAILED’ error (ProxyAPI::ProxyException): ERF12-4115 [ProxyAPI::ProxyException]: Unable to get classes from Puppet for development ([RestClient::NotAcceptable]: 406 Not Acceptable) for proxy https://test.local:9093/puppet
4c02b915 | /usr/share/foreman/app/services/proxy_api/puppet.rb:27:in rescue in classes' 4c02b915 | /usr/share/foreman/app/services/proxy_api/puppet.rb:20:in classes’
4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/services/foreman_puppet/puppet_class_importer.rb:89:in proxy_classes_for' 4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/services/foreman_puppet/puppet_class_importer.rb:204:in actual_classes’
4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/services/foreman_puppet/puppet_class_importer.rb:95:in new_classes_for' 4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/services/foreman_puppet/puppet_class_importer.rb:53:in changes_for_environment’
4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/services/foreman_puppet/puppet_class_importer.rb:27:in block in changes' 4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/services/foreman_puppet/puppet_class_importer.rb:26:in each’
4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/services/foreman_puppet/puppet_class_importer.rb:26:in changes' 4c02b915 | /usr/share/gems/gems/foreman_puppet-3.0.7/app/controllers/concerns/foreman_puppet/environments_import.rb:12:in import_environments’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/basic_implicit_render.rb:6:in send_action' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/abstract_controller/base.rb:195:in process_action’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/rendering.rb:30:in process_action' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/abstract_controller/callbacks.rb:42:in block in process_action’
4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:112:in block in run_callbacks' 4c02b915 | /usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in set_timezone’
4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in block in run_callbacks' 4c02b915 | /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in clear_thread’
4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in block in run_callbacks' 4c02b915 | /usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in set_topbar_sweeper_controller’
4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in block in run_callbacks' 4c02b915 | /usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in around’
4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in block in run_callbacks' 4c02b915 | /usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in around’
4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in block in run_callbacks' 4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:139:in run_callbacks’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/abstract_controller/callbacks.rb:41:in process_action' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/rescue.rb:22:in process_action’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/instrumentation.rb:33:in block in process_action' 4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/notifications.rb:180:in block in instrument’
4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/notifications/instrumenter.rb:24:in instrument' 4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/notifications.rb:180:in instrument’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/instrumentation.rb:32:in process_action' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal/params_wrapper.rb:245:in process_action’
4c02b915 | /usr/share/gems/gems/activerecord-6.0.3.7/lib/active_record/railties/controller_runtime.rb:27:in process_action' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/abstract_controller/base.rb:136:in process’
4c02b915 | /usr/share/gems/gems/actionview-6.0.3.7/lib/action_view/rendering.rb:39:in process' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal.rb:190:in dispatch’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_controller/metal.rb:254:in dispatch' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:50:in dispatch’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:33:in serve' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:49:in block in serve’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in each' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in serve’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:834:in call' 4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/engine.rb:527:in call’
4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in public_send' 4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in method_missing’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/mapper.rb:19:in block in <class:Constraints>' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/mapper.rb:48:in serve’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:49:in block in serve' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in each’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in serve' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:834:in call’
4c02b915 | /usr/share/gems/gems/katello-4.4.2.2/lib/katello/middleware/organization_created_enforcer.rb:18:in call' 4c02b915 | /usr/share/gems/gems/katello-4.4.2.2/lib/katello/middleware/event_daemon.rb:10:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call’
4c02b915 | /usr/share/gems/gems/apipie-dsl-2.4.0/lib/apipie_dsl/static_dispatcher.rb:67:in call' 4c02b915 | /usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/static_dispatcher.rb:66:in call’
4c02b915 | /usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/extractor/recorder.rb:137:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call' 4c02b915 | /usr/share/foreman/lib/foreman/middleware/libvirt_connection_cleaner.rb:9:in call’
4c02b915 | /usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in call' 4c02b915 | /usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/middleware/checksum_in_headers.rb:27:in call’
4c02b915 | /usr/share/foreman/lib/foreman/middleware/catch_json_parse_errors.rb:9:in call' 4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/tempfile_reaper.rb:15:in call’
4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/etag.rb:27:in call' 4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/conditional_get.rb:27:in call’
4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/head.rb:12:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/http/content_security_policy.rb:18:in call’
4c02b915 | /usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in call' 4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:266:in context’
4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:260:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/cookies.rb:648:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/callbacks.rb:27:in block in call' 4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:101:in run_callbacks’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/callbacks.rb:26:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/actionable_exceptions.rb:18:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/debug_exceptions.rb:32:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/show_exceptions.rb:33:in call’
4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/rack/logger.rb:37:in call_app' 4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/rack/logger.rb:28:in call’
4c02b915 | /usr/share/gems/gems/sprockets-rails-3.2.1/lib/sprockets/rails/quiet_assets.rb:13:in call' 4c02b915 | /usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/remote_ip.rb:81:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/request_id.rb:27:in call’
4c02b915 | /usr/share/gems/gems/katello-4.4.2.2/lib/katello/prevent_json_parsing.rb:12:in call' 4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/method_override.rb:24:in call’
4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/runtime.rb:22:in call' 4c02b915 | /usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in call’
4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/executor.rb:14:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in call’
4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/sendfile.rb:110:in call' 4c02b915 | /usr/share/gems/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/host_authorization.rb:76:in call’
4c02b915 | /usr/share/gems/gems/secure_headers-6.3.0/lib/secure_headers/middleware.rb:11:in call' 4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/engine.rb:527:in call’
4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in public_send' 4c02b915 | /usr/share/gems/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in method_missing’
4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:74:in block in call' 4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in each’
4c02b915 | /usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in call' 4c02b915 | /usr/share/gems/gems/puma-5.5.2/lib/puma/configuration.rb:249:in call’
4c02b915 | /usr/share/gems/gems/puma-5.5.2/lib/puma/request.rb:77:in block in handle_request' 4c02b915 | /usr/share/gems/gems/puma-5.5.2/lib/puma/thread_pool.rb:340:in with_force_shutdown’
4c02b915 | /usr/share/gems/gems/puma-5.5.2/lib/puma/request.rb:76:in handle_request' 4c02b915 | /usr/share/gems/gems/puma-5.5.2/lib/puma/server.rb:447:in process_client’
4c02b915 | /usr/share/gems/gems/puma-5.5.2/lib/puma/thread_pool.rb:147:in block in spawn_thread' 4c02b915 | /usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in block in create_with_logging_context’
2023-02-08T09:47:18 [I|app|4c02b915] Redirected to https://test.local/foreman_puppet/environments
2023-02-08T09:47:18 [I|app|4c02b915] Completed 302 Found in 19961ms (ActiveRecord: 721.8ms | Allocations: 3289421)
2023-02-08T09:47:18 [I|app|a59f1a90] Started GET “/foreman_puppet/environments” for 192.168.23.104 at 2023-02-08 09:47:18 +0000
2023-02-08T09:47:18 [I|app|a59f1a90] Processing by ForemanPuppet::EnvironmentsController#index as HTML
2023-02-08T09:47:18 [I|app|a59f1a90] Rendering /usr/share/gems/gems/foreman_puppet-3.0.7/app/views/foreman_puppet/environments/index.html.erb within layouts/application
2023-02-08T09:47:18 [I|app|a59f1a90] Rendered common/_pagination.html.erb (Duration: 1.3ms | Allocations: 1649)
2023-02-08T09:47:18 [I|app|a59f1a90] Rendered /usr/share/gems/gems/foreman_puppet-3.0.7/app/views/foreman_puppet/environments/index.html.erb within layouts/application (Duration: 29.4ms | Allocations: 11307)