DHCP time out when building machines (ERF12-6899)

Problem:
ERF12-6899 and dhcp timeout when deploying OS in discovery boot state.
We use UEFI, Grub2, Windows Server 2019, ubuntu 20.04.

OS: ubuntu 20.04

isc dhcp.conf

# READ: This file was written the foreman-installer and not by the Foreman
# application. Any updates to subnets in the Foreman database are not
# automatically reflected in this configuration and vice versa. Configuration
# updates like DNS servers or adding/removing subnets must be done both in
# Foreman application and in this configuration preferably via
# foreman-installer. Use custom-hiera.yaml for multiple subnets.
omapi-port 7911;

default-lease-time 43200;
max-lease-time 86400;


#not authoritative;


ddns-update-style none;

option domain-name "local.domain";
option domain-name-servers 10.170.0.17;
option ntp-servers none;

allow booting;
allow bootp;

option fqdn.no-client-update    on;  # set the "O" and "S" flag bits
option fqdn.rcode2            255;
option pxegrub code 150 = text ;


# required for UEFI HTTP boot
#if substring(option vendor-class-identifier, 0, 10) = "HTTPClient" {
#  option vendor-class-identifier "HTTPClient";
#}
# promote vendor in dhcpd.leases
#set vendor-string = option vendor-class-identifier;
# next server and filename options
next-server 10.171.255.241;
option architecture code 93 = unsigned integer 16 ;
if option architecture = 00:06 {
  filename "grub2/bootia32.efi";
} elsif option architecture = 00:07 {
  filename "grub2/bootx64.efi";
} elsif option architecture = 00:09 {
  filename "grub2/bootx64.efi";
} else {
  filename "pxelinux.0";
}

log-facility local7;

include "/etc/dhcp/dhcpd.hosts";
# local.domain
subnet 10.171.240.0 netmask 255.255.240.0 {
  pool
  {
    range 10.171.240.1 10.171.255.240;
  }

  option subnet-mask 255.255.240.0;
  option routers 10.171.255.254;
}

proxy.log

2022-05-15T19:10:16  [D] accept: 10.171.255.241:45890
2022-05-15T19:10:16  [D] Rack::Handler::WEBrick is invoked.
2022-05-15T19:10:16 a352283c [I] Started GET /dhcp/10.171.240.0/mac/d4:f5:ef:5a:97:04
2022-05-15T19:10:16 a352283c [D] verifying remote client 10.171.255.241 against trusted_hosts ["bc-master-01.local.domain"]
2022-05-15T19:10:16 a352283c [I] Finished GET /dhcp/10.171.240.0/mac/d4:f5:ef:5a:97:04 with 200 (0.54 ms)
2022-05-15T19:10:16  [D] close: 10.171.255.241:45890
2022-05-15T19:10:16  [D] accept: 10.171.255.241:45892
2022-05-15T19:10:16  [D] Rack::Handler::WEBrick is invoked.
2022-05-15T19:10:16 a352283c [I] Started GET /dhcp/10.171.240.0/ip/10.171.240.4
2022-05-15T19:10:16 a352283c [D] verifying remote client 10.171.255.241 against trusted_hosts ["bc-master-01.local.domain"]
2022-05-15T19:10:16 a352283c [I] Finished GET /dhcp/10.171.240.0/ip/10.171.240.4 with 200 (0.41 ms)
2022-05-15T19:10:16  [D] close: 10.171.255.241:45892
2022-05-15T19:10:17  [D] accept: 10.171.255.241:45894
2022-05-15T19:10:17  [D] Rack::Handler::WEBrick is invoked.
2022-05-15T19:10:17 a352283c [I] Started POST /dhcp/10.171.240.0
2022-05-15T19:10:17 a352283c [D] verifying remote client 10.171.255.241 against trusted_hosts ["bc-master-01.local.domain"]
2022-05-15T19:10:17 a352283c [D] omshell> server 127.0.0.1
2022-05-15T19:10:17 a352283c [D] omshell> port 7911
2022-05-15T19:10:17 a352283c [D] omshell> connect
2022-05-15T19:10:17 a352283c [D] omshell> new host
2022-05-15T19:10:17 a352283c [D] omshell> set name = "dwerwer.local.domain"
2022-05-15T19:10:17 a352283c [D] omshell> set ip-address = 10.171.240.4
2022-05-15T19:10:17 a352283c [D] omshell> set hardware-address = d4:f5:ef:5a:97:04
2022-05-15T19:10:17 a352283c [D] omshell> set hardware-type = 1
2022-05-15T19:10:17 a352283c [D] omshell> set statements = "option host-name = \"dwerwer.local.domain\";"
2022-05-15T19:10:17 a352283c [D] omshell> create
2022-05-15T19:11:05  [D] Starting allocated ip addresses cleanup pass...
2022-05-15T19:12:05  [D] Starting allocated ip addresses cleanup pass...

production.log

2022-05-15T19:11:17 [W|app|a352283c] Create DHCP Settings for dwerwer.local.domain task failed with the following error: ERF12-6899 [ProxyAPI::ProxyException]: Unable to set DHCP entry ([RestClient::Exceptions::ReadTimeout]: Timed out reading data from server) for proxy https://bc-master-01.local.domain:8443/dhcp
2022-05-15T19:11:17 [I|app|a352283c] Backtrace for 'Create DHCP Settings for dwerwer.local.domain task failed with the following error: ERF12-6899 [ProxyAPI::ProxyException]: Unable to set DHCP entry ([RestClient::Exceptions::ReadTimeout]: Timed out reading data from server) for proxy https://bc-master-01.local.domain:8443/dhcp' error (ProxyAPI::ProxyException): ERF12-6899 [ProxyAPI::ProxyException]: Unable to set DHCP entry ([RestClient::Exceptions::ReadTimeout]: Timed out reading data from server) for proxy https://bc-master-01.local.domain:8443/dhcp
 a352283c | /usr/share/foreman/app/services/proxy_api/dhcp.rb:89:in `rescue in set'
 a352283c | /usr/share/foreman/app/services/proxy_api/dhcp.rb:84:in `set'
 a352283c | /usr/share/foreman/lib/net/dhcp/record.rb:43:in `create'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration/dhcp.rb:62:in `block in set_dhcp'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration/dhcp.rb:62:in `all?'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration/dhcp.rb:62:in `set_dhcp'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration.rb:227:in `execute'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration.rb:152:in `block in process'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration.rb:144:in `each'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration.rb:144:in `process'
 a352283c | /usr/share/foreman/app/models/concerns/orchestration.rb:44:in `around_save_orchestration'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:139:in `run_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:825:in `_run_save_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/callbacks.rb:327:in `create_or_update'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/timestamp.rb:128:in `create_or_update'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/persistence.rb:470:in `save'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/validations.rb:47:in `save'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/transactions.rb:314:in `block in save'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/transactions.rb:375:in `block in with_transaction_returning_status'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `block in transaction'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract/transaction.rb:280:in `block in within_new_transaction'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in synchronize'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract/transaction.rb:278:in `within_new_transaction'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `transaction'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/transactions.rb:212:in `transaction'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/transactions.rb:366:in `with_transaction_returning_status'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/transactions.rb:314:in `save'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/suppressor.rb:44:in `save'
 a352283c | /usr/share/foreman/app/models/concerns/foreman/sti.rb:26:in `save'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/foreman_discovery-21.0.0/app/controllers/discovered_hosts_controller.rb:85:in `block in perform_update'
 a352283c | /usr/share/foreman/app/models/taxonomy.rb:73:in `block in no_taxonomy_scope'
 a352283c | /usr/share/foreman/app/models/taxonomy.rb:80:in `block (2 levels) in as_taxonomy'
 a352283c | /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:195:in `as_location'
 a352283c | /usr/share/foreman/app/models/taxonomy.rb:79:in `block in as_taxonomy'
 a352283c | /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:154:in `as_org'
 a352283c | /usr/share/foreman/app/models/taxonomy.rb:78:in `as_taxonomy'
 a352283c | /usr/share/foreman/app/models/taxonomy.rb:72:in `no_taxonomy_scope'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/foreman_discovery-21.0.0/app/controllers/discovered_hosts_controller.rb:82:in `perform_update'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/foreman_discovery-21.0.0/app/controllers/discovered_hosts_controller.rb:78:in `update'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal/basic_implicit_render.rb:6:in `send_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/abstract_controller/base.rb:195:in `process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal/rendering.rb:30:in `process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/abstract_controller/callbacks.rb:42:in `block in process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:112:in `block in run_callbacks'
 a352283c | /usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in `set_timezone'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
 a352283c | /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in `clear_thread'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
 a352283c | /usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in `set_topbar_sweeper_controller'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/audited-4.10.0/lib/audited/sweeper.rb:14:in `around'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/audited-4.10.0/lib/audited/sweeper.rb:14:in `around'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:139:in `run_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/abstract_controller/callbacks.rb:41:in `process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal/rescue.rb:22:in `process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal/instrumentation.rb:33:in `block in process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/notifications.rb:180:in `block in instrument'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/notifications/instrumenter.rb:24:in `instrument'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/notifications.rb:180:in `instrument'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal/instrumentation.rb:32:in `process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal/params_wrapper.rb:245:in `process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activerecord-6.0.3.7/lib/active_record/railties/controller_runtime.rb:27:in `process_action'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/abstract_controller/base.rb:136:in `process'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionview-6.0.3.7/lib/action_view/rendering.rb:39:in `process'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal.rb:190:in `dispatch'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_controller/metal.rb:254:in `dispatch'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:50:in `dispatch'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:33:in `serve'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:49:in `block in serve'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in `each'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/journey/router.rb:32:in `serve'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/routing/route_set.rb:834:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/apipie-dsl-2.4.0/lib/apipie_dsl/static_dispatcher.rb:67:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/apipie-rails-0.5.19/lib/apipie/static_dispatcher.rb:66:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/apipie-rails-0.5.19/lib/apipie/extractor/recorder.rb:137:in `call'
 a352283c | /usr/share/foreman/lib/foreman/middleware/libvirt_connection_cleaner.rb:9:in `call'
 a352283c | /usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/apipie-rails-0.5.19/lib/apipie/middleware/checksum_in_headers.rb:27:in `call'
 a352283c | /usr/share/foreman/lib/foreman/middleware/catch_json_parse_errors.rb:9:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/tempfile_reaper.rb:15:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/etag.rb:27:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/conditional_get.rb:40:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/head.rb:12:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/http/content_security_policy.rb:18:in `call'
 a352283c | /usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:266:in `context'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:260:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/cookies.rb:648:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/callbacks.rb:27:in `block in call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/callbacks.rb:101:in `run_callbacks'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/callbacks.rb:26:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/actionable_exceptions.rb:18:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/debug_exceptions.rb:32:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/show_exceptions.rb:33:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/railties-6.0.3.7/lib/rails/rack/logger.rb:37:in `call_app'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/railties-6.0.3.7/lib/rails/rack/logger.rb:28:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/sprockets-rails-3.4.2/lib/sprockets/rails/quiet_assets.rb:13:in `call'
 a352283c | /usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/remote_ip.rb:81:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/request_id.rb:27:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/method_override.rb:24:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/runtime.rb:22:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/activesupport-6.0.3.7/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/executor.rb:14:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/static.rb:126:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/sendfile.rb:110:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/actionpack-6.0.3.7/lib/action_dispatch/middleware/host_authorization.rb:76:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/secure_headers-6.3.3/lib/secure_headers/middleware.rb:11:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/railties-6.0.3.7/lib/rails/engine.rb:527:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in `public_send'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/railties-6.0.3.7/lib/rails/railtie.rb:190:in `method_missing'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/urlmap.rb:74:in `block in call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `each'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/puma-5.6.2/lib/puma/configuration.rb:252:in `call'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/puma-5.6.2/lib/puma/request.rb:77:in `block in handle_request'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/puma-5.6.2/lib/puma/thread_pool.rb:340:in `with_force_shutdown'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/puma-5.6.2/lib/puma/request.rb:76:in `handle_request'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/puma-5.6.2/lib/puma/server.rb:441:in `process_client'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/puma-5.6.2/lib/puma/thread_pool.rb:147:in `block in spawn_thread'
 a352283c | /usr/share/foreman/vendor/ruby/2.7.0/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
2022-05-15T19:11:17 [W|app|a352283c] Rolling back due to a problem: [#<Orchestration::Task:0x00007f31048e77b8 @name="Create DHCP Settings for dwerwer.local.domain", @id="dhcp_create_d4:f5:ef:5a:97:04", @status="failed", @priority=9, @action=[#<Nic::Managed id: 299, mac: "d4:f5:ef:5a:97:04", ip: "10.171.240.4", type: "Nic::Managed", name: "dwerwer.local.domain", host_id: 45, subnet_id: 1, domain_id: 1, attrs: {"mtu"=>1500, "bindings"=>[{"address"=>"10.171.240.4", "netmask"=>"255.255.240.0", "network"=>"10.171.240.0"}], "bindings6"=>[{"address"=>"fe80::d6f5:efff:fe5a:9704", "netmask"=>"ffff:ffff:ffff:ffff::", "network"=>"fe80::", "scope6"=>"link"}], "netmask"=>"255.255.240.0", "network"=>"10.171.240.0", "netmask6"=>"ffff:ffff:ffff:ffff::", "network6"=>"fe80::", "scope6"=>"link"}, created_at: "2022-05-15 08:56:08", updated_at: "2022-05-15 08:56:09", provider: nil, username: nil, password: nil, virtual: false, link: true, identifier: "eno5", tag: "", attached_to: "", managed: true, mode: "balance-rr", attached_devices: "", bond_options: "", primary: true, provision: true, compute_attributes: {}, ip6: "", subnet6_id: nil>, :set_dhcp], @created=1652609416.9555197, @timestamp=2022-05-15 10:11:17.120060935 UTC>]
2022-05-15T19:11:17 [E|app|a352283c] Failed to save: Create DHCP Settings for dwerwer.local.domain task failed with the following error: ERF12-6899 [ProxyAPI::ProxyException]: Unable to set DHCP entry ([RestClient::Exceptions::ReadTimeout]: Timed out reading data from server) for proxy https://bc-master-01.local.domain:8443/dhcp
2022-05-15T19:11:17 [I|app|a352283c]   Rendering vendor/ruby/2.7.0/gems/foreman_discovery-21.0.0/app/views/discovered_hosts/edit.html.erb within layouts/application
2022-05-15T19:11:17 [I|app|a352283c]   Rendered hosts/_progress.html.erb (Duration: 0.1ms | Allocations: 64)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/hosts/foreman_puppet/_form_main_tab_fields.html.erb (Duration: 4.3ms | Allocations: 2111)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered collection of vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/foreman_puppet/puppetclasses/_selected_classes.html.erb [0 times] (Duration: 0.0ms | Allocations: 3)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered collection of vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/foreman_puppet/puppetclasses/_classes_in_groups.html.erb [0 times] (Duration: 0.0ms | Allocations: 3)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/foreman_puppet/puppetclasses/_classes.html.erb (Duration: 0.0ms | Allocations: 11)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/foreman_puppet/puppetclasses/_class_selection.html.erb (Duration: 27.9ms | Allocations: 15545)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered collection of vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/foreman_puppet/puppetclasses/_class_parameters.html.erb [0 times] (Duration: 0.0ms | Allocations: 3)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/foreman_puppet/puppetclasses/_classes_parameters.html.erb (Duration: 5.8ms | Allocations: 3101)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered vendor/ruby/2.7.0/gems/foreman_puppet-3.0.6/app/views/hosts/_form_puppet_enc_tab.html.erb (Duration: 34.8ms | Allocations: 19161)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 29.8ms | Allocations: 17192)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_virtual_form.html.erb (Duration: 0.8ms | Allocations: 865)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.0ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/manageds/_managed.html.erb (Duration: 31.5ms | Allocations: 18823)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 27.0ms | Allocations: 16774)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_virtual_form.html.erb (Duration: 0.8ms | Allocations: 865)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.0ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/manageds/_managed.html.erb (Duration: 28.7ms | Allocations: 18405)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 26.7ms | Allocations: 16774)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_virtual_form.html.erb (Duration: 0.7ms | Allocations: 865)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.0ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/manageds/_managed.html.erb (Duration: 28.3ms | Allocations: 18405)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 27.5ms | Allocations: 16774)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_virtual_form.html.erb (Duration: 0.8ms | Allocations: 865)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.1ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/manageds/_managed.html.erb (Duration: 29.3ms | Allocations: 18405)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 26.3ms | Allocations: 16856)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_virtual_form.html.erb (Duration: 0.7ms | Allocations: 865)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.0ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/manageds/_managed.html.erb (Duration: 28.2ms | Allocations: 18487)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 27.0ms | Allocations: 16774)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_virtual_form.html.erb (Duration: 0.7ms | Allocations: 865)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.0ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/manageds/_managed.html.erb (Duration: 28.7ms | Allocations: 18405)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 27.7ms | Allocations: 16784)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.0ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/bmcs/_bmc.html.erb (Duration: 29.4ms | Allocations: 18184)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_base_form.html.erb (Duration: 27.7ms | Allocations: 17613)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_virtual_form.html.erb (Duration: 0.7ms | Allocations: 860)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/_provider_specific_form.html.erb (Duration: 0.0ms | Allocations: 6)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered nic/manageds/_managed.html.erb (Duration: 29.3ms | Allocations: 19229)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered hosts/_interfaces.html.erb (Duration: 236.4ms | Allocations: 149898)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered common/os_selection/_architecture.html.erb (Duration: 2.6ms | Allocations: 1217)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered common/os_selection/_pxe_loader.html.erb (Duration: 0.7ms | Allocations: 712)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered common/os_selection/_operatingsystem.html.erb (Duration: 15.4ms | Allocations: 8340)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered hosts/provision_method/build/_form.html.erb (Duration: 16.1ms | Allocations: 9018)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered hosts/provision_method/image/_form.html.erb (Duration: 0.0ms | Allocations: 13)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered hosts/_operating_system.html.erb (Duration: 21.4ms | Allocations: 11990)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered hosts/_unattended.html.erb (Duration: 21.6ms | Allocations: 12073)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered common_parameters/_inherited_parameters.html.erb (Duration: 1.1ms | Allocations: 1428)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered common_parameters/_parameter.html.erb (Duration: 1.0ms | Allocations: 1029)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered common_parameters/_parameters.html.erb (Duration: 2.6ms | Allocations: 1837)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered hosts/_form.html.erb (Duration: 349.0ms | Allocations: 211767)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered vendor/ruby/2.7.0/gems/foreman_discovery-21.0.0/app/views/discovered_hosts/edit.html.erb within layouts/application (Duration: 349.2ms | Allocations: 211865)
2022-05-15T19:11:17 [I|app|a352283c]   Rendered layouts/_application_content.html.erb (Duration: 0.5ms | Allocations: 271)
2022-05-15T19:11:17 [I|app|a352283c]   Rendering layouts/base.html.erb
2022-05-15T19:11:17 [I|app|a352283c]   Rendered layouts/base.html.erb (Duration: 12.4ms | Allocations: 13886)
2022-05-15T19:11:17 [I|app|a352283c] Completed 200 OK in 60729ms (Views: 344.2ms | ActiveRecord: 36.0ms | Allocations: 365872)
2022-05-15T19:11:18 [I|app|511c49a6] Started GET "/tasks/9e5ba07c-c1cc-455c-baf8-9fbbbafbdc2a" for 10.10.30.224 at 2022-05-15 19:11:18 +0900
2022-05-15T19:11:18 [I|app|511c49a6] Processing by TasksController#show as */*
2022-05-15T19:11:18 [I|app|511c49a6]   Parameters: {"id"=>"9e5ba07c-c1cc-455c-baf8-9fbbbafbdc2a"}
2022-05-15T19:11:18 [I|app|511c49a6]   Rendered tasks/_list.html.erb (Duration: 0.2ms | Allocations: 328)
2022-05-15T19:11:18 [I|app|511c49a6] Completed 200 OK in 5ms (Views: 0.7ms | ActiveRecord: 0.7ms | Allocations: 2116)
2022-05-15T19:11:19 [I|app|b9e725ac] Started POST "/api/v2/discovered_hosts/facts" for 10.171.240.4 at 2022-05-15 19:11:19 +0900
2022-05-15T19:11:19 [I|app|b9e725ac] Processing by Api::V2::DiscoveredHostsController#facts as JSON
2022-05-15T19:11:19 [I|app|b9e725ac]   Parameters: {"facts"=>"[FILTERED]", "apiv"=>"v2", "discovered_host"=>{"facts"=>"[FILTERED]"}}
2022-05-15T19:11:19 [I|app|b9e725ac] Import facts for 'macd4f5ef5a9704' completed. Added: 0, Updated: 0, Deleted 0 facts
2022-05-15T19:11:19 [I|app|b9e725ac] Detected IPv4 subnet: 10.171.240.0 with taxonomy ["Default Organization"]/["Default Location"]
2022-05-15T19:11:19 [I|app|b9e725ac] Assigned location: Default Location
2022-05-15T19:11:19 [I|app|b9e725ac] Assigned organization: Default Organization
2022-05-15T19:11:19 [I|app|b9e725ac] Completed 201 Created in 166ms (Views: 0.9ms | ActiveRecord: 39.8ms | Allocations: 47979)
2022-05-15T19:11:21 [I|app|096dd0b2] Started GET "/notification_recipients" for 10.10.30.224 at 2022-05-15 19:11:21 +0900
2022-05-15T19:11:21 [I|app|096dd0b2] Processing by NotificationRecipientsController#index as JSON
2022-05-15T19:11:21 [I|app|096dd0b2] Completed 200 OK in 7ms (Views: 0.1ms | ActiveRecord: 0.9ms | Allocations: 2234)
2022-05-15T19:11:21 [I|app|096349a1] Started GET "/notification_recipients" for 10.10.30.224 at 2022-05-15 19:11:21 +0900
2022-05-15T19:11:21 [I|app|096349a1] Processing by NotificationRecipientsController#index as JSON
2022-05-15T19:11:21 [I|app|096349a1] Completed 200 OK in 6ms (Views: 0.1ms | ActiveRecord: 0.8ms | Allocations: 2218)

Expected outcome:

Foreman and Proxy versions:
3.2.0
Foreman and Proxy plugin versions:
ruby-foreman-discovery: 21.0.0
Distribution and version:

Other relevant data:

It might be useful to have a packet trace of the DHCP exchange, or a log from the DHCP server. My guess is that there is something wrong there.

1 Like