Provisioning error

Hello,

I have an issue while provisioning a server from Foreman-katello, The server boots through PXE but got stuck on the KS pull from the server.

This from the produciton.log;

 | ActionController::RedirectBackError (No HTTP_REFERER was set in the request to this action, so redirect_to :back could not be called successfully. If this is a test, make sure to specify request.env["HTTP_REFERER"].):
 |   app/controllers/application_controller.rb:293:in `process_error'
 |   app/controllers/application_controller.rb:117:in `smart_proxy_exception'
 |   lib/middleware/catch_json_parse_errors.rb:9:in `call'
 |   lib/middleware/tagged_logging.rb:18:in `call'

And on the console it ends like this and going to dracut shell;

dracut-initqueu[562]: curl: (22) The requested URL returned error: 500 Internal server error

dracut-initqueu[562]: warning: anaconda: failed to fetch kickstart from http://prd-cs-lforeman.example.com/unattended/provision?=74118184-817f-4d00-9af0-c814-a9460c69

Can anyone help me on this?

Thanks,
Kumar

Foreman version is 1.13
Katello version is 3.2.2
Running on CentOS 7.4

Hello, your URL is wrong, there is ?=74... instead of ?token=74.....

Have you modified templates in any way? Looks like a typo. Unattended controller needs a token, this looks like an invalid URL to Rails.

Hi,

Thanks for your suggestion. I think I missed that when I manually note the error.

I have tried that again with another host but no luck.
http://prd-cs-lforeman.example.com/unattended/provision?token=1105eaf4-0828-4d4c-8618-18a62a3ec51f

What do you see in the smart proxy log at /var/log/foreman-proxy/proxy.log?

Hi James,

This is what I can see in proxy.log.

W, [2018-02-13T20:52:12.584864 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-13T20:52:12.585577 #25534] ERROR -- : Failed to remove certificate(s) for testforeman: Execution of puppetca failed, check log files
I, [2018-02-13T20:52:12.586504 #25534]  INFO -- : 10.134.130.4 - - [13/Feb/2018:20:52:12 -0800] "DELETE /puppet/ca/testforeman HTTP/1.1" 406 118 0.0222

W, [2018-02-13T20:52:14.224439 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-13T20:52:14.224919 #25534] ERROR -- : Failed to remove certificate(s) for testforeman: Execution of puppetca failed, check log files
I, [2018-02-13T20:52:14.225632 #25534]  INFO -- : 10.134.130.4 - - [13/Feb/2018:20:52:14 -0800] "DELETE /puppet/ca/testforeman.example.com HTTP/1.1" 406 118 0.0207

W, [2018-02-13T20:52:16.658634 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-13T20:52:16.659074 #25534] ERROR -- : Failed to remove certificate(s) for testforeman.example.com: Execution of puppetca failed, check log files
I, [2018-02-13T20:52:16.659745 #25534]  INFO -- : 10.134.130.4 - - [13/Feb/2018:20:52:16 -0800] "DELETE /puppet/ca/testforeman.example.com HTTP/1.1" 406 118 0.0187

W, [2018-02-13T20:52:19.098874 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-13T20:52:19.099395 #25534] ERROR -- : Failed to remove certificate(s) for testforeman.example.com: Execution of puppetca failed, check log files
I, [2018-02-13T20:52:19.100154 #25534]  INFO -- : 10.134.130.4 - - [13/Feb/2018:20:52:19 -0800] "DELETE /puppet/ca/testforeman.example.com HTTP/1.1" 406 118 0.0191

I start to thing the error is irrelevant, can you pastebin whole unattended controller request log? Do foreman-tail on server, do the request (pro provision the system) and pastebin whole transaction. Interested in response logs from /unattended requests.

Hi Lukas,

Here is the complete log…

Feb 14 11:13:56 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:bf:4a:62 to 10.210.130.4
Feb 14 11:13:56 prd-cs-lforeman dhcpd: DHCPDISCOVER from 00:50:56:bf:4a:62 via ens160
Feb 14 11:13:56 prd-cs-lforeman dhcpd: DHCPOFFER on 10.210.130.17 to 00:50:56:bf:4a:62 via ens160
Feb 14 11:13:58 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:bf:4a:62 to 10.210.130.4
Feb 14 11:13:58 prd-cs-lforeman dhcpd: DHCPREQUEST for 10.210.130.17 (10.210.130.4) from 00:50:56:bf:4a:62 via ens160
Feb 14 11:13:58 prd-cs-lforeman dhcpd: DHCPACK on 10.210.130.17 to 00:50:56:bf:4a:62 via ens160
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21103]: RRQ from 10.210.130.17 filename pxelinux.0
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21103]: tftp: client does not accept options
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21104]: RRQ from 10.210.130.17 filename pxelinux.0
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21104]: Client 10.210.130.17 finished pxelinux.0
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21105]: RRQ from 10.210.130.17 filename pxelinux.cfg/423f2e7d-a92f-24d8-6ed6-e7c02b4b69ce
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21105]: Client 10.210.130.17 File not found pxelinux.cfg/423f2e7d-a92f-24d8-6ed6-e7c02b4b69ce
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21106]: RRQ from 10.210.130.17 filename pxelinux.cfg/01-00-50-56-bf-4a-62
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21106]: Client 10.210.130.17 finished pxelinux.cfg/01-00-50-56-bf-4a-62
Feb 14 11:13:58 prd-cs-lforeman in.tftpd[21107]: RRQ from 10.210.130.17 filename boot/CentOS-7.4.1708-x86_64-vmlinuz
Feb 14 11:13:59 prd-cs-lforeman in.tftpd[21107]: Client 10.210.130.17 finished boot/CentOS-7.4.1708-x86_64-vmlinuz
Feb 14 11:13:59 prd-cs-lforeman in.tftpd[21108]: RRQ from 10.210.130.17 filename boot/CentOS-7.4.1708-x86_64-initrd.img
Feb 14 11:14:04 prd-cs-lforeman in.tftpd[21108]: Client 10.210.130.17 finished boot/CentOS-7.4.1708-x86_64-initrd.img
Feb 14 11:14:09 prd-cs-lforeman dhcpd: DHCPDISCOVER from 00:50:56:bf:4a:62 via ens160
Feb 14 11:14:09 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:bf:4a:62 to 10.210.130.4
Feb 14 11:14:09 prd-cs-lforeman dhcpd: DHCPOFFER on 10.210.130.17 to 00:50:56:bf:4a:62 via ens160
Feb 14 11:14:09 prd-cs-lforeman dhcpd: DHCPREQUEST for 10.210.130.235 (10.210.130.182) from 00:50:56:bf:4a:62 via ens160: lease 10.210.130.235 unavailable.
Feb 14 11:14:09 prd-cs-lforeman dhcpd: DHCPNAK on 10.210.130.235 to 00:50:56:bf:4a:62 via ens160
Feb 14 11:14:09 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:bf:4a:62 to 10.210.130.4

==> /var/log/foreman/production.log <==
2018-02-14 11:14:13 55c6e379 [app] [I] Started GET "/unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e" for 10.210.130.235 at 2018-02-14 11:14:13 -0800


==> /var/log/httpd/foreman_access.log <==
10.210.130.235 - - [14/Feb/2018:11:14:13 -0800] "GET /unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e HTTP/1.1" 500 1477 "-" "curl/7.29.0"

==> /var/log/foreman-proxy/proxy.log <==
W, [2018-02-14T11:14:13.506228 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-14T11:14:13.506856 #25534] ERROR -- : Failed to remove certificate(s) for testforeman.example: Execution of puppetca failed, check log files
I, [2018-02-14T11:14:13.507843 #25534]  INFO -- : 10.210.130.4 - - [14/Feb/2018:11:14:13 -0800] "DELETE /puppet/ca/testforeman.example HTTP/1.1" 406 118 0.0387


==> /var/log/foreman/production.log <==
2018-02-14 11:14:13 55c6e379 [app] [I] Processing by UnattendedController#host_template as TEXT
2018-02-14 11:14:13 55c6e379 [app] [I]   Parameters: {"token"=>"bd5eb587-1819-43be-b00e-c94841d4b35e", "kind"=>"provision"}
2018-02-14 11:14:14 55c6e379 [app] [I] Redirected to
2018-02-14 11:14:14 55c6e379 [app] [I] Completed 500 Internal Server Error in 675ms (ActiveRecord: 4.2ms)
2018-02-14 11:14:14 55c6e379 [app] [F]
 | ActionController::RedirectBackError (No HTTP_REFERER was set in the request to this action, so redirect_to :back could not be called successfully. If this is a test, make sure to specify request.env["HTTP_REFERER"].):
 |   app/controllers/application_controller.rb:293:in `process_error'
 |   app/controllers/application_controller.rb:117:in `smart_proxy_exception'
 |   lib/middleware/catch_json_parse_errors.rb:9:in `call'
 |   lib/middleware/tagged_logging.rb:18:in `call'
 |
 |

==> /var/log/httpd/foreman_access.log <==
10.210.130.235 - - [14/Feb/2018:11:14:15 -0800] "GET /unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e HTTP/1.1" 500 1477 "-" "curl/7.29.0"

==> /var/log/foreman-proxy/proxy.log <==
W, [2018-02-14T11:14:15.569410 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-14T11:14:15.569863 #25534] ERROR -- : Failed to remove certificate(s) for testforeman.example: Execution of puppetca failed, check log files
I, [2018-02-14T11:14:15.570570 #25534]  INFO -- : 10.210.130.4 - - [14/Feb/2018:11:14:15 -0800] "DELETE /puppet/ca/testforeman.example HTTP/1.1" 406 118 0.0187


==> /var/log/foreman/production.log <==
2018-02-14 11:14:15 3acd4a42 [app] [I] Started GET "/unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e" for 10.210.130.235 at 2018-02-14 11:14:15 -0800
2018-02-14 11:14:15 3acd4a42 [app] [I] Processing by UnattendedController#host_template as TEXT
2018-02-14 11:14:15 3acd4a42 [app] [I]   Parameters: {"token"=>"bd5eb587-1819-43be-b00e-c94841d4b35e", "kind"=>"provision"}
2018-02-14 11:14:15 3acd4a42 [app] [I] Redirected to
2018-02-14 11:14:15 3acd4a42 [app] [I] Completed 500 Internal Server Error in 96ms (ActiveRecord: 2.5ms)
2018-02-14 11:14:15 3acd4a42 [app] [F]
 | ActionController::RedirectBackError (No HTTP_REFERER was set in the request to this action, so redirect_to :back could not be called successfully. If this is a test, make sure to specify request.env["HTTP_REFERER"].):
 |   app/controllers/application_controller.rb:293:in `process_error'
 |   app/controllers/application_controller.rb:117:in `smart_proxy_exception'
 |   lib/middleware/catch_json_parse_errors.rb:9:in `call'
 |   lib/middleware/tagged_logging.rb:18:in `call'
 |
 |

==> /var/log/httpd/foreman_access.log <==
10.210.130.235 - - [14/Feb/2018:11:14:17 -0800] "GET /unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e HTTP/1.1" 500 1477 "-" "curl/7.29.0"

==> /var/log/foreman-proxy/proxy.log <==
W, [2018-02-14T11:14:17.766217 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-14T11:14:17.766674 #25534] ERROR -- : Failed to remove certificate(s) for testforeman.example: Execution of puppetca failed, check log files
I, [2018-02-14T11:14:17.767389 #25534]  INFO -- : 10.210.130.4 - - [14/Feb/2018:11:14:17 -0800] "DELETE /puppet/ca/testforeman.example HTTP/1.1" 406 118 0.0191


==> /var/log/foreman/production.log <==
2018-02-14 11:14:17 552d5c11 [app] [I] Started GET "/unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e" for 10.210.130.235 at 2018-02-14 11:14:17 -0800
2018-02-14 11:14:17 552d5c11 [app] [I] Processing by UnattendedController#host_template as TEXT
2018-02-14 11:14:17 552d5c11 [app] [I]   Parameters: {"token"=>"bd5eb587-1819-43be-b00e-c94841d4b35e", "kind"=>"provision"}
2018-02-14 11:14:17 552d5c11 [app] [I] Redirected to
2018-02-14 11:14:17 552d5c11 [app] [I] Completed 500 Internal Server Error in 96ms (ActiveRecord: 2.5ms)
2018-02-14 11:14:17 552d5c11 [app] [F]
 | ActionController::RedirectBackError (No HTTP_REFERER was set in the request to this action, so redirect_to :back could not be called successfully. If this is a test, make sure to specify request.env["HTTP_REFERER"].):
 |   app/controllers/application_controller.rb:293:in `process_error'
 |   app/controllers/application_controller.rb:117:in `smart_proxy_exception'
 |   lib/middleware/catch_json_parse_errors.rb:9:in `call'
 |   lib/middleware/tagged_logging.rb:18:in `call'
 |
 |

==> /var/log/httpd/foreman_access.log <==
10.210.130.235 - - [14/Feb/2018:11:14:20 -0800] "GET /unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e HTTP/1.1" 500 1477 "-" "curl/7.29.0"

==> /var/log/foreman-proxy/proxy.log <==
W, [2018-02-14T11:14:20.602763 #25534]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-14T11:14:20.603302 #25534] ERROR -- : Failed to remove certificate(s) for testforeman.example: Execution of puppetca failed, check log files
I, [2018-02-14T11:14:20.603995 #25534]  INFO -- : 10.210.130.4 - - [14/Feb/2018:11:14:20 -0800] "DELETE /puppet/ca/testforeman.example HTTP/1.1" 406 118 0.0195


==> /var/log/foreman/production.log <==
2018-02-14 11:14:20 2a52d6c6 [app] [I] Started GET "/unattended/provision?token=bd5eb587-1819-43be-b00e-c94841d4b35e" for 10.210.130.235 at 2018-02-14 11:14:20 -0800
2018-02-14 11:14:20 2a52d6c6 [app] [I] Processing by UnattendedController#host_template as TEXT
2018-02-14 11:14:20 2a52d6c6 [app] [I]   Parameters: {"token"=>"bd5eb587-1819-43be-b00e-c94841d4b35e", "kind"=>"provision"}
2018-02-14 11:14:20 2a52d6c6 [app] [I] Redirected to
2018-02-14 11:14:20 2a52d6c6 [app] [I] Completed 500 Internal Server Error in 96ms (ActiveRecord: 2.5ms)
2018-02-14 11:14:20 2a52d6c6 [app] [F]
 | ActionController::RedirectBackError (No HTTP_REFERER was set in the request to this action, so redirect_to :back could not be called successfully. If this is a test, make sure to specify request.env["HTTP_REFERER"].):
 |   app/controllers/application_controller.rb:293:in `process_error'
 |   app/controllers/application_controller.rb:117:in `smart_proxy_exception'
 |   lib/middleware/catch_json_parse_errors.rb:9:in `call'
 |   lib/middleware/tagged_logging.rb:18:in `call'
 |
 |

==> /var/log/messages <==
Feb 14 11:14:28 prd-cs-lforeman dhcpd: DHCPINFORM from 10.210.130.247 via ens160
Feb 14 11:14:28 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:17:a4:77:00:21 to 10.210.130.4
Feb 14 11:14:28 prd-cs-lforeman dhcpd: DHCPACK to 10.210.130.247 (00:17:a4:77:00:21) via ens160

Ok this was helpful, frankly I have never seen this before. Can you turn on debugging for Rails and try again? Then paste just this block:

==> /var/log/foreman/production.log <==
2018-02-14 11:14:13 55c6e379 [app] [I] Processing by UnattendedController#host_template as TEXT
2018-02-14 11:14:13 55c6e379 [app] [I]   Parameters: {"token"=>"bd5eb587-1819-43be-b00e-c94841d4b35e", "kind"=>"provision"}
2018-02-14 11:14:14 55c6e379 [app] [I] Redirected to
2018-02-14 11:14:14 55c6e379 [app] [I] Completed 500 Internal Server Error in 675ms (ActiveRecord: 4.2ms)
2018-02-14 11:14:14 55c6e379 [app] [F]
 | ActionController::RedirectBackError (No HTTP_REFERER was set in the request to this action, so redirect_to :back could not be called successfully. If this is a test, make sure to specify request.env["HTTP_REFERER"].):
 |   app/controllers/application_controller.rb:293:in `process_error'
 |   app/controllers/application_controller.rb:117:in `smart_proxy_exception'
 |   lib/middleware/catch_json_parse_errors.rb:9:in `call'
 |   lib/middleware/tagged_logging.rb:18:in `call'

Hi Lukas,

Nothing interesting found in the debug mode too. The same ActionController::RedirectBackError error. :frowning:

2018-02-15 15:15:33 84558943 [app] [I] Started GET "/unattended/provision?token=238ff62a-68ee-46bd-bd5b-6aa48bcec362" for 10.134.130.29 at 2018-02-15 15:15:33 -0800
2018-02-15 15:15:33 84558943 [app] [I] Processing by UnattendedController#host_template as TEXT
2018-02-15 15:15:33 84558943 [app] [I]   Parameters: {"token"=>"238ff62a-68ee-46bd-bd5b-6aa48bcec362", "kind"=>"provision"}
2018-02-15 15:15:33 84558943 [sql] [D]   User Load (0.5ms)  SELECT  "users".* FROM "users" WHERE "users"."lower_login" = $1 LIMIT 1  [["lower_login", "foreman_api_admin"]]
2018-02-15 15:15:33 84558943 [app] [D] Setting current user thread-local variable to foreman_api_admin
2018-02-15 15:15:33 84558943 [sql] [D]   Host::Managed Load (1.6ms)  SELECT  hosts.* FROM "hosts" INNER JOIN "tokens" ON "tokens"."host_id" = "hosts"."id" WHERE "hosts"."type" IN ('Host::Managed') AND "tokens"."value" = $1 AND (expires >= '2018-02-15 23:15:33')  ORDER BY "hosts"."id" ASC LIMIT 1  [["value", "238ff62a-68ee-46bd-bd5b-6aa48bcec362"]]
2018-02-15 15:15:33 84558943 [sql] [D]   Operatingsystem Load (0.3ms)  SELECT  "operatingsystems".* FROM "operatingsystems" WHERE "operatingsystems"."id" = $1  ORDER BY "operatingsystems"."title" ASC LIMIT 1  [["id", 1]]
2018-02-15 15:15:33 84558943 [app] [D] Found client1.example
2018-02-15 15:15:33 84558943 [sql] [D]   SmartProxy Load (0.3ms)  SELECT  "smart_proxies".* FROM "smart_proxies" WHERE "smart_proxies"."id" = $1  ORDER BY smart_proxies.name LIMIT 1  [["id", 1]]
2018-02-15 15:15:33 84558943 [sql] [I] Remove puppet certificate for client1.example
2018-02-15 15:15:33 84558943 [app] [I] Redirected to
2018-02-15 15:15:33 84558943 [app] [I] Completed 500 Internal Server Error in 109ms (ActiveRecord: 4.2ms)
2018-02-15 15:15:33 84558943 [app] [F]
 | ActionController::RedirectBackError (No HTTP_REFERER was set in the request to this action, so redirect_to :back could not be called successfully. If this is a test, make sure to specify request.env["HTTP_REFERER"].):
 |   app/controllers/application_controller.rb:293:in `process_error'
 |   app/controllers/application_controller.rb:117:in `smart_proxy_exception'
 |   lib/middleware/catch_json_parse_errors.rb:9:in `call'
 |   lib/middleware/tagged_logging.rb:18:in `call'
 |

Ok this is a bug in our code which tries to nicely format the error message. Can you add this line:

Rails.logger.error request.headers.inspect

above this one:

I belive the error message itself contains the string which causes the branch with back to fail, but you need to confirm this.

Thanks Lukas, but that did not resolve it. I still see the same error.

That was not supposed to resolve the issue, but to log a line which I need to see, paste it to me. Obviously, something is erroring out with HTTP_REFERER header and then Rails does not see it there… We need to find what kind of response is that.

I did change something on the application_controller.rb and then the ActionController::RedirectBackError error went away but I still some puppet cert delete issue;

It was like this

#  def smart_proxy_exception(exception = nil)
#    process_error(:redirect => :back, :error_msg => exception.message)
#    Foreman::Logging.exception("ProxyAPI operation FAILED", exception)
#  end

I changed as below;

  def smart_proxy_exception(exception = nil)
     Foreman::Logging.exception("ProxyAPI operation FAILED", exception)
      if request.headers.include? 'HTTP_REFERER'
        process_error(:redirect => :back, :error_msg => exception.message)
      else
        process_error(:render => { :plain => exception.message },
                  :error_msg => exception.message)
      end
   end

Debug foreman-tail after the change;

==> /var/log/messages <==
eFeb 20 11:33:14 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:be:4a:62 to 10.234.30.4
Feb 20 11:33:14 prd-cs-lforeman dhcpd: DHCPDISCOVER from 00:50:56:be:4a:62 via ens160
Feb 20 11:33:14 prd-cs-lforeman dhcpd: DHCPOFFER on 10.234.30.34 to 00:50:56:be:4a:62 via ens160
Feb 20 11:33:14 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:17:a4:77:00:8f to 10.234.30.4
Feb 20 11:33:14 prd-cs-lforeman dhcpd: DHCPINFORM from 10.234.30.249 via ens160
Feb 20 11:33:14 prd-cs-lforeman dhcpd: DHCPACK to 10.234.30.249 (00:17:a4:77:00:8f) via ens160


Feb 20 11:33:16 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:be:4a:62 to 10.234.30.4
Feb 20 11:33:16 prd-cs-lforeman dhcpd: DHCPREQUEST for 10.234.30.34 (10.234.30.4) from 00:50:56:be:4a:62 via ens160
Feb 20 11:33:16 prd-cs-lforeman dhcpd: DHCPACK on 10.234.30.34 to 00:50:56:be:4a:62 via ens160
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8385]: RRQ from 10.234.30.34 filename pxelinux.0
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8385]: tftp: client does not accept options
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8386]: RRQ from 10.234.30.34 filename pxelinux.0
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8386]: Client 10.234.30.34 finished pxelinux.0
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8387]: RRQ from 10.234.30.34 filename pxelinux.cfg/423f2e7d-a92f-24d8-6ed6-e7c02b4b69ce
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8387]: Client 10.234.30.34 File not found pxelinux.cfg/423f2e7d-a92f-24d8-6ed6-e7c02b4b69ce
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8388]: RRQ from 10.234.30.34 filename pxelinux.cfg/01-00-50-56-bf-4a-62
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8388]: Client 10.234.30.34 finished pxelinux.cfg/01-00-50-56-bf-4a-62
Feb 20 11:33:16 prd-cs-lforeman in.tftpd[8389]: RRQ from 10.234.30.34 filename boot/CentOS-7.4.1708-x86_64-vmlinuz
Feb 20 11:33:17 prd-cs-lforeman in.tftpd[8389]: Client 10.234.30.34 finished boot/CentOS-7.4.1708-x86_64-vmlinuz
Feb 20 11:33:17 prd-cs-lforeman in.tftpd[8390]: RRQ from 10.234.30.34 filename boot/CentOS-7.4.1708-x86_64-initrd.img




==> /var/log/messages <==
Feb 20 11:33:29 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:be:4a:62 to 10.234.30.4
Feb 20 11:33:29 prd-cs-lforeman dhcpd: DHCPDISCOVER from 00:50:56:be:4a:62 via ens160
Feb 20 11:33:29 prd-cs-lforeman dhcpd: DHCPOFFER on 10.234.30.34 to 00:50:56:be:4a:62 via ens160
Feb 20 11:33:29 prd-cs-lforeman dhcpd: DHCPREQUEST for 10.234.30.235 (10.234.30.182) from 00:50:56:be:4a:62 via ens160: lease 10.234.30.235 unavailable.
Feb 20 11:33:29 prd-cs-lforeman dhcrelay[2995]: Forwarded BOOTREQUEST for 00:50:56:be:4a:62 to 10.234.30.4
Feb 20 11:33:29 prd-cs-lforeman dhcpd: DHCPNAK on 10.234.30.235 to 00:50:56:be:4a:62 via ens160

==> /var/log/httpd/puppet_access_ssl.log <==
10.234.33.241 - - [20/Feb/2018:11:33:29 -0800] "GET /stage/file_metadata/files/issue.net?source_permissions=use&links=manage HTTP/1.1" 200 283 "-" "-"
10.234.33.241 - - [20/Feb/2018:11:33:30 -0800] "GET /stage/file_metadata/files/motd?source_permissions=use&links=manage HTTP/1.1" 200 278 "-" "-"

==> /var/log/httpd/puppet_access_ssl.log <==
10.234.64.119 - - [20/Feb/2018:11:33:31 -0800] "GET /qa/file_metadatas/pluginfacts?checksum_type=md5&ignore=.svn&ignore=CVS&ignore=.git&links=manage&recurse=true HTTP/1.1" 200 278 "-" "-"
10.234.33.241 - - [20/Feb/2018:11:33:31 -0800] "GET /stage/file_metadata/files/c6.nsswitch.conf?source_permissions=use&links=manage HTTP/1.1" 200 290 "-" "-"
10.234.64.119 - - [20/Feb/2018:11:33:32 -0800] "GET /qa/file_metadatas/plugins?checksum_type=md5&ignore=.svn&ignore=CVS&ignore=.git&links=manage&recurse=true HTTP/1.1" 200 278 "-" "-"
10.234.33.241 - - [20/Feb/2018:11:33:32 -0800] "GET /stage/file_metadata/files/c6.sshd?source_permissions=use&links=manage HTTP/1.1" 200 281 "-" "-"

==> /var/log/foreman/production.log <==
2018-02-20 11:33:33 cccd44e0 [app] [I] Started GET "/unattended/provision?token=45b6b91c-f0a8-4e86-87f7-439675eb7fb6" for 10.234.30.235 at 2018-02-20 11:33:33 -0800
2018-02-20 11:33:33 cccd44e0 [app] [I] Processing by UnattendedController#host_template as TEXT
2018-02-20 11:33:33 cccd44e0 [app] [I]   Parameters: {"token"=>"45b6b91c-f0a8-4e86-87f7-439675eb7fb6", "kind"=>"provision"}
2018-02-20 11:33:33 cccd44e0 [app] [D] Setting current user thread-local variable to foreman_api_admin
2018-02-20 11:33:33 cccd44e0 [app] [D] Found clinet1.prod.example
==> /var/log/httpd/foreman_access.log <==
10.234.30.235 - - [20/Feb/2018:11:33:33 -0800] "GET /unattended/provision?token=45b6b91c-f0a8-4e86-87f7-439675eb7fb6 HTTP/1.1" 200 235 "-" "curl/7.29.0"

==> /var/log/httpd/foreman-ssl_access_ssl.log <==
10.234.30.4 - prd-cs-lforeman.prod.example [20/Feb/2018:11:33:33 -0800] "POST /api/config_reports HTTP/1.1" 201 723 "-" "Ruby"
==> /var/log/foreman-proxy/proxy.log <==
W, [2018-02-20T11:33:33.386620 #4545]  WARN -- : Failed to run puppetca: sudo: sorry, you must have a tty to run sudo

E, [2018-02-20T11:33:33.387260 #4545] ERROR -- : Failed to remove certificate(s) for clinet1.prod.example: Execution of puppetca failed, check log files
I, [2018-02-20T11:33:33.388174 #4545]  INFO -- : 10.234.30.4 - - [20/Feb/2018:11:33:33 -0800] "DELETE /puppet/ca/clinet1.prod.example HTTP/1.1" 406 114 0.0463


==> /var/log/foreman/production.log <==
2018-02-20 11:33:33 cccd44e0 [app] [W] ProxyAPI operation FAILED
 | ProxyAPI::ProxyException: ERF12-7740 [ProxyAPI::ProxyException]: Unable to delete PuppetCA certificate for clinet1.prod.example ([RestClient::NotAcceptable]: 406 Not Acceptable) for proxy https://prd-cs-lforeman.prod.example:9090/puppet/ca
 | /usr/share/foreman/lib/proxy_api/puppetca.rb:41:in `rescue in del_certificate'
 | /usr/share/foreman/lib/proxy_api/puppetca.rb:36:in `del_certificate'
 | /usr/share/foreman/app/models/concerns/orchestration/puppetca.rb:25:in `delCertificate'
 | /usr/share/foreman/app/models/host/managed.rb:290:in `handle_ca'
 | /usr/share/foreman/app/controllers/unattended_controller.rb:163:in `handle_ca'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:432:in `block in make_lambda'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:145:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:145:in `block in halting_and_conditional'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:504:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:504:in `block in call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:504:in `each'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:504:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:498:in `block (2 levels) in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `block (2 levels) in halting'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/rails-observers-0.1.2/lib/rails/observers/action_controller/caching/sweeping.rb:73:in `around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:455:in `public_send'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:455:in `block in make_lambda'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `block in halting'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `block in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:498:in `block (2 levels) in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `block (2 levels) in halting'
 | /usr/share/foreman/app/controllers/concerns/application_shared.rb:14:in `set_timezone'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:432:in `block in make_lambda'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `block in halting'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `block in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:498:in `block (2 levels) in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `block (2 levels) in halting'
 | /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in `clear_thread'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:432:in `block in make_lambda'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `block in halting'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `block in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:498:in `block (2 levels) in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:313:in `block (2 levels) in halting'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/rails-observers-0.1.2/lib/rails/observers/action_controller/caching/sweeping.rb:73:in `around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:455:in `public_send'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:455:in `block in make_lambda'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:312:in `block in halting'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:497:in `block in around'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:505:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:92:in `__run_callbacks__'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:778:in `_run_process_action_callbacks'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:81:in `run_callbacks'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/abstract_controller/callbacks.rb:19:in `process_action'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_controller/metal/rescue.rb:29:in `process_action'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_controller/metal/instrumentation.rb:32:in `block in process_action'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/notifications.rb:164:in `block in instrument'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/notifications/instrumenter.rb:20:in `instrument'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/notifications.rb:164:in `instrument'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_controller/metal/instrumentation.rb:30:in `process_action'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_controller/metal/params_wrapper.rb:250:in `process_action'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/railties/controller_runtime.rb:18:in `process_action'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/abstract_controller/base.rb:137:in `process'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionview-4.2.5.1/lib/action_view/rendering.rb:30:in `process'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_controller/metal.rb:196:in `dispatch'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_controller/metal/rack_delegation.rb:13:in `dispatch'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_controller/metal.rb:237:in `block in action'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/routing/route_set.rb:74:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/routing/route_set.rb:74:in `dispatch'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/routing/route_set.rb:43:in `serve'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/journey/router.rb:43:in `block in serve'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/journey/router.rb:30:in `each'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/journey/router.rb:30:in `serve'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/routing/route_set.rb:815:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/static.rb:116:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/static.rb:116:in `call'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.3.6/lib/apipie/static_dispatcher.rb:65:in `call'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.3.6/lib/apipie/extractor/recorder.rb:132:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/static.rb:116:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/static.rb:116:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/static.rb:116:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/static.rb:116:in `call'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.3.6/lib/apipie/middleware/checksum_in_headers.rb:27:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/etag.rb:24:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/conditionalget.rb:25:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/head.rb:13:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/params_parser.rb:27:in `call'
 | /usr/share/foreman/lib/middleware/catch_json_parse_errors.rb:9:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/flash.rb:260:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/session/abstract/id.rb:225:in `context'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/session/abstract/id.rb:220:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/cookies.rb:560:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/query_cache.rb:36:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/connection_adapters/abstract/connection_pool.rb:653:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/callbacks.rb:29:in `block in call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:88:in `__run_callbacks__'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:778:in `_run_call_callbacks'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/callbacks.rb:81:in `run_callbacks'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/callbacks.rb:27:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/remote_ip.rb:78:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/debug_exceptions.rb:17:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/show_exceptions.rb:30:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/rack/logger.rb:38:in `call_app'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/rack/logger.rb:22:in `call'
 | /usr/share/foreman/lib/middleware/tagged_logging.rb:18:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/request_id.rb:21:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/methodoverride.rb:22:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/runtime.rb:18:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/cache/strategy/local_cache_middleware.rb:28:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/actionpack-4.2.5.1/lib/action_dispatch/middleware/static.rb:116:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/sendfile.rb:113:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:518:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/application.rb:165:in `call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/railtie.rb:194:in `public_send'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/railtie.rb:194:in `method_missing'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/urlmap.rb:66:in `block in call'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/urlmap.rb:50:in `each'
 | /opt/rh/sclo-ror42/root/usr/share/gems/gems/rack-1.6.2/lib/rack/urlmap.rb:50:in `call'
 | /usr/share/passenger/phusion_passenger/rack/thread_handler_extension.rb:74:in `process_request'
 | /usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:141:in `accept_and_process_next_request'
 | /usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:109:in `main_loop'
 | /usr/share/passenger/phusion_passenger/request_handler.rb:455:in `block (3 levels) in start_threads'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `call'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `block in create_with_logging_context'
2018-02-20 11:33:33 cccd44e0 [app] [I]   Rendered text template (0.0ms)
2018-02-20 11:33:33 cccd44e0 [app] [I] Completed 200 OK in 154ms (Views: 9.9ms | ActiveRecord: 4.4ms)
2018-02-20 11:33:33 0b94d8fe [app] [I] Started POST "/api/config_reports" for 10.234.30.4 at 2018-02-20 11:33:33 -0800
2018-02-20 11:33:33 0b94d8fe [app] [D] Value for params[:config_report][:logs] was set to nil, because it was one of [], [null] or [null, null, ...]. Go to http://guides.rubyonrails.org/security.html#unsafe-query-generation for more information.
2018-02-20 11:33:33 0b94d8fe [app] [I] Processing by Api::V2::ConfigReportsController#create as JSON
2018-02-20 11:33:33 0b94d8fe [app] [I]   Parameters: {"config_report"=>"[FILTERED]", "apiv"=>"v2"}
2018-02-20 11:33:33 0b94d8fe [app] [D] Examining client certificate to extract dn and sans
2018-02-20 11:33:33 0b94d8fe [app] [D] Client sent certificate with subject 'prd-cs-lforeman.prod.example' and subject alt names '["prd-cs-lforeman.prod.example"]'
2018-02-20 11:33:33 0b94d8fe [app] [D] Verifying request from ["prd-cs-lforeman.prod.example"] against ["prd-cs-lforeman.prod.example"]
2018-02-20 11:33:33 0b94d8fe [app] [D] Setting current user thread-local variable to foreman_api_admin

This is resolved. I have added the right permission in the sudoers file.

1 Like

Very good! Now google that exception and you get:

https://projects.theforeman.org/projects/foreman/wiki/ERF12-7740

Doublecheck all.

Have we started adding standard error codes to the core and plugins?

Sorry what? This is Foreman core feature, everytime you raise Foreman::Exception or WrappedException, a code is assigned by the stack. There is a rake task which will generate you list of codes and messages. It’s in wiki-compatible format so this way we generated the initial list:

rake exception:codes
* [[ERF12-0104]] - Unable to set PuppetCA autosign for %s
 * [[ERF12-0635]] - Unable to delete DHCP entry for %s
 * [[ERF12-1261]] - Unable to delete DNS entry
 * [[ERF12-1764]] - Unable to detect version
 * [[ERF12-1772]] - Unable to perform power BMC operation
 * [[ERF12-2269]] - Unable to perform lan BMC operation
 * [[ERF12-2357]] - Unable to set DNS entry
 * [[ERF12-2530]] - Unable to detect features
 * [[ERF12-2573]] - Unable to fetch TFTP boot file
 * [[ERF12-2600]] - Unable to retrieve DHCP subnets
 * [[ERF12-2749]] - Unable to get environments from Puppet
 * [[ERF12-3517]] - Unable to get PuppetCA autosign
 * [[ERF12-3828]] - Unable to get environment from Puppet
 * [[ERF12-4115]] - Unable to get classes from Puppet for %s
 * [[ERF12-4252]] - Unable to execute Puppet run
 * [[ERF12-4395]] - Unable to retrieve DHCP entry for %s
 * [[ERF12-4681]] - Unable to delete PuppetCA autosign for %s
 * [[ERF12-5139]] - Unable to detect TFTP boot server
 * [[ERF12-5287]] - Unable to create realm entry
 * [[ERF12-5356]] - Unable to get PuppetCA certificates
 * [[ERF12-5472]] - Unable to set TFTP boot entry for %s
 * [[ERF12-5866]] - Unable to perform identify BMC operation
 * [[ERF12-6899]] - Unable to set DHCP entry
 * [[ERF12-7299]] - Unable to delete TFTP boot entry for %s
 * [[ERF12-7740]] - Unable to delete PuppetCA certificate for %s
 * [[ERF12-7885]] - Unable to fetch logs
 * [[ERF12-7947]] - Unable to retrieve DHCP subnet
 * [[ERF12-8202]] - Unable to retrieve unused IP
 * [[ERF12-8670]] - Unable to perform boot BMC operation
 * [[ERF12-8801]] - Unable to get installed BMC providers
 * [[ERF12-9243]] - Unable to create default TFTP boot menu
 * [[ERF12-9483]] - Unable to get BMC providers
 * [[ERF12-9815]] - Unable to sign PuppetCA certificate for %s
 * [[ERF42-0154]] - Attempting to construct an operating system image filename but %s cannot be built from an image
 * [[ERF42-0410]] - unknown provider
 * [[ERF42-0453]] - Provision script had a non zero exit
 * [[ERF42-0624]] - unknown network_type
 * [[ERF42-0955]] - parsing settings type '%s' from string is not defined
 * [[ERF42-1026]] - Invalid type for host creation via facts: %s
 * [[ERF42-1231]] - invalid host list
 * [[ERF42-1251]] - Error has occurred while communicating with %{cr}: %{e}
 * [[ERF42-1330]] - must provide a provider
 * [[ERF42-1419]] - Unknown IPAM type - can't continue
 * [[ERF42-1518]] - Unable to find a proxy with BMC feature
 * [[ERF42-1522]] - Not implemented
 * [[ERF42-1817]] - invalid type %s
 * [[ERF42-1994]] - Unable to find proper authentication method
 * [[ERF42-2263]] - Unsupported IPAM mode for %s
 * [[ERF42-2343]] - Unallowed template for dashboard widget: %s
 * [[ERF42-2450]] - Unsupported report status format
 * [[ERF42-2472]] - Unable to create the default role.
 * [[ERF42-2586]] - Invalid medium '%{medium}' for '%{os}'
 * [[ERF42-2587]] - Must provide an operating system
 * [[ERF42-2979]] - Template '%s' is either missing or has an invalid organization or location
 * [[ERF42-3078]] - %{os} medium was not set for host '%{host}'
 * [[ERF42-3305]] - Unable to find template %s
 * [[ERF42-3348]] - Cannot add pagelet with key %s and without partial
 * [[ERF42-3367]] - Must specify a user with email enabled
 * [[ERF42-3505]] - The console is not available because the VM is not powered on
 * [[ERF42-3624]] - A problem occurred when detecting host type: %s
 * [[ERF42-3629]] - Can't find a valid Foreman Proxy with a Puppet feature
 * [[ERF42-3779]] - Invalid architecture '%{arch}' for '%{os}'
 * [[ERF42-4097]] - Failed to deploy vm %{name}, fault: %{e}
 * [[ERF42-4505]] - invalid path
 * [[ERF42-4516]] - Unknown action name for success message: %s
 * [[ERF42-4598]] - Hint data is missing
 * [[ERF42-4689]] - Template '%s' was not found
 * [[ERF42-4738]] - %s is an unknown attribute
 * [[ERF42-4995]] - Invalid authenticity token
 * [[ERF42-5146]] - %s console is not supported at this time
 * [[ERF42-5227]] - unknown parent permission for %s
 * [[ERF42-5349]] - Realm proxy did not return a one-time password
 * [[ERF42-5351]] - invalid architecture for %s
 * [[ERF42-5434]] - unknown permission %s
 * [[ERF42-5531]] - unknown permission for %s
 * [[ERF42-5628]] - Unsupported password hash function '%s'
 * [[ERF42-5644]] - Function not available for %s
 * [[ERF42-5949]] - At least one volume must be specified for image-based provisioning.
 * [[ERF42-6051]] - invalid medium for %s
 * [[ERF42-6086]] - Cluster ID is required to list available networks
 * [[ERF42-6165]] - :foreman_url is not set, please configure in the Foreman Web UI (Administer -> Settings -> General)
 * [[ERF42-6282]] - Invalid log level: %s
 * [[ERF42-6302]] - No free ports available for websockify, try again later
 * [[ERF42-6324]] - Could not find network %s on VMWare compute resource
 * [[ERF42-6332]] - Cannot add pagelet with key %s and without mountpoint
 * [[ERF42-6784]] - There are orchestration modules with methods for configuration rebuild that have identical name: '%s'
 * [[ERF42-6794]] - Anonymous admin user %s is missing, run foreman-rake db:seed
 * [[ERF42-6801]] - Must provide template kind
 * [[ERF42-7277]] - Invalid architecture for %s
 * [[ERF42-7329]] - Not implemented for %s
 * [[ERF42-7495]] - Cannot find user %s when switching context
 * [[ERF42-7633]] - No templates found
 * [[ERF42-7634]] - Timeout has occurred while communicating with %s
 * [[ERF42-7938]] - Please specify volume size. You may optionally use suffix 'G' to specify volume size in gigabytes.
 * [[ERF42-7951]] - Must specify a valid user with email enabled
 * [[ERF42-8079]] - VM is not running!
 * [[ERF42-8175]] - invalid method %s
 * [[ERF42-8219]] - Invalid medium for %s
 * [[ERF42-8459]] - Invalid power state request: %{action}, supported actions are %{supported}
 * [[ERF42-8477]] - %s is not a valid DNS record type
 * [[ERF42-8590]] - unable to sign a non pending certificate
 * [[ERF42-8800]] - Cannot register compute resource, wrong type supplied
 * [[ERF42-9767]] - Invalid version format, please enter in x.y (only major version).
 * [[ERF42-9902]] - DHCP not supported for this NIC
 * [[ERF42-9958]] - Unknown power management support - can't continue
 * [[ERF42-9972]] - Cannot create LDAP configuration for %s without dedicated service account
 * [[ERF50-1006]] - Unable to connect to LDAP server
 * [[ERF50-2486]] - Import of facts failed for host %s
 * [[ERF50-2487]] - Unable to initialize ProxyAPI class %s
 * [[ERF50-5345]] - Unable to connect
 * [[ERF50-9294]] - Unable to find IP address for '%s'

This then goes to:

https://projects.theforeman.org/projects/foreman/wiki/ErrorCodes

It works with core plugins as well, I executed this without Katello installed but when you have it, you are getting codes from plugin as well.

1 Like

Hi

I am trying to build pos server throw foreman , it is booting throw pxe but stuck on dracut

Hello and welcome. There is nothing I could read from this screen, it is just bunch of consequences after a host could not boot into Anaconda properly. Can be a network error, syntax error in Kickstart or pretty much anything.

Please file a new thread and provide all the details, logs from production.log etc. Try to figure it out.