Problem: Currently our Puppet/Foreman server is experiencing intermittent timeouts.
Common issues that we experience are:
Slowness in the Foreman web GUI
Proxy-timeout messages when attempting to access the web GUI
Error message seen when this ocurrs says:
PROXY ERROR
The proxy server received an invalid response from an upstream server.
The Proxy server could not handle thee request.
Reason: Error readying from remote server
Timeout messages when attempting to run the hammer import-proxy command for updating foreman with our Puppet environments along with these frequently occurring errors in the hammer.log file
[ERROR 2023-03-09T05:18:13 API] 502 Bad Gateway
[ERROR 2023-03-09T05:18:13 Exception] Error: 502 Bad Gateway
[ERROR 2023-03-09T05:18:13 Exception]
RestClient::BadGateway (502 Bad Gateway):
[ERROR 2023-03-10T06:38:54 API] 500 Internal Server Error
[ERROR 2023-03-10T06:38:54 Exception] ERF12-2749 [ProxyAPI::ProxyException]: Unable to get environments from Puppet ([RestClient::NotAcceptable]: 406 Not Acceptable) for proxy https://server1:8443/puppet
[ERROR 2023-03-10T06:38:54 Exception]
RestClient::InternalServerError (500 Internal Server Error):
[ERROR 2023-03-07T02:58:59 API] 500 Internal Server Error
[ERROR 2023-03-07T02:58:59 Exception] ERF12-4115 [ProxyAPI::ProxyException]: Unable to get classes from Puppet for production ([RestClient::ServiceUnavailable]: 503 Service Unavailable) for proxy https:/server1:8443/puppet
[ERROR 2023-03-07T02:58:59 Exception]
RestClient::InternalServerError (500 Internal Server Error)
Currently trying to pin point where the issue is stemming from. I don’t see any useful info in the foreman production.log file and for the most part, I can’t see any glaring issues on the server. The issue seems like it’s almost resource based, but the server itself isn’t running into any bottlenecks.
Any idea where I could get more detailed information from foreman and why it’s running into these issues?
Expected outcome:
Foreman and Proxy versions:
Foreman version is 2.1.4
Foreman and Proxy plugin versions:
Distribution and version:
Other relevant data: