"Oops, we're sorry but something went wrong A backend service [ Candlepin ] is unreachable"

Support
#1

Problem: After redhat sync repo in foreman, I could not join my WebUI interface in my browser. I got
this message “Oops, we’re sorry but something went wrong A backend service [ Candlepin ] is unreachable” after that I couldn’t run the webUI since it’s also unreachable.
Expected outcome:
Able to reach and connect to the Foreman web interface

Foreman and Proxy versions:

Foreman and Proxy plugin versions:
foreman 3.2 katello 4.4

Distribution and version:
rhel 7.9

Other relevant data:
It’s a forman used in my company. We were able to use it since now but one day, nothing and here the message “Oops…”

#2

Hi @luq,

Could you run foreman-maintain service status to check if all services are up and running? Do you see any error messages in /var/log/foreman/production.log and /var/log/candlepin/candlepin.log and error.log?

Thanks.

#3

Hi @lfu Thanks for your reply, When i run “foreman-maintain service status” I can see that all the services are running.
\ All services are running [OK]

#4

here the output of the candlepin.log you ask:

~]# cat /var/log/candlepin/candlepin.log
2022-05-18 00:00:00,016 [thread=QuartzScheduler_Worker-5] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d408fb050004, name: ExpiredPoolsCleanupJob, key: ExpiredPoolsCleanupJob, state: QUEUED]
2022-05-18 00:00:00,098 [thread=QuartzScheduler_Worker-6] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d408fb5a0005, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 00:00:03,358 [thread=Thread-10 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d408fb5a0005, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 00:00:03,396 [thread=Thread-9 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d408fb050004, job_key=ExpiredPoolsCleanupJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ExpiredPoolsCleanupJob” using class: org.candlepin.async.tasks.ExpiredPoolsCleanupJob
2022-05-18 00:00:03,408 [thread=Thread-10 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d408fb5a0005, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 57ms
2022-05-18 00:00:04,191 [thread=Thread-9 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d408fb050004, job_key=ExpiredPoolsCleanupJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ExpiredPoolsCleanupJob” completed in 823ms
2022-05-18 01:00:00,014 [thread=QuartzScheduler_Worker-7] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d43fe9850006, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 01:00:00,037 [thread=Thread-12 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d43fe9850006, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 01:00:00,047 [thread=Thread-12 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d43fe9850006, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 10ms
2022-05-18 02:00:00,013 [thread=QuartzScheduler_Worker-8] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d476d8060007, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 02:00:00,033 [thread=Thread-14 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d476d8060007, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 02:00:00,044 [thread=Thread-14 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d476d8060007, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 12ms
2022-05-18 03:00:00,025 [thread=QuartzScheduler_Worker-9] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d4adc68a0008, name: UnmappedGuestEntitlementCleanerJob, key: UnmappedGuestEntitlementCleanerJob, state: QUEUED]
2022-05-18 03:00:00,052 [thread=QuartzScheduler_Worker-10] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d4adc6a40009, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 03:00:00,138 [thread=Thread-17 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d4adc6a40009, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 03:00:00,182 [thread=Thread-17 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d4adc6a40009, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 48ms
2022-05-18 03:00:00,293 [thread=Thread-16 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d4adc68a0008, job_key=UnmappedGuestEntitlementCleanerJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “UnmappedGuestEntitlementCleanerJob” using class: org.candlepin.async.tasks.UnmappedGuestEntitlementCleanerJob
2022-05-18 03:00:04,556 [thread=Thread-16 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d4adc68a0008, job_key=UnmappedGuestEntitlementCleanerJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “UnmappedGuestEntitlementCleanerJob” completed in 4212ms
2022-05-18 04:00:00,012 [thread=QuartzScheduler_Worker-11] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d4e4b505000a, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 04:00:00,047 [thread=Thread-19 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d4e4b505000a, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 04:00:00,057 [thread=Thread-19 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d4e4b505000a, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 10ms
2022-05-18 05:00:00,038 [thread=QuartzScheduler_Worker-12] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d51ba39f000b, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 05:00:00,074 [thread=Thread-21 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d51ba39f000b, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 05:00:00,085 [thread=Thread-21 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d51ba39f000b, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 13ms
2022-05-18 06:00:00,017 [thread=QuartzScheduler_Worker-13] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d5529206000c, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 06:00:00,045 [thread=Thread-23 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5529206000c, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 06:00:00,055 [thread=Thread-23 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5529206000c, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 16ms
2022-05-18 07:00:00,077 [thread=QuartzScheduler_Worker-14] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d5898084000d, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 07:00:00,174 [thread=Thread-25 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5898084000d, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 07:00:00,191 [thread=Thread-25 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5898084000d, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 14ms
2022-05-18 08:00:00,014 [thread=QuartzScheduler_Worker-15] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d5c06f06000e, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 08:00:00,060 [thread=Thread-27 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5c06f06000e, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 08:00:00,074 [thread=Thread-27 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5c06f06000e, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 16ms
2022-05-18 09:00:00,009 [thread=QuartzScheduler_Worker-1] [=, org=, csid=] INFO org.candlepin.async.JobManager - Job queued: AsyncJobStatus [id: 8aaf8dfe80d2f73b0180d5f75d85000f, name: ActiveEntitlementJob, key: ActiveEntitlementJob, state: QUEUED]
2022-05-18 09:00:00,036 [thread=Thread-29 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5f75d85000f, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Starting job “ActiveEntitlementJob” using class: org.candlepin.async.tasks.ActiveEntitlementJob
2022-05-18 09:00:00,044 [thread=Thread-29 (ActiveMQ-client-global-threads)] [job=8aaf8dfe80d2f73b0180d5f75d85000f, job_key=ActiveEntitlementJob, org=, csid=] INFO org.candlepin.async.JobManager - Job “ActiveEntitlementJob” completed in 10ms

#5

I notice an error in this log /var/log/foreman/production.log

" 2022-05-17T19:00:48 [E|app|33680213] Error occurred while starting Katello::CandlepinEventListener
2022-05-17T19:00:48 [E|app|33680213] Connection refused - connect(2) for “localhost” port 61613 "

33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/stomp/client.rb:99:in initialize' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/messaging/stomp_connection.rb:69:in new’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/messaging/stomp_connection.rb:69:in client' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/messaging/stomp_connection.rb:43:in subscribe’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/services/katello/candlepin_event_listener.rb:34:in run' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:40:in block in check_services’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:30:in each' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:30:in check_services’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:16:in block (2 levels) in start' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/execution_wrapper.rb:88:in wrap’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:15:in block in start' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:14:in loop’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:14:in start' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/runner.rb:78:in block in start_monitor_thread’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in block in create_with_logging_context' 2022-05-17T19:00:48 [E|app|33680213] Error occurred while starting Katello::CandlepinEventListener 2022-05-17T19:00:48 [E|app|33680213] Connection refused - connect(2) for "localhost" port 61613 2022-05-17T19:00:48 [E|app|33680213] /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/netio.rb:461:in initialize’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/netio.rb:461:in open' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/netio.rb:461:in block in open_ssl_socket’
33680213 | /opt/rh/rh-ruby27/root/usr/share/ruby/timeout.rb:78:in timeout' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/netio.rb:460:in open_ssl_socket’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/netio.rb:520:in open_socket' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/utils.rb:116:in block in socket’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/utils.rb:109:in synchronize' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/connection/utils.rb:109:in socket’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/stomp/connection.rb:173:in initialize' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/stomp/client.rb:134:in new’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/stomp/client.rb:134:in create_connection' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/stomp/client.rb:101:in block in initialize’
33680213 | /opt/rh/rh-ruby27/root/usr/share/ruby/timeout.rb:95:in block in timeout' 33680213 | /opt/rh/rh-ruby27/root/usr/share/ruby/timeout.rb:33:in block in catch’
33680213 | /opt/rh/rh-ruby27/root/usr/share/ruby/timeout.rb:33:in catch' 33680213 | /opt/rh/rh-ruby27/root/usr/share/ruby/timeout.rb:33:in catch’
33680213 | /opt/rh/rh-ruby27/root/usr/share/ruby/timeout.rb:110:in timeout' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/stomp-1.4.9/lib/stomp/client.rb:99:in initialize’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/messaging/stomp_connection.rb:69:in new' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/messaging/stomp_connection.rb:69:in client’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/messaging/stomp_connection.rb:43:in subscribe' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/services/katello/candlepin_event_listener.rb:34:in run’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:40:in block in check_services' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:30:in each’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:30:in check_services' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:16:in block (2 levels) in start’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/execution_wrapper.rb:88:in wrap' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:15:in block in start’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:14:in loop' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/monitor.rb:14:in start’
33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.4.0.2/app/lib/katello/event_daemon/runner.rb:78:in block in start_monitor_thread' 33680213 | /opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in block in create_with_logging_context’
2022-05-17T19:01:03 [I|app|33680213] Subscribed to katello.candlepin.candlepin_events
2022-05-17T19:30:16 [I|app|] Rails cache backend: File
2022-05-17T19:30:18 [W|app|] Setting remote_execution_workers_pool_size has no definition, please define it before using

#6

journalctl -u tomcat.service
May 17 19:00:10 isc1-sv93126 systemd[1]: Stopping Apache Tomcat Web Application Container…
May 17 19:00:10 isc1-sv93126 server[10219]: May 17, 2022 7:00:10 PM org.apache.coyote.AbstractProtocol pause
May 17 19:00:10 isc1-sv93126 server[10219]: INFO: Pausing ProtocolHandler [“http-bio-127.0.0.1-23443”]
May 17 19:00:10 isc1-sv93126 server[10219]: May 17, 2022 7:00:10 PM org.apache.catalina.core.StandardService stopInternal
May 17 19:00:10 isc1-sv93126 server[10219]: INFO: Stopping service Catalina
May 17 19:00:11 isc1-sv93126 server[10219]: May 17, 2022 7:00:11 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
May 17 19:00:11 isc1-sv93126 server[10219]: SEVERE: The web application [/candlepin] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@42b60bb1])
May 17 19:00:11 isc1-sv93126 server[10219]: May 17, 2022 7:00:11 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
May 17 19:00:11 isc1-sv93126 server[10219]: SEVERE: The web application [/candlepin] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@42b60bb1])
May 17 19:00:11 isc1-sv93126 server[10219]: May 17, 2022 7:00:11 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
May 17 19:00:11 isc1-sv93126 server[10219]: SEVERE: The web application [/candlepin] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@42b60bb1])
May 17 19:00:11 isc1-sv93126 server[10219]: May 17, 2022 7:00:11 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
May 17 19:00:11 isc1-sv93126 server[10219]: SEVERE: The web application [/candlepin] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@2edd00ce])
May 17 19:00:11 isc1-sv93126 server[10219]: May 17, 2022 7:00:11 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
May 17 19:00:11 isc1-sv93126 server[10219]: SEVERE: The web application [/candlepin] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@42b60bb1])
May 17 19:00:12 isc1-sv93126 server[10219]: May 17, 2022 7:00:12 PM org.apache.coyote.AbstractProtocol stop
May 17 19:00:12 isc1-sv93126 server[10219]: INFO: Stopping ProtocolHandler [“http-bio-127.0.0.1-23443”]
May 17 19:00:12 isc1-sv93126 server[10219]: May 17, 2022 7:00:12 PM org.apache.coyote.AbstractProtocol destroy
May 17 19:00:12 isc1-sv93126 server[10219]: INFO: Destroying ProtocolHandler [“http-bio-127.0.0.1-23443”]
May 17 19:00:12 isc1-sv93126 systemd[1]: Stopped Apache Tomcat Web Application Container.
May 17 19:00:12 isc1-sv93126 systemd[1]: Started Apache Tomcat Web Application Container.
May 17 19:00:13 isc1-sv93126 server[12904]: Java virtual machine used: /usr/lib/jvm/jre-11/bin/java
May 17 19:00:13 isc1-sv93126 server[12904]: classpath used: /usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/commons-daemon.jar
May 17 19:00:13 isc1-sv93126 server[12904]: main class used: org.apache.catalina.startup.Bootstrap
May 17 19:00:13 isc1-sv93126 server[12904]: flags used: -Xms1024m -Xmx4096m -Dcom.redhat.fips=false -Djava.security.auth.login.config=/usr/share/tomcat/conf/login.config
May 17 19:00:13 isc1-sv93126 server[12904]: options used: -Dcatalina.base=/usr/share/tomcat -Dcatalina.home=/usr/share/tomcat -Djava.endorsed.dirs= -Djava.io.tmpdir=/var/cache/tomcat/temp -
May 17 19:00:13 isc1-sv93126 server[12904]: arguments used: start
May 17 19:00:38 isc1-sv93126 server[12904]: May 17, 2022 7:00:36 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
May 17 19:00:38 isc1-sv93126 server[12904]: INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.pa
May 17 19:00:40 isc1-sv93126 server[12904]: May 17, 2022 7:00:40 PM org.apache.coyote.AbstractProtocol init
May 17 19:00:40 isc1-sv93126 server[12904]: INFO: Initializing ProtocolHandler [“http-bio-127.0.0.1-23443”]
May 17 19:00:42 isc1-sv93126 server[12904]: May 17, 2022 7:00:42 PM org.apache.catalina.startup.Catalina load
May 17 19:00:42 isc1-sv93126 server[12904]: INFO: Initialization processed in 20005 ms
May 17 19:00:42 isc1-sv93126 server[12904]: May 17, 2022 7:00:42 PM org.apache.catalina.core.StandardService startInternal
May 17 19:00:42 isc1-sv93126 server[12904]: INFO: Starting service Catalina
May 17 19:00:42 isc1-sv93126 server[12904]: May 17, 2022 7:00:42 PM org.apache.catalina.core.StandardEngine startInternal
May 17 19:00:42 isc1-sv93126 server[12904]: INFO: Starting Servlet Engine: Apache Tomcat/7.0.76
May 17 19:00:42 isc1-sv93126 server[12904]: May 17, 2022 7:00:42 PM org.apache.catalina.startup.HostConfig deployDirectory
May 17 19:00:42 isc1-sv93126 server[12904]: INFO: Deploying web application directory /var/lib/tomcat/webapps/candlepin
May 17 19:00:43 isc1-sv93126 server[12904]: WARNING: An illegal reflective access operation has occurred
May 17 19:00:43 isc1-sv93126 server[12904]: WARNING: Illegal reflective access by org.apache.catalina.loader.WebappClassLoaderBase$1 (file:/usr/share/java/tomcat/catalina.jar) to method jav
May 17 19:00:43 isc1-sv93126 server[12904]: WARNING: Please consider reporting this to the maintainers of org.apache.catalina.loader.WebappClassLoaderBase$1
May 17 19:00:43 isc1-sv93126 server[12904]: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
May 17 19:00:43 isc1-sv93126 server[12904]: WARNING: All illegal access operations will be denied in a future release
May 17 19:00:43 isc1-sv93126 server[12904]: May 17, 2022 7:00:43 PM org.apache.catalina.loader.WebappClassLoaderBase validateJarFile
May 17 19:00:43 isc1-sv93126 server[12904]: INFO: validateJarFile(/usr/share/tomcat/webapps/candlepin/WEB-INF/lib/javax.el-api-3.0.0.jar) - jar not loaded. See Servlet Spec 3.0, section 10.
May 17 19:00:43 isc1-sv93126 server[12904]: May 17, 2022 7:00:43 PM org.apache.catalina.loader.WebappLoader buildClassPath
May 17 19:00:43 isc1-sv93126 server[12904]: INFO: Unknown loader jdk.internal.loader.ClassLoaders$AppClassLoader@5bc2b487 class jdk.internal.loader.ClassLoaders$AppClassLoader
May 17 19:00:53 isc1-sv93126 server[12904]: May 17, 2022 7:00:53 PM org.apache.catalina.startup.TldConfig execute
May 17 19:00:53 isc1-sv93126 server[12904]: INFO: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were sca
May 17 19:00:54 isc1-sv93126 server[12904]: May 17, 2022 7:00:54 PM com.google.inject.internal.ProxyFactory
May 17 19:00:54 isc1-sv93126 server[12904]: WARNING: Method [public org.candlepin.model.Persisted org.candlepin.model.OwnerCurator.create(org.candlepin.model.Persisted)] is synthetic and is
May 17 19:00:54 isc1-sv93126 server[12904]: May 17, 2022 7:00:54 PM com.google.inject.internal.ProxyFactory
May 17 19:00:54 isc1-sv93126 server[12904]: WARNING: Method [public org.candlepin.model.Persisted org.candlepin.model.ProductCurator.merge(org.candlepin.model.Persisted)] is synthetic and i
May 17 19:00:54 isc1-sv93126 server[12904]: May 17, 2022 7:00:54 PM com.google.inject.internal.ProxyFactory
May 17 19:00:54 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.ProductCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [
May 17 19:00:54 isc1-sv93126 server[12904]: May 17, 2022 7:00:54 PM com.google.inject.internal.ProxyFactory
May 17 19:00:54 isc1-sv93126 server[12904]: WARNING: Method [public org.candlepin.model.Persisted org.candlepin.model.ProductCurator.create(org.candlepin.model.Persisted)] is synthetic and
May 17 19:00:54 isc1-sv93126 server[12904]: May 17, 2022 7:00:54 PM com.google.inject.internal.ProxyFactory
May 17 19:00:54 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.EntitlementCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.ConsumerCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public org.candlepin.model.Persisted org.candlepin.model.ConsumerCurator.create(org.candlepin.model.Persisted,boolean)] is synth
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.CdnCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [com.
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.PoolCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [com
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.RulesCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [co
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public org.candlepin.model.Persisted org.candlepin.model.RulesCurator.create(org.candlepin.model.Persisted)] is synthetic and is
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.ContentCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public void org.candlepin.model.EntitlementCertificateCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being i
May 17 19:00:55 isc1-sv93126 server[12904]: May 17, 2022 7:00:55 PM com.google.inject.internal.ProxyFactory
May 17 19:00:55 isc1-sv93126 server[12904]: WARNING: Method [public java.lang.Iterable org.candlepin.resource.OwnerResource.createBatchContent(java.lang.String,java.util.List)] is synthetic
May 17 19:01:04 isc1-sv93126 server[12904]: May 17, 2022 7:01:04 PM org.apache.catalina.startup.HostConfig deployDirectory
May 17 19:01:04 isc1-sv93126 server[12904]: INFO: Deployment of web application directory /var/lib/tomcat/webapps/candlepin has finished in 21,423 ms
May 17 19:01:04 isc1-sv93126 server[12904]: May 17, 2022 7:01:04 PM org.apache.coyote.AbstractProtocol start
May 17 19:01:04 isc1-sv93126 server[12904]: INFO: Starting ProtocolHandler [“http-bio-127.0.0.1-23443”]
May 17 19:01:04 isc1-sv93126 server[12904]: May 17, 2022 7:01:04 PM org.apache.catalina.startup.Catalina start
May 17 19:01:04 isc1-sv93126 server[12904]: INFO: Server startup in 21799 ms

#7

[root@isc1-sv93126 ~]# hammer -u admin -p changeme ping
database:
Status: ok
Server Response: Duration: 0ms
candlepin:
Status: ok
Server Response: Duration: 41ms
candlepin_auth:
Status: ok
Server Response: Duration: 36ms
candlepin_events:
Status: ok
message: 0 Processed, 0 Failed
Server Response: Duration: 0ms
katello_events:
Status: ok
message: 0 Processed, 0 Failed
Server Response: Duration: 3ms
pulp3:
Status: ok
Server Response: Duration: 212ms
pulp3_content:
Status: ok
Server Response: Duration: 63ms
foreman_tasks:
Status: ok
Server Response: Duration: 292ms

#8

HI @lfu

I can finally connect to the web interface thanks to you. Because of you I could point that it was an issue with the ports on my foreman although i remember open them previously. When I checked on my list ports using “foreman-cmd --list-all” None of the ports required were opened. So I open them and make them persistent with “firewall-cmd --runtime-to-permanent” as the doc says actually.
Thank you @lfu