Foreman-installer crash - The webserver was unable to reach the backend service

Problem:

After upgrading from RH8.6 → 8.7 I now have the bellow error msg:

2022-12-12 17:20:04 [ERROR ] [configure] /Stage[main]/Foreman::Register/Foreman_host[foreman-dsdpsatellite.fmlogistic.fr]: Could not evaluate: Error making GET request to Foreman at https://dsdpsatellite.fmlogistic.fr/api/v2/hosts: Response: 503 Service Unavailable: The webserver was unable to reach the backend service. Is Foreman running at dsdpsatellite.fmlogistic.fr?

I precise That there is any error in RH8.6 before the OS upgrade.

Can you help me please ?

Expected outcome:

Foreman and Proxy versions:

Foreman and Proxy plugin versions: Foreman 3.4 + Katello 4.6

Distribution and version: RH 8.7

Other relevant data:

foreman-maintain service status

Running Status Services

Get status of applicable services:

Displaying the following service(s):
redis, postgresql, pulpcore-api, pulpcore-content, pulpcore-worker@1.service, pulpcore-worker@2.service, pulpcore-worker@3.service, pulpcore-worker@4.service, pulpcore-worker@5.service, pulpcore-worker@6.service, pulpcore-worker@7.service, pulpcore-worker@8.service, tomcat, dynflow-sidekiq@orchestrator, foreman, httpd, dynflow-sidekiq@worker-1, dynflow-sidekiq@worker-hosts-queue-1, foreman-proxy
\ displaying redis
● redis.service - Redis persistent key-value database
Loaded: loaded (/usr/lib/systemd/system/redis.service; enabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/redis.service.d
└─90-limits.conf
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1625 (redis-server)
Tasks: 4 (limit: 204127)
Memory: 9.7M
CGroup: /system.slice/redis.service
└─1625 /usr/bin/redis-server 127.0.0.1:6379

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting Redis persistent key-value database…
Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Redis persistent key-value database.
\ displaying postgresql
● postgresql.service - PostgreSQL database server
Loaded: loaded (/usr/lib/systemd/system/postgresql.service; enabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/postgresql.service.d
└─postgresql.conf
Active: active (running) since Mon 2022-12-12 16:57:42 CET; 27min ago
Main PID: 1679 (postmaster)
Tasks: 101 (limit: 204127)
Memory: 943.6M
CGroup: /system.slice/postgresql.service
├─1679 /usr/bin/postmaster -D /var/lib/pgsql/data
├─1771 postgres: logger
├─1775 postgres: checkpointer
├─1776 postgres: background writer
├─1777 postgres: walwriter
├─1778 postgres: autovacuum launcher
├─1779 postgres: stats collector
├─1780 postgres: logical replication launcher
├─2226 postgres: pulp pulpcore 127.0.0.1(50422) idle
├─2234 postgres: pulp pulpcore 127.0.0.1(50426) idle
├─2236 postgres: pulp pulpcore 127.0.0.1(50434) idle
├─2238 postgres: pulp pulpcore 127.0.0.1(50446) idle
├─2239 postgres: pulp pulpcore 127.0.0.1(50456) idle
├─2242 postgres: pulp pulpcore 127.0.0.1(50468) idle
├─2246 postgres: pulp pulpcore 127.0.0.1(50472) idle
├─2262 postgres: pulp pulpcore 127.0.0.1(50478) idle
├─2270 postgres: pulp pulpcore 127.0.0.1(50488) idle
├─2271 postgres: pulp pulpcore 127.0.0.1(50492) idle
├─2274 postgres: pulp pulpcore 127.0.0.1(50502) idle
├─2277 postgres: pulp pulpcore 127.0.0.1(50504) idle
├─2279 postgres: pulp pulpcore 127.0.0.1(50508) idle
├─2280 postgres: pulp pulpcore 127.0.0.1(50518) idle
├─2282 postgres: pulp pulpcore 127.0.0.1(50532) idle
├─2291 postgres: pulp pulpcore 127.0.0.1(50534) idle
├─2295 postgres: pulp pulpcore 127.0.0.1(50538) idle
├─2299 postgres: pulp pulpcore 127.0.0.1(50550) idle
├─2302 postgres: pulp pulpcore 127.0.0.1(50560) idle
├─2319 postgres: pulp pulpcore 127.0.0.1(50564) idle
├─2323 postgres: pulp pulpcore 127.0.0.1(50574) idle
├─2324 postgres: pulp pulpcore 127.0.0.1(50588) idle
├─2328 postgres: pulp pulpcore 127.0.0.1(50596) idle
├─2329 postgres: pulp pulpcore 127.0.0.1(50604) idle
├─2334 postgres: pulp pulpcore 127.0.0.1(50608) idle
├─2341 postgres: candlepin candlepin 127.0.0.1(50614) idle in transaction
├─2354 postgres: candlepin candlepin 127.0.0.1(58472) idle in transaction
├─2369 postgres: foreman foreman [local] idle
├─2410 postgres: candlepin candlepin 127.0.0.1(58508) idle
├─2411 postgres: candlepin candlepin 127.0.0.1(58526) idle
├─2412 postgres: candlepin candlepin 127.0.0.1(58524) idle
├─2495 postgres: foreman foreman [local] idle
├─2499 postgres: foreman foreman [local] idle
├─2500 postgres: foreman foreman [local] idle
├─2507 postgres: foreman foreman [local] idle
├─2511 postgres: foreman foreman [local] idle
├─2512 postgres: foreman foreman [local] idle
├─2513 postgres: foreman foreman [local] idle
├─2521 postgres: foreman foreman [local] idle
├─2522 postgres: foreman foreman [local] idle
├─2583 postgres: foreman foreman [local] idle
├─2588 postgres: foreman foreman [local] idle
├─2589 postgres: foreman foreman [local] idle
├─2591 postgres: foreman foreman [local] idle
├─2593 postgres: foreman foreman [local] idle
├─2599 postgres: foreman foreman [local] idle
├─2603 postgres: foreman foreman [local] idle
├─2608 postgres: foreman foreman [local] idle
├─2609 postgres: foreman foreman [local] idle
├─2614 postgres: foreman foreman [local] idle
├─2617 postgres: foreman foreman [local] idle
├─2618 postgres: foreman foreman [local] idle
├─2620 postgres: foreman foreman [local] idle
├─2621 postgres: foreman foreman [local] idle
├─2622 postgres: foreman foreman [local] idle
├─2626 postgres: foreman foreman [local] idle
├─2627 postgres: foreman foreman [local] idle
├─2628 postgres: foreman foreman [local] idle
├─2629 postgres: foreman foreman [local] idle
├─2632 postgres: foreman foreman [local] idle
├─2634 postgres: foreman foreman [local] idle
├─2637 postgres: foreman foreman [local] idle
├─2638 postgres: foreman foreman [local] idle
├─2639 postgres: foreman foreman [local] idle
├─2640 postgres: foreman foreman [local] idle
├─2649 postgres: foreman foreman [local] idle
├─2650 postgres: foreman foreman [local] idle
├─2651 postgres: foreman foreman [local] idle
├─2652 postgres: foreman foreman [local] idle
├─2653 postgres: foreman foreman [local] idle
├─2654 postgres: foreman foreman [local] idle
├─2655 postgres: foreman foreman [local] idle
├─2657 postgres: foreman foreman [local] idle
├─2658 postgres: foreman foreman [local] idle
├─2659 postgres: foreman foreman [local] idle
├─2661 postgres: foreman foreman [local] idle
├─2662 postgres: foreman foreman [local] idle
├─2663 postgres: foreman foreman [local] idle
├─2667 postgres: foreman foreman [local] idle
├─2670 postgres: foreman foreman [local] idle
├─2679 postgres: foreman foreman [local] idle
├─2680 postgres: foreman foreman [local] idle
├─2682 postgres: foreman foreman [local] idle
├─2683 postgres: foreman foreman [local] idle
├─2689 postgres: foreman foreman [local] idle
├─2690 postgres: foreman foreman [local] idle
├─2696 postgres: foreman foreman [local] idle
├─2723 postgres: foreman foreman [local] idle
├─2757 postgres: foreman foreman [local] idle
├─5942 postgres: candlepin candlepin 127.0.0.1(35532) idle
├─6057 postgres: candlepin candlepin 127.0.0.1(52408) idle
├─6070 postgres: candlepin candlepin 127.0.0.1(54776) idle
└─6071 postgres: candlepin candlepin 127.0.0.1(54774) idle

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting PostgreSQL database server…
Dec 12 16:57:42 dsdpsatellite postmaster[1679]: 2022-12-12 16:57:42 CET LOG: starting PostgreSQL 12.12 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), 64-bit
Dec 12 16:57:42 dsdpsatellite postmaster[1679]: 2022-12-12 16:57:42 CET LOG: listening on IPv4 address “127.0.0.1”, port 5432
Dec 12 16:57:42 dsdpsatellite postmaster[1679]: 2022-12-12 16:57:42 CET LOG: listening on Unix socket “/var/run/postgresql/.s.PGSQL.5432”
Dec 12 16:57:42 dsdpsatellite postmaster[1679]: 2022-12-12 16:57:42 CET LOG: listening on Unix socket “/tmp/.s.PGSQL.5432”
Dec 12 16:57:42 dsdpsatellite postmaster[1679]: 2022-12-12 16:57:42 CET LOG: redirecting log output to logging collector process
Dec 12 16:57:42 dsdpsatellite postmaster[1679]: 2022-12-12 16:57:42 CET HINT: Future log output will appear in directory “log”.
Dec 12 16:57:42 dsdpsatellite systemd[1]: Started PostgreSQL database server.
\ displaying pulpcore-api
● pulpcore-api.service - Pulp API Server
Loaded: loaded (/etc/systemd/system/pulpcore-api.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:42 CET; 27min ago
Main PID: 1618 (gunicorn)
Status: “Gunicorn arbiter booted”
Tasks: 6 (limit: 204127)
Memory: 554.1M
CGroup: /system.slice/pulpcore-api.service
├─1618 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s “%(r)s” %(s)s %(b)s “%(f)s” “%(a)s”
├─1905 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s “%(r)s” %(s)s %(b)s “%(f)s” “%(a)s”
├─1932 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s “%(r)s” %(s)s %(b)s “%(f)s” “%(a)s”
├─1947 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s “%(r)s” %(s)s %(b)s “%(f)s” “%(a)s”
├─1958 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s “%(r)s” %(s)s %(b)s “%(f)s” “%(a)s”
└─1961 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s “%(r)s” %(s)s %(b)s “%(f)s” “%(a)s”

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting Pulp API Server…
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1618]: [2022-12-12 16:57:42 +0100] [1618] [INFO] Starting gunicorn 20.1.0
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1618]: [2022-12-12 16:57:42 +0100] [1618] [INFO] Listening at: unix:/run/pulpcore-api.sock (1618)
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1618]: [2022-12-12 16:57:42 +0100] [1618] [INFO] Using worker: sync
Dec 12 16:57:42 dsdpsatellite systemd[1]: Started Pulp API Server.
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1905]: [2022-12-12 16:57:42 +0100] [1905] [INFO] Booting worker with pid: 1905
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1932]: [2022-12-12 16:57:42 +0100] [1932] [INFO] Booting worker with pid: 1932
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1947]: [2022-12-12 16:57:42 +0100] [1947] [INFO] Booting worker with pid: 1947
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1958]: [2022-12-12 16:57:42 +0100] [1958] [INFO] Booting worker with pid: 1958
Dec 12 16:57:42 dsdpsatellite pulpcore-api[1961]: [2022-12-12 16:57:42 +0100] [1961] [INFO] Booting worker with pid: 1961
\ displaying pulpcore-content
● pulpcore-content.service - Pulp Content App
Loaded: loaded (/etc/systemd/system/pulpcore-content.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:43 CET; 27min ago
Main PID: 1621 (gunicorn)
Status: “Gunicorn arbiter booted”
Tasks: 43 (limit: 204127)
Memory: 1.7G
CGroup: /system.slice/pulpcore-content.service
├─1621 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─1992 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2001 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2005 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2031 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2040 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2043 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2062 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2074 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2090 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2091 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2095 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2097 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2099 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2100 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2101 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
├─2102 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -
└─2103 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile -

Dec 12 16:57:43 dsdpsatellite pulpcore-content[2074]: [2022-12-12 16:57:43 +0100] [2074] [INFO] Booting worker with pid: 2074
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2090]: [2022-12-12 16:57:43 +0100] [2090] [INFO] Booting worker with pid: 2090
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2095]: [2022-12-12 16:57:43 +0100] [2095] [INFO] Booting worker with pid: 2095
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2097]: [2022-12-12 16:57:43 +0100] [2097] [INFO] Booting worker with pid: 2097
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2091]: [2022-12-12 16:57:43 +0100] [2091] [INFO] Booting worker with pid: 2091
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2099]: [2022-12-12 16:57:43 +0100] [2099] [INFO] Booting worker with pid: 2099
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2100]: [2022-12-12 16:57:43 +0100] [2100] [INFO] Booting worker with pid: 2100
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2101]: [2022-12-12 16:57:43 +0100] [2101] [INFO] Booting worker with pid: 2101
Dec 12 16:57:43 dsdpsatellite pulpcore-content[2102]: [2022-12-12 16:57:43 +0100] [2102] [INFO] Booting worker with pid: 2102
Dec 12 16:57:44 dsdpsatellite pulpcore-content[2103]: [2022-12-12 16:57:44 +0100] [2103] [INFO] Booting worker with pid: 2103
\ displaying pulpcore-worker@1.service
● pulpcore-worker@1.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1608 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 106.4M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@1.service
└─1608 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-1[1608]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-1[1608]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1608@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying pulpcore-worker@2.service
● pulpcore-worker@2.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1609 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 104.6M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@2.service
└─1609 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-2[1609]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-2[1609]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1609@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying pulpcore-worker@3.service
● pulpcore-worker@3.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1602 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 105.1M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@3.service
└─1602 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-3[1602]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-3[1602]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1602@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying pulpcore-worker@4.service
● pulpcore-worker@4.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1610 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 106.6M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@4.service
└─1610 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-4[1610]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-4[1610]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1610@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying pulpcore-worker@5.service
● pulpcore-worker@5.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1612 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 107.8M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@5.service
└─1612 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-5[1612]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-5[1612]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1612@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying pulpcore-worker@6.service
● pulpcore-worker@6.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1605 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 106.2M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@6.service
└─1605 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-6[1605]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-6[1605]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1605@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying pulpcore-worker@7.service
● pulpcore-worker@7.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1611 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 106.0M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@7.service
└─1611 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-7[1611]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-7[1611]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1611@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying pulpcore-worker@8.service
● pulpcore-worker@8.service - Pulp Worker
Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1603 (pulpcore-worker)
Tasks: 1 (limit: 204127)
Memory: 105.5M
CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@8.service
└─1603 /usr/bin/python3.9 /usr/bin/pulpcore-worker

Dec 12 16:57:41 dsdpsatellite systemd[1]: Started Pulp Worker.
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-8[1603]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker
Dec 12 16:57:58 dsdpsatellite pulpcore-worker-8[1603]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker ‘1603@dsdpsatellite.fmlogistic.fr’ discovered
\ displaying tomcat
● tomcat.service - Apache Tomcat Web Application Container
Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:41 CET; 27min ago
Main PID: 1622 (java)
Tasks: 83 (limit: 204127)
Memory: 1.2G
CGroup: /system.slice/tomcat.service
└─1622 /usr/lib/jvm/jre-11/bin/java -Xms1024m -Xmx4096m -Dcom.redhat.fips=false -Djava.security.auth.login.config=/usr/share/tomcat/conf/login.config -classpath /usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/ant.jar:/usr/share/java/ant-launcher.jar:/usr/lib/jvm/java/lib/tools.jar -Dcatalina.base=/usr/share/tomcat -Dcatalina.home=/usr/share/tomcat -Djava.endorsed.dirs= -Djava.io.tmpdir=/var/cache/tomcat/temp -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager org.apache.catalina.startup.Bootstrap start

Dec 12 16:58:07 dsdpsatellite server[1622]: 12-Dec-2022 16:58:07.889 WARNING [main] com.google.inject.internal.ProxyFactory. Method [public void org.candlepin.model.EntitlementCertificateCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [com.google.inject.persist.jpa.JpaLocalTxnInterceptor@1df468bf]. This could indicate a bug. The method may be intercepted twice, or may not be intercepted at all.
Dec 12 16:58:07 dsdpsatellite server[1622]: 12-Dec-2022 16:58:07.903 WARNING [main] com.google.inject.internal.ProxyFactory. Method [public void org.candlepin.model.ContentCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [com.google.inject.persist.jpa.JpaLocalTxnInterceptor@1df468bf]. This could indicate a bug. The method may be intercepted twice, or may not be intercepted at all.
Dec 12 16:58:14 dsdpsatellite server[1622]: WARNING: An illegal reflective access operation has occurred
Dec 12 16:58:14 dsdpsatellite server[1622]: WARNING: Illegal reflective access by org.candlepin.util.Util (file:/var/lib/tomcat/webapps/candlepin/WEB-INF/classes/) to field java.net.InetAddress.impl
Dec 12 16:58:14 dsdpsatellite server[1622]: WARNING: Please consider reporting this to the maintainers of org.candlepin.util.Util
Dec 12 16:58:14 dsdpsatellite server[1622]: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
Dec 12 16:58:14 dsdpsatellite server[1622]: WARNING: All illegal access operations will be denied in a future release
Dec 12 16:58:15 dsdpsatellite server[1622]: 12-Dec-2022 16:58:15.302 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/var/lib/tomcat/webapps/candlepin] has finished in [24,602] ms
Dec 12 16:58:15 dsdpsatellite server[1622]: 12-Dec-2022 16:58:15.305 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler [“https-jsse-nio-127.0.0.1-23443”]
Dec 12 16:58:15 dsdpsatellite server[1622]: 12-Dec-2022 16:58:15.325 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [25163] milliseconds
| displaying dynflow-sidekiq@orchestrator
● dynflow-sidekiq@orchestrator.service - Foreman jobs daemon - orchestrator on sidekiq
Loaded: loaded (/usr/lib/systemd/system/dynflow-sidekiq@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:58:48 CET; 25min ago
Docs: https://theforeman.org
Main PID: 1672 (sidekiq)
Tasks: 11 (limit: 204127)
Memory: 419.3M
CGroup: /system.slice/system-dynflow\x2dsidekiq.slice/dynflow-sidekiq@orchestrator.service
└─1672 sidekiq 5.2.10 [0 of 1 busy]

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting Foreman jobs daemon - orchestrator on sidekiq…
Dec 12 16:57:47 dsdpsatellite dynflow-sidekiq@orchestrator[1672]: 2022-12-12T15:57:47.427Z 1672 TID-8k INFO: GitLab reliable fetch activated!
Dec 12 16:57:47 dsdpsatellite dynflow-sidekiq@orchestrator[1672]: 2022-12-12T15:57:47.440Z 1672 TID-9k INFO: Booting Sidekiq 5.2.10 with redis options {:id=>“Sidekiq-server-PID-1672”, :url=>“redis://localhost:6379/0”}
Dec 12 16:57:59 dsdpsatellite dynflow-sidekiq@orchestrator[1672]: Top level ::CompositeIO is deprecated, require ‘multipart/post’ and use Multipart::Post::CompositeReadIO instead!
Dec 12 16:57:59 dsdpsatellite dynflow-sidekiq@orchestrator[1672]: Top level ::Parts is deprecated, require ‘multipart/post’ and use Multipart::Post::Parts instead!
Dec 12 16:58:48 dsdpsatellite systemd[1]: Started Foreman jobs daemon - orchestrator on sidekiq.
| displaying foreman
● foreman.service - Foreman
Loaded: loaded (/usr/lib/systemd/system/foreman.service; enabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/foreman.service.d
└─installer.conf
Active: active (running) since Mon 2022-12-12 16:58:18 CET; 26min ago
Docs: https://theforeman.org
Main PID: 1667 (rails)
Tasks: 226 (limit: 204127)
Memory: 2.3G
CGroup: /system.slice/foreman.service
├─1667 puma 5.6.4 (unix:///run/foreman.sock) [foreman]
├─2523 puma: cluster worker 0: 1667 [foreman]
├─2526 puma: cluster worker 1: 1667 [foreman]
├─2531 puma: cluster worker 2: 1667 [foreman]
├─2536 puma: cluster worker 3: 1667 [foreman]
├─2542 puma: cluster worker 4: 1667 [foreman]
├─2549 puma: cluster worker 5: 1667 [foreman]
├─2554 puma: cluster worker 6: 1667 [foreman]
├─2558 puma: cluster worker 7: 1667 [foreman]
├─2562 puma: cluster worker 8: 1667 [foreman]
├─2569 puma: cluster worker 9: 1667 [foreman]
├─2573 puma: cluster worker 10: 1667 [foreman]
└─2577 puma: cluster worker 11: 1667 [foreman]

Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 0 (PID: 2523) booted in 0.28s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 6 (PID: 2554) booted in 0.25s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 5 (PID: 2549) booted in 0.28s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 7 (PID: 2558) booted in 0.27s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 8 (PID: 2562) booted in 0.26s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 9 (PID: 2569) booted in 0.28s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 2 (PID: 2531) booted in 0.33s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 11 (PID: 2577) booted in 0.29s, phase: 0
Dec 12 16:58:18 dsdpsatellite foreman[1667]: [1667] - Worker 1 (PID: 2526) booted in 0.37s, phase: 0
Dec 12 16:58:18 dsdpsatellite systemd[1]: Started Foreman.
| displaying httpd
● httpd.service - The Apache HTTP Server
Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:57:42 CET; 27min ago
Docs: man:httpd.service(8)
Main PID: 1678 (httpd)
Status: “Total requests: 243; Idle/Busy workers 100/0;Requests/sec: 0.15; Bytes served/sec: 1.7KB/sec”
Tasks: 37 (limit: 204127)
Memory: 26.3M
CGroup: /system.slice/httpd.service
├─1678 /usr/sbin/httpd -DFOREGROUND
├─1726 /usr/sbin/httpd -DFOREGROUND
└─1727 /usr/sbin/httpd -DFOREGROUND

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting The Apache HTTP Server…
Dec 12 16:57:42 dsdpsatellite httpd[1678]: AH00513: WARNING: MaxRequestWorkers of 150 is not an integer multiple of ThreadsPerChild of 16, decreasing to nearest multiple 144, for a maximum of 9 servers.
Dec 12 16:57:42 dsdpsatellite systemd[1]: Started The Apache HTTP Server.
Dec 12 16:57:42 dsdpsatellite httpd[1678]: Server configured, listening on: port 80, port 443
| displaying dynflow-sidekiq@worker-1
● dynflow-sidekiq@worker-1.service - Foreman jobs daemon - worker-1 on sidekiq
Loaded: loaded (/usr/lib/systemd/system/dynflow-sidekiq@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:58:18 CET; 26min ago
Docs: https://theforeman.org
Main PID: 1671 (sidekiq)
Tasks: 15 (limit: 204127)
Memory: 433.4M
CGroup: /system.slice/system-dynflow\x2dsidekiq.slice/dynflow-sidekiq@worker-1.service
└─1671 sidekiq 5.2.10 [0 of 5 busy]

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting Foreman jobs daemon - worker-1 on sidekiq…
Dec 12 16:57:46 dsdpsatellite dynflow-sidekiq@worker-1[1671]: 2022-12-12T15:57:46.845Z 1671 TID-8r INFO: GitLab reliable fetch activated!
Dec 12 16:57:46 dsdpsatellite dynflow-sidekiq@worker-1[1671]: 2022-12-12T15:57:46.864Z 1671 TID-9j INFO: Booting Sidekiq 5.2.10 with redis options {:id=>“Sidekiq-server-PID-1671”, :url=>“redis://localhost:6379/0”}
Dec 12 16:57:59 dsdpsatellite dynflow-sidekiq@worker-1[1671]: Top level ::CompositeIO is deprecated, require ‘multipart/post’ and use Multipart::Post::CompositeReadIO instead!
Dec 12 16:57:59 dsdpsatellite dynflow-sidekiq@worker-1[1671]: Top level ::Parts is deprecated, require ‘multipart/post’ and use Multipart::Post::Parts instead!
Dec 12 16:58:18 dsdpsatellite systemd[1]: Started Foreman jobs daemon - worker-1 on sidekiq.
| displaying dynflow-sidekiq@worker-hosts-queue-1
● dynflow-sidekiq@worker-hosts-queue-1.service - Foreman jobs daemon - worker-hosts-queue-1 on sidekiq
Loaded: loaded (/usr/lib/systemd/system/dynflow-sidekiq@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2022-12-12 16:58:18 CET; 26min ago
Docs: https://theforeman.org
Main PID: 1661 (sidekiq)
Tasks: 15 (limit: 204127)
Memory: 434.8M
CGroup: /system.slice/system-dynflow\x2dsidekiq.slice/dynflow-sidekiq@worker-hosts-queue-1.service
└─1661 sidekiq 5.2.10 [0 of 5 busy]

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting Foreman jobs daemon - worker-hosts-queue-1 on sidekiq…
Dec 12 16:57:46 dsdpsatellite dynflow-sidekiq@worker-hosts-queue-1[1661]: 2022-12-12T15:57:46.831Z 1661 TID-ch INFO: GitLab reliable fetch activated!
Dec 12 16:57:46 dsdpsatellite dynflow-sidekiq@worker-hosts-queue-1[1661]: 2022-12-12T15:57:46.843Z 1661 TID-bx INFO: Booting Sidekiq 5.2.10 with redis options {:id=>“Sidekiq-server-PID-1661”, :url=>“redis://localhost:6379/0”}
Dec 12 16:57:59 dsdpsatellite dynflow-sidekiq@worker-hosts-queue-1[1661]: Top level ::CompositeIO is deprecated, require ‘multipart/post’ and use Multipart::Post::CompositeReadIO instead!
Dec 12 16:57:59 dsdpsatellite dynflow-sidekiq@worker-hosts-queue-1[1661]: Top level ::Parts is deprecated, require ‘multipart/post’ and use Multipart::Post::Parts instead!
Dec 12 16:58:18 dsdpsatellite systemd[1]: Started Foreman jobs daemon - worker-hosts-queue-1 on sidekiq.
| displaying foreman-proxy
● foreman-proxy.service - Foreman Proxy
Loaded: loaded (/usr/lib/systemd/system/foreman-proxy.service; enabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/foreman-proxy.service.d
└─90-limits.conf
Active: active (running) since Mon 2022-12-12 16:57:50 CET; 26min ago
Main PID: 1629 (smart-proxy)
Tasks: 7 (limit: 204127)
Memory: 89.8M
CGroup: /system.slice/foreman-proxy.service
└─1629 /usr/bin/ruby /usr/share/foreman-proxy/bin/smart-proxy --no-daemonize

Dec 12 16:57:41 dsdpsatellite systemd[1]: Starting Foreman Proxy…
Dec 12 16:57:50 dsdpsatellite systemd[1]: Started Foreman Proxy.

All services are running [OK]

Any idea please ?

Thx in advance

is the issue solved?