Running Status Services ================================================================================ Get status of applicable services: Displaying the following service(s): redis, postgresql (candlepin), postgresql (foreman), postgresql (pulpcore), pulpcore-api, pulpcore-content, pulpcore-worker@1.service, pulpcore-worker@2.service, pulpcore-worker@3.service, pulpcore-worker@4.service, pulpcore-worker@5.service, pulpcore-worker@6.service, pulpcore-worker@7.service, pulpcore-worker@8.service, tomcat, dynflow-sidekiq@orchestrator, foreman, httpd, dynflow-sidekiq@worker-1, dynflow-sidekiq@worker-hosts-queue-1, foreman-proxy | / / displaying redis ● redis.service - Redis persistent key-value database Loaded: loaded (/usr/lib/systemd/system/redis.service; enabled; vendor preset: disabled) Drop-In: /etc/systemd/system/redis.service.d └─90-limits.conf Active: active (running) since Thu 2023-02-02 23:45:38 EST; 22min ago Process: 168296 ExecStop=/usr/libexec/redis-shutdown (code=exited, status=0/SUCCESS) Main PID: 168574 (redis-server) Status: "Ready to accept connections" Tasks: 5 (limit: 3355442) Memory: 11.0M CGroup: /system.slice/redis.service └─168574 /usr/bin/redis-server 127.0.0.1:6379 Feb 02 23:45:38 sjprdsatapp01.cadence.com systemd[1]: Starting Redis persistent key-value database... Feb 02 23:45:38 sjprdsatapp01.cadence.com systemd[1]: Started Redis persistent key-value database. / displaying postgresql (candlepin) postgresql (candlepin) is remote and is UP. / displaying postgresql (foreman) postgresql (foreman) is remote and is UP. / displaying postgresql (pulpcore) postgresql (pulpcore) is remote and is UP. / displaying pulpcore-api ● pulpcore-api.service - Pulp API Server Loaded: loaded (/etc/systemd/system/pulpcore-api.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168589 (gunicorn) Status: "Gunicorn arbiter booted" Tasks: 6 (limit: 3355442) Memory: 488.5M CGroup: /system.slice/pulpcore-api.service ├─168589 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s" ├─168593 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s" ├─168619 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s" ├─168629 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s" ├─168743 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s" └─168748 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.app.wsgi:application --timeout 90 -w 5 --access-logfile - --access-logformat pulp [%({correlation-id}o)s]: %(h)s %(l)s %(u)s %(t)s "%(r)s" %(s)s %(b)s "%(f)s" "%(a)s" Feb 02 23:45:38 sjprdsatapp01.cadence.com systemd[1]: Starting Pulp API Server... Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168589]: [2023-02-02 23:45:39 -0500] [168589] [INFO] Starting gunicorn 20.1.0 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168589]: [2023-02-02 23:45:39 -0500] [168589] [INFO] Listening at: unix:/run/pulpcore-api.sock (168589) Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168589]: [2023-02-02 23:45:39 -0500] [168589] [INFO] Using worker: sync Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp API Server. Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168593]: [2023-02-02 23:45:39 -0500] [168593] [INFO] Booting worker with pid: 168593 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168619]: [2023-02-02 23:45:39 -0500] [168619] [INFO] Booting worker with pid: 168619 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168629]: [2023-02-02 23:45:39 -0500] [168629] [INFO] Booting worker with pid: 168629 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168743]: [2023-02-02 23:45:39 -0500] [168743] [INFO] Booting worker with pid: 168743 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-api[168748]: [2023-02-02 23:45:39 -0500] [168748] [INFO] Booting worker with pid: 168748 / displaying pulpcore-content ● pulpcore-content.service - Pulp Content App Loaded: loaded (/etc/systemd/system/pulpcore-content.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168590 (gunicorn) Status: "Gunicorn arbiter booted" Tasks: 35 (limit: 3355442) Memory: 1.6G CGroup: /system.slice/pulpcore-content.service ├─168590 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168591 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168592 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168617 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168625 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168653 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168746 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168752 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168755 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168756 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168757 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168758 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168759 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168760 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168761 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168762 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - ├─168763 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - └─168764 /usr/bin/python3.9 /usr/bin/gunicorn pulpcore.content:server --timeout 90 --worker-class aiohttp.GunicornWebWorker -w 17 --access-logfile - Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168755]: [2023-02-02 23:45:39 -0500] [168755] [INFO] Booting worker with pid: 168755 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168756]: [2023-02-02 23:45:39 -0500] [168756] [INFO] Booting worker with pid: 168756 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168757]: [2023-02-02 23:45:39 -0500] [168757] [INFO] Booting worker with pid: 168757 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168758]: [2023-02-02 23:45:39 -0500] [168758] [INFO] Booting worker with pid: 168758 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168759]: [2023-02-02 23:45:39 -0500] [168759] [INFO] Booting worker with pid: 168759 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168760]: [2023-02-02 23:45:39 -0500] [168760] [INFO] Booting worker with pid: 168760 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168762]: [2023-02-02 23:45:39 -0500] [168762] [INFO] Booting worker with pid: 168762 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168761]: [2023-02-02 23:45:39 -0500] [168761] [INFO] Booting worker with pid: 168761 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168763]: [2023-02-02 23:45:39 -0500] [168763] [INFO] Booting worker with pid: 168763 Feb 02 23:45:39 sjprdsatapp01.cadence.com pulpcore-content[168764]: [2023-02-02 23:45:39 -0500] [168764] [INFO] Booting worker with pid: 168764 / displaying pulpcore-worker@1.service ● pulpcore-worker@1.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168601 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.5M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@1.service └─168601 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-1[168601]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-1[168601]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168601@sjprdsatapp01.cadence.com' discovered / displaying pulpcore-worker@2.service ● pulpcore-worker@2.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168608 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.5M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@2.service └─168608 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-2[168608]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-2[168608]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168608@sjprdsatapp01.cadence.com' discovered / displaying pulpcore-worker@3.service ● pulpcore-worker@3.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168622 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.5M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@3.service └─168622 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-3[168622]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-3[168622]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168622@sjprdsatapp01.cadence.com' discovered / displaying pulpcore-worker@4.service ● pulpcore-worker@4.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168611 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.5M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@4.service └─168611 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-4[168611]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-4[168611]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168611@sjprdsatapp01.cadence.com' discovered / displaying pulpcore-worker@5.service ● pulpcore-worker@5.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168612 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.4M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@5.service └─168612 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-5[168612]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-5[168612]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168612@sjprdsatapp01.cadence.com' discovered / displaying pulpcore-worker@6.service ● pulpcore-worker@6.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168618 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.5M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@6.service └─168618 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-6[168618]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-6[168618]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168618@sjprdsatapp01.cadence.com' discovered / displaying pulpcore-worker@7.service ● pulpcore-worker@7.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168621 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.5M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@7.service └─168621 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-7[168621]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-7[168621]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168621@sjprdsatapp01.cadence.com' discovered / displaying pulpcore-worker@8.service ● pulpcore-worker@8.service - Pulp Worker Loaded: loaded (/etc/systemd/system/pulpcore-worker@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168620 (pulpcore-worker) Tasks: 1 (limit: 3355442) Memory: 97.5M CGroup: /system.slice/system-pulpcore\x2dworker.slice/pulpcore-worker@8.service └─168620 /usr/bin/python3.9 /usr/bin/pulpcore-worker Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started Pulp Worker. Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-8[168620]: pulp [None]: pulpcore.tasking.entrypoint:INFO: Starting distributed type worker Feb 02 23:45:42 sjprdsatapp01.cadence.com pulpcore-worker-8[168620]: pulp [None]: pulpcore.tasking.pulpcore_worker:INFO: New worker '168620@sjprdsatapp01.cadence.com' discovered / displaying tomcat ● tomcat.service - Apache Tomcat Web Application Container Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Main PID: 168623 (java) Tasks: 62 (limit: 3355442) Memory: 978.9M CGroup: /system.slice/tomcat.service └─168623 /usr/lib/jvm/jre-11/bin/java -Xms1024m -Xmx4096m -Dcom.redhat.fips=false -Djava.security.auth.login.config=/usr/share/tomcat/conf/login.config -classpath /usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/ant.jar:/usr/share/java/ant-launcher.jar:/usr/lib/jvm/java/lib/tools.jar -Dcatalina.base=/usr/share/tomcat -Dcatalina.home=/usr/share/tomcat -Djava.endorsed.dirs= -Djava.io.tmpdir=/var/cache/tomcat/temp -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager org.apache.catalina.startup.Bootstrap start Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: 02-Feb-2023 23:45:46.685 SEVERE [main] org.apache.catalina.core.StandardContext.startInternal Context [/candlepin] startup failed due to previous errors Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: 02-Feb-2023 23:45:46.718 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [candlepin] registered the JDBC driver [org.postgresql.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered. Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: WARNING: An illegal reflective access operation has occurred Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: WARNING: Illegal reflective access by org.apache.catalina.loader.WebappClassLoaderBase (file:/usr/share/java/tomcat/catalina.jar) to field java.io.ObjectStreamClass$Caches.localDescs Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: WARNING: Please consider reporting this to the maintainers of org.apache.catalina.loader.WebappClassLoaderBase Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: WARNING: All illegal access operations will be denied in a future release Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: 02-Feb-2023 23:45:46.724 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/var/lib/tomcat/webapps/candlepin] has finished in [6,133] ms Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: 02-Feb-2023 23:45:46.727 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["https-jsse-nio-127.0.0.1-23443"] Feb 02 23:45:46 sjprdsatapp01.cadence.com server[168623]: 02-Feb-2023 23:45:46.735 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [6,220] milliseconds / displaying dynflow-sidekiq@orchestrator ● dynflow-sidekiq@orchestrator.service - Foreman jobs daemon - orchestrator on sidekiq Loaded: loaded (/usr/lib/systemd/system/dynflow-sidekiq@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:53 EST; 22min ago Docs: https://theforeman.org Main PID: 168634 (sidekiq) Status: "Everything ready for world: 6fa863c1-394a-485e-9c43-f0511f9bd704" Tasks: 12 (limit: 3355442) Memory: 386.6M CGroup: /system.slice/system-dynflow\x2dsidekiq.slice/dynflow-sidekiq@orchestrator.service └─168634 sidekiq 6.3.1 [0 of 1 busy] Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Starting Foreman jobs daemon - orchestrator on sidekiq... Feb 02 23:45:39 sjprdsatapp01.cadence.com dynflow-sidekiq@orchestrator[168634]: 2023-02-03T04:45:39.472Z pid=168634 tid=3msm INFO: Enabling systemd notification integration Feb 02 23:45:40 sjprdsatapp01.cadence.com dynflow-sidekiq@orchestrator[168634]: 2023-02-03T04:45:40.201Z pid=168634 tid=3msm INFO: Booting Sidekiq 6.3.1 with redis options {:url=>"redis://localhost:6379/0"} Feb 02 23:45:40 sjprdsatapp01.cadence.com dynflow-sidekiq@orchestrator[168634]: 2023-02-03T04:45:40.201Z pid=168634 tid=3msm INFO: GitLab reliable fetch activated! Feb 02 23:45:53 sjprdsatapp01.cadence.com systemd[1]: Started Foreman jobs daemon - orchestrator on sidekiq. / displaying foreman ● foreman.service - Foreman Loaded: loaded (/usr/lib/systemd/system/foreman.service; enabled; vendor preset: disabled) Drop-In: /etc/systemd/system/foreman.service.d └─installer.conf Active: active (running) since Thu 2023-02-02 23:45:54 EST; 22min ago Docs: https://theforeman.org Main PID: 168636 (rails) Tasks: 869 (limit: 3355442) Memory: 3.0G CGroup: /system.slice/foreman.service ├─168636 puma 5.6.5 (unix:///run/foreman.sock) [foreman] ├─169067 puma: cluster worker 0: 168636 [foreman] ├─169071 puma: cluster worker 1: 168636 [foreman] ├─169076 puma: cluster worker 2: 168636 [foreman] ├─169084 puma: cluster worker 3: 168636 [foreman] ├─169089 puma: cluster worker 4: 168636 [foreman] ├─169095 puma: cluster worker 5: 168636 [foreman] ├─169101 puma: cluster worker 6: 168636 [foreman] ├─169108 puma: cluster worker 7: 168636 [foreman] ├─169115 puma: cluster worker 8: 168636 [foreman] ├─169120 puma: cluster worker 9: 168636 [foreman] ├─169128 puma: cluster worker 10: 168636 [foreman] ├─169135 puma: cluster worker 11: 168636 [foreman] ├─169141 puma: cluster worker 12: 168636 [foreman] ├─169152 puma: cluster worker 13: 168636 [foreman] ├─169165 puma: cluster worker 14: 168636 [foreman] ├─169180 puma: cluster worker 15: 168636 [foreman] ├─169199 puma: cluster worker 16: 168636 [foreman] ├─169224 puma: cluster worker 17: 168636 [foreman] ├─169254 puma: cluster worker 18: 168636 [foreman] ├─169279 puma: cluster worker 19: 168636 [foreman] ├─169293 puma: cluster worker 20: 168636 [foreman] ├─169320 puma: cluster worker 21: 168636 [foreman] ├─169340 puma: cluster worker 22: 168636 [foreman] ├─169362 puma: cluster worker 23: 168636 [foreman] ├─169379 puma: cluster worker 24: 168636 [foreman] ├─169400 puma: cluster worker 25: 168636 [foreman] ├─169416 puma: cluster worker 26: 168636 [foreman] ├─169437 puma: cluster worker 27: 168636 [foreman] ├─169459 puma: cluster worker 28: 168636 [foreman] ├─169483 puma: cluster worker 29: 168636 [foreman] ├─169502 puma: cluster worker 30: 168636 [foreman] ├─169522 puma: cluster worker 31: 168636 [foreman] ├─169534 puma: cluster worker 32: 168636 [foreman] ├─169556 puma: cluster worker 33: 168636 [foreman] ├─169576 puma: cluster worker 34: 168636 [foreman] ├─169599 puma: cluster worker 35: 168636 [foreman] ├─169619 puma: cluster worker 36: 168636 [foreman] ├─169634 puma: cluster worker 37: 168636 [foreman] ├─169653 puma: cluster worker 38: 168636 [foreman] ├─169677 puma: cluster worker 39: 168636 [foreman] ├─169698 puma: cluster worker 40: 168636 [foreman] ├─169719 puma: cluster worker 41: 168636 [foreman] ├─169736 puma: cluster worker 42: 168636 [foreman] ├─169758 puma: cluster worker 43: 168636 [foreman] ├─169775 puma: cluster worker 44: 168636 [foreman] ├─169792 puma: cluster worker 45: 168636 [foreman] ├─169809 puma: cluster worker 46: 168636 [foreman] └─169833 puma: cluster worker 47: 168636 [foreman] Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 39 (PID: 169677) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 40 (PID: 169698) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 41 (PID: 169719) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 42 (PID: 169736) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 43 (PID: 169758) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 44 (PID: 169775) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 45 (PID: 169792) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 46 (PID: 169809) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com foreman[168636]: [168636] - Worker 47 (PID: 169833) booted in 0.06s, phase: 0 Feb 02 23:45:54 sjprdsatapp01.cadence.com systemd[1]: Started Foreman. / displaying httpd ● httpd.service - The Apache HTTP Server Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:45:39 EST; 22min ago Docs: man:httpd.service(8) Main PID: 168639 (httpd) Status: "Running, listening on: port 80, port 443" Tasks: 85 (limit: 3355442) Memory: 21.1M CGroup: /system.slice/httpd.service ├─168639 /usr/sbin/httpd -DFOREGROUND ├─168655 /usr/sbin/httpd -DFOREGROUND └─168656 /usr/sbin/httpd -DFOREGROUND Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Starting The Apache HTTP Server... Feb 02 23:45:39 sjprdsatapp01.cadence.com httpd[168639]: AH00513: WARNING: MaxRequestWorkers of 150 is not an integer multiple of ThreadsPerChild of 16, decreasing to nearest multiple 144, for a maximum of 9 servers. Feb 02 23:45:39 sjprdsatapp01.cadence.com systemd[1]: Started The Apache HTTP Server. Feb 02 23:45:39 sjprdsatapp01.cadence.com httpd[168639]: Server configured, listening on: port 80, port 443 / displaying dynflow-sidekiq@worker-1 ● dynflow-sidekiq@worker-1.service - Foreman jobs daemon - worker-1 on sidekiq Loaded: loaded (/usr/lib/systemd/system/dynflow-sidekiq@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:46:09 EST; 22min ago Docs: https://theforeman.org Main PID: 170007 (sidekiq) Status: "Everything ready for world: 6ccbc0e0-ea28-4737-98d0-f78b9e6eb44d" Tasks: 15 (limit: 3355442) Memory: 399.8M CGroup: /system.slice/system-dynflow\x2dsidekiq.slice/dynflow-sidekiq@worker-1.service └─170007 sidekiq 6.3.1 [0 of 5 busy] Feb 02 23:45:54 sjprdsatapp01.cadence.com systemd[1]: Starting Foreman jobs daemon - worker-1 on sidekiq... Feb 02 23:45:54 sjprdsatapp01.cadence.com dynflow-sidekiq@worker-1[170007]: 2023-02-03T04:45:54.984Z pid=170007 tid=3o23 INFO: Enabling systemd notification integration Feb 02 23:45:55 sjprdsatapp01.cadence.com dynflow-sidekiq@worker-1[170007]: 2023-02-03T04:45:55.687Z pid=170007 tid=3o23 INFO: Booting Sidekiq 6.3.1 with redis options {:url=>"redis://localhost:6379/0"} Feb 02 23:45:55 sjprdsatapp01.cadence.com dynflow-sidekiq@worker-1[170007]: 2023-02-03T04:45:55.688Z pid=170007 tid=3o23 INFO: GitLab reliable fetch activated! Feb 02 23:46:09 sjprdsatapp01.cadence.com systemd[1]: Started Foreman jobs daemon - worker-1 on sidekiq. / displaying dynflow-sidekiq@worker-hosts-queue-1 ● dynflow-sidekiq@worker-hosts-queue-1.service - Foreman jobs daemon - worker-hosts-queue-1 on sidekiq Loaded: loaded (/usr/lib/systemd/system/dynflow-sidekiq@.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:46:09 EST; 22min ago Docs: https://theforeman.org Main PID: 170006 (sidekiq) Status: "Everything ready for world: 648c8528-edd2-4b9e-8e5b-7ac3ed482dd3" Tasks: 15 (limit: 3355442) Memory: 399.5M CGroup: /system.slice/system-dynflow\x2dsidekiq.slice/dynflow-sidekiq@worker-hosts-queue-1.service └─170006 sidekiq 6.3.1 [0 of 5 busy] Feb 02 23:45:54 sjprdsatapp01.cadence.com systemd[1]: Starting Foreman jobs daemon - worker-hosts-queue-1 on sidekiq... Feb 02 23:45:54 sjprdsatapp01.cadence.com dynflow-sidekiq@worker-hosts-queue-1[170006]: 2023-02-03T04:45:54.984Z pid=170006 tid=3o22 INFO: Enabling systemd notification integration Feb 02 23:45:55 sjprdsatapp01.cadence.com dynflow-sidekiq@worker-hosts-queue-1[170006]: 2023-02-03T04:45:55.687Z pid=170006 tid=3o22 INFO: Booting Sidekiq 6.3.1 with redis options {:url=>"redis://localhost:6379/0"} Feb 02 23:45:55 sjprdsatapp01.cadence.com dynflow-sidekiq@worker-hosts-queue-1[170006]: 2023-02-03T04:45:55.688Z pid=170006 tid=3o22 INFO: GitLab reliable fetch activated! Feb 02 23:46:09 sjprdsatapp01.cadence.com systemd[1]: Started Foreman jobs daemon - worker-hosts-queue-1 on sidekiq. / displaying foreman-proxy ● foreman-proxy.service - Foreman Proxy Loaded: loaded (/usr/lib/systemd/system/foreman-proxy.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2023-02-02 23:46:10 EST; 22min ago Main PID: 171192 (smart-proxy) Tasks: 2 (limit: 3355442) Memory: 38.4M CGroup: /system.slice/foreman-proxy.service └─171192 /usr/bin/ruby /usr/share/foreman-proxy/bin/smart-proxy Feb 02 23:46:09 sjprdsatapp01.cadence.com systemd[1]: Starting Foreman Proxy... Feb 02 23:46:10 sjprdsatapp01.cadence.com systemd[1]: Started Foreman Proxy. / All services displayed / All services are running [OK] --------------------------------------------------------------------------------