Katello 4.2.2 --> 4.3.1 upgrade fails

Support
,
1

Tried an upgrade, dynflow-sidekiq seems to have issues. I am open to ideas! Thank you.

Upgrading from foreman 3.0 to 3.1, Katello 4.2 to 4.3

foreman-installer

2022-04-18 15:19:29 [NOTICE] [root] Loading installer configuration. This will take some time.
2022-04-18 15:19:32 [NOTICE] [root] Running installer with log based terminal output at level NOTICE.
2022-04-18 15:19:32 [NOTICE] [root] Use -l to set the terminal output log level to ERROR, WARN, NOTICE, INFO, or DEBUG. See --full-help for definitions.
2022-04-18 15:19:35 [NOTICE] [configure] Starting system configuration.
2022-04-18 15:19:44 [NOTICE] [configure] 250 configuration steps out of 1897 steps complete.
2022-04-18 15:19:46 [NOTICE] [configure] 500 configuration steps out of 1899 steps complete.
2022-04-18 15:19:48 [NOTICE] [configure] 750 configuration steps out of 1902 steps complete.
2022-04-18 15:19:49 [NOTICE] [configure] 1000 configuration steps out of 1907 steps complete.
2022-04-18 15:19:50 [NOTICE] [configure] 1250 configuration steps out of 1909 steps complete.
2022-04-18 15:20:12 [NOTICE] [configure] 1500 configuration steps out of 1909 steps complete.
2022-04-18 15:20:12 [NOTICE] [configure] 1750 configuration steps out of 1909 steps complete.
2022-04-18 15:20:16 [ERROR ] [configure] Systemd start for dynflow-sidekiq@orchestrator failed!
2022-04-18 15:20:16 [ERROR ] [configure] journalctl log for dynflow-sidekiq@orchestrator:
2022-04-18 15:20:16 [ERROR ] [configure] – Logs begin at Mon 2022-04-18 10:17:14 CDT, end at Mon 2022-04-18 15:20:16 CDT. –
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:19 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/foreman_puppet-2.0.4/lib/foreman_puppet/register.rb:156: warning: already initialized constant Foreman::Plugin::RbacSupport::AUTO_EXTENDED_ROLES
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:19 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/foreman/app/registries/foreman/plugin/rbac_support.rb:5: warning: previous definition of AUTO_EXTENDED_ROLES was here
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: 293 extra bytes after the deserialized object
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in full_unpack' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in load’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:390:in load_data' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in block in find_coordinator_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in map' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in find_coordinator_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator_adapters/sequel.rb:30:in find_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:366:in find_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:372:in find_worlds' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:131:in worlds_validity_check’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:118:in perform_validity_checks' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:46:in block in initialize!’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in tap' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in initialize!’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/foreman/extras/dynflow-sidekiq.rb:34:in <top (required)>' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/rubygems/rubygems/core_ext/kernel_require.rb:83:in require’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/cli.rb:292:in boot_system' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/cli.rb:46:in run’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/sidekiq-5.2.7/bin/sidekiq:12:in <top (required)>' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/bin/sidekiq:23:in load’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/bin/sidekiq:23:in <main>' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Main process exited, code=exited, status=1/FAILURE 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Failed with result 'exit-code'. 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu systemd[1]: Failed to start Foreman jobs daemon - orchestrator on sidekiq. 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Service RestartSec=1s expired, scheduling restart. 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Scheduled restart job, restart counter is at 16. 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: Stopped Foreman jobs daemon - orchestrator on sidekiq. 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: Starting Foreman jobs daemon - orchestrator on sidekiq... 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:31 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: 2022-04-18T20:15:31.094Z 88787 TID-1wzr INFO: GitLab reliable fetch activated! 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:31 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: 2022-04-18T20:15:31.095Z 88787 TID-1x17 INFO: Booting Sidekiq 5.2.7 with redis options {:id=>"Sidekiq-server-PID-88787", :url=>"redis://localhost:6379/0"} 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:37 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/foreman_puppet-2.0.4/lib/foreman_puppet/register.rb:156: warning: already initialized constant Foreman::Plugin::RbacSupport::AUTO_EXTENDED_ROLES 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:37 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/foreman/app/registries/foreman/plugin/rbac_support.rb:5: warning: previous definition of AUTO_EXTENDED_ROLES was here 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: 293 extra bytes after the deserialized object 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in full_unpack’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in load' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:390:in load_data’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in block in find_coordinator_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in map’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in find_coordinator_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator_adapters/sequel.rb:30:in find_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:366:in find_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:372:in find_worlds’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:131:in worlds_validity_check' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:118:in perform_validity_checks’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:46:in block in initialize!' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in tap’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in initialize!' 2022-04-18 15:20:16 [ERROR ] [configure] /Stage[main]/Foreman::Service/Foreman::Dynflow::Worker[orchestrator]/Service[dynflow-sidekiq@orchestrator]/ensure: change from 'stopped' to 'running' failed: Systemd start for dynflow-sidekiq@orchestrator failed! 2022-04-18 15:20:16 [ERROR ] [configure] journalctl log for dynflow-sidekiq@orchestrator: 2022-04-18 15:20:16 [ERROR ] [configure] -- Logs begin at Mon 2022-04-18 10:17:14 CDT, end at Mon 2022-04-18 15:20:16 CDT. -- 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:19 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/foreman_puppet-2.0.4/lib/foreman_puppet/register.rb:156: warning: already initialized constant Foreman::Plugin::RbacSupport::AUTO_EXTENDED_ROLES 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:19 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/foreman/app/registries/foreman/plugin/rbac_support.rb:5: warning: previous definition of AUTO_EXTENDED_ROLES was here 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: 293 extra bytes after the deserialized object 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in full_unpack’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in load' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:390:in load_data’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in block in find_coordinator_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in map’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in find_coordinator_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator_adapters/sequel.rb:30:in find_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:366:in find_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:372:in find_worlds’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:131:in worlds_validity_check' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:118:in perform_validity_checks’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:46:in block in initialize!' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in tap’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in initialize!' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/foreman/extras/dynflow-sidekiq.rb:34:in <top (required)>’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/rubygems/rubygems/core_ext/kernel_require.rb:83:in require' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/cli.rb:292:in boot_system’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/cli.rb:46:in run' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/share/gems/gems/sidekiq-5.2.7/bin/sidekiq:12:in <top (required)>’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/bin/sidekiq:23:in load' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88763]: /usr/bin/sidekiq:23:in ’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Main process exited, code=exited, status=1/FAILURE
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Failed with result ‘exit-code’.
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:28 katello.ctsi.mcw.edu systemd[1]: Failed to start Foreman jobs daemon - orchestrator on sidekiq.
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Service RestartSec=1s expired, scheduling restart.
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: dynflow-sidekiq@orchestrator.service: Scheduled restart job, restart counter is at 16.
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: Stopped Foreman jobs daemon - orchestrator on sidekiq.
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:30 katello.ctsi.mcw.edu systemd[1]: Starting Foreman jobs daemon - orchestrator on sidekiq…
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:31 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: 2022-04-18T20:15:31.094Z 88787 TID-1wzr INFO: GitLab reliable fetch activated!
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:31 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: 2022-04-18T20:15:31.095Z 88787 TID-1x17 INFO: Booting Sidekiq 5.2.7 with redis options {:id=>“Sidekiq-server-PID-88787”, :url=>“redis://localhost:6379/0”}
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:37 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/foreman_puppet-2.0.4/lib/foreman_puppet/register.rb:156: warning: already initialized constant Foreman::Plugin::RbacSupport::AUTO_EXTENDED_ROLES
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:37 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/foreman/app/registries/foreman/plugin/rbac_support.rb:5: warning: previous definition of AUTO_EXTENDED_ROLES was here
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: 293 extra bytes after the deserialized object
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in full_unpack' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in load’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:390:in load_data' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in block in find_coordinator_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in map' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/persistence_adapters/sequel.rb:260:in find_coordinator_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator_adapters/sequel.rb:30:in find_records' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:366:in find_records’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/coordinator.rb:372:in find_worlds' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:131:in worlds_validity_check’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/world/invalidation.rb:118:in perform_validity_checks' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:46:in block in initialize!’
2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in tap' 2022-04-18 15:20:16 [ERROR ] [configure] Apr 18 15:15:46 katello.ctsi.mcw.edu dynflow-sidekiq@orchestrator[88787]: /usr/share/gems/gems/dynflow-1.6.3/lib/dynflow/rails.rb:38:in initialize!’
2022-04-18 15:20:25 [NOTICE] [configure] System configuration has finished.

There were errors detected during install.
Please address the errors and re-run the installer to ensure the system is properly configured.
Failing to do so is likely to result in broken functionality.

The full log is at /var/log/foreman-installer/katello.log