the installs passed finally – thanks @ezr-ondrej and @nadjaheitmann!
The upgrades fail to start dynflow tho.
Oct 15 10:56:40 pipe-up-foreman-nightly-centos7.n5.example.com systemd[1]: Starting Foreman jobs daemon - orchestrator on sidekiq...
Oct 15 10:56:43 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: 2021-10-15T10:56:43.572Z 32239 TID-o6z INFO: GitLab reliable fetch activated!
Oct 15 10:56:43 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: 2021-10-15T10:56:43.574Z 32239 TID-o5j INFO: Booting Sidekiq 5.2.7 with redis options {:id=>"Sidekiq-server-PID-32239", :url=>"redis://localhost:6379/0"}
Oct 15 10:56:49 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: API controllers newer than Apipie cache! Run apipie:cache rake task to regenerate cache.
Oct 15 10:56:51 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_puppet-2.0.0.alpha.2/lib/foreman_puppet/register.rb:120: warning: already initialized constant Foreman::Plugin::RbacSupport::AUTO_EXTENDED_ROLES
Oct 15 10:56:51 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /usr/share/foreman/app/registries/foreman/plugin/rbac_support.rb:5: warning: previous definition of AUTO_EXTENDED_ROLES was here
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: 285 extra bytes after the deserialized object
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in `full_unpack'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/msgpack-1.3.3/lib/msgpack.rb:37:in `load'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/persistence_adapters/sequel.rb:390:in `load_data'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/persistence_adapters/sequel.rb:260:in `block in find_coordinator_records'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/persistence_adapters/sequel.rb:260:in `map'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/persistence_adapters/sequel.rb:260:in `find_coordinator_records'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/coordinator_adapters/sequel.rb:30:in `find_records'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/coordinator.rb:366:in `find_records'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/coordinator.rb:372:in `find_worlds'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/world/invalidation.rb:131:in `worlds_validity_check'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/world/invalidation.rb:118:in `perform_validity_checks'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/rails.rb:46:in `block in initialize!'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/rails.rb:38:in `tap'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.6.1/lib/dynflow/rails.rb:38:in `initialize!'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /usr/share/foreman/extras/dynflow-sidekiq.rb:34:in `<top (required)>'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/rh/rh-ruby27/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:83:in `require'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/rh/rh-ruby27/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:83:in `require'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/cli.rb:292:in `boot_system'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/cli.rb:46:in `run'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/bin/sidekiq:12:in `<top (required)>'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/bin/sidekiq:23:in `load'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com dynflow-sidekiq@orchestrator[32239]: /opt/theforeman/tfm/root/usr/bin/sidekiq:23:in `<main>'
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com systemd[1]: dynflow-sidekiq@orchestrator.service: main process exited, code=exited, status=1/FAILURE
Oct 15 10:57:06 pipe-up-foreman-nightly-centos7.n5.example.com systemd[1]: Failed to start Foreman jobs daemon - orchestrator on sidekiq.
@aruzicka could it be that dynflow fails to load its own messages from before the upgrade?