Problem:
We rebooted our perfectly working foreman server, and now foreman web server refuse to start. No significant updates on our server, only the security one (30 packages since august 24, our last reboot)
# Proxy Error
The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request *[GET /](http://foreman.example.com)*.
Reason: **Error reading from remote server**
Expected outcome:
Foreman server restart
Foreman and Proxy versions:
HOSTNAME: foreman.example.com
OS: redhat
RELEASE: CentOS Linux release 7.9.2009 (Core)
FOREMAN: 2.4.1
RUBY: ruby 2.0.0p648 (2015-12-16) [x86_64-linux]
PUPPET: 5.5.16
DENIALS: 0
We use the rh-ruby25-ruby-2.5 and the server was updated using foreman-installer
Foreman and Proxy plugin versions:
As foreman is not running, we don’t know
Distribution and version:
Other relevant data:
foreman-installer --skip-puppet-version-check
2022-10-19 16:04:11 [NOTICE] [root] Loading default values from puppet modules...
2022-10-19 16:04:15 [NOTICE] [root] ... finished
2022-10-19 16:04:18 [NOTICE] [root] Running validation checks
2022-10-19 16:04:23 [NOTICE] [configure] Starting system configuration.
The total number of configuration tasks may increase during the run.
Observe logs or specify --verbose-log-level to see individual configuration tasks.
2022-10-19 16:05:05 [ERROR ] [configure] Systemd start for foreman failed!
2022-10-19 16:05:05 [ERROR ] [configure] journalctl log for foreman:
2022-10-19 16:05:05 [ERROR ] [configure] -- Logs begin at Wed 2022-10-19 09:21:54 CEST, end at Wed 2022-10-19 16:05:05 CEST. --
2022-10-19 16:05:05 [ERROR ] [configure] Oct 19 16:00:05 foreman foreman[8175]: => Booting Puma
2022-10-19 16:05:05 [ERROR ] [configure] Oct 19 16:00:05 foreman foreman[8175]: => Rails 6.0.3.4 application starting in production
2022-10-19 16:05:05 [ERROR ] [configure] Oct 19 16:00:05 foreman foreman[8175]: => Run `rails server --help` for more startup options
2022-10-19 16:05:05 [ERROR ] [configure] Oct 19 16:00:08 foreman foreman[8175]: Exiting
2022-10-19 16:05:05 [ERROR ] [configure] Oct 19 16:00:08 foreman foreman[8175]: /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/validations.rb:80:in `raise_validation_error': Validation failed: Permissions You must select at least one permission (ActiveRecord::RecordInvalid)
The main error seems to be Validation failed: Permissions You must select at least one permission, but I have absolutely no clue how to select a permission (to what ?)
Can you please capture the /var/log/foreman/production.log when you try to start the services? My guess is, some plugin is unable to save some permissions. We may need to the debug further what’s going on and perhaps clean up something in the DB.
Hi,
for
# journalctl -u foreman
Oct 24 18:18:22 foreman systemd[1]: Starting Foreman...
Oct 24 18:18:23 foreman systemd[1]: Stopped Foreman.
Oct 24 18:19:11 foreman systemd[1]: Starting Foreman...
Oct 24 18:19:15 foreman foreman[21235]: => Booting Puma
Oct 24 18:19:15 foreman foreman[21235]: => Rails 6.0.3.4 application starting in production
Oct 24 18:19:15 foreman foreman[21235]: => Run `rails server --help` for more startup options
Oct 24 18:19:18 foreman foreman[21235]: Exiting
Oct 24 18:19:18 foreman foreman[21235]: /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/validations.rb:80:in `raise_validation_error': Validation failed: Permissions
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/validations.rb:53:in `save!'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:318:in `block in save!'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:375:in `block in with_transaction_returning_status'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `block in tra
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/transaction.rb:280:in `block in within_new_
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchroniz
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/transaction.rb:278:in `within_new_transacti
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `transaction'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:212:in `transaction'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:366:in `with_transaction_returning_status'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:318:in `save!'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/suppressor.rb:48:in `save!'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/relation/delegation.rb:87:in `each'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/relation/delegation.rb:87:in `each'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/app/services/cache_manager.rb:14:in `map'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/app/services/cache_manager.rb:14:in `block in create_new_filter_cache'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/app/models/role.rb:86:in `ignore_locking'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/app/services/cache_manager.rb:13:in `create_new_filter_cache'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/app/services/cache_manager.rb:22:in `recache!'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/config/initializers/fix_cache.rb:10:in `<top (required)>'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/dependencies.rb:318:in `load'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/dependencies.rb:318:in `block in load'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/dependencies.rb:291:in `load_dependency'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/dependencies.rb:318:in `load'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/engine.rb:666:in `block in load_config_initializer'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/notifications.rb:182:in `instrument'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/engine.rb:665:in `load_config_initializer'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/engine.rb:625:in `block (2 levels) in <class:Engine>'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/engine.rb:624:in `each'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/engine.rb:624:in `block in <class:Engine>'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/initializable.rb:32:in `instance_exec'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/initializable.rb:32:in `run'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/initializable.rb:61:in `block in run_initializers'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:228:in `block in tsort_each'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:422:in `block (2 levels) in each_strongly_connected_component_from'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:431:in `each_strongly_connected_component_from'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:421:in `block in each_strongly_connected_component_from'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/initializable.rb:50:in `each'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/initializable.rb:50:in `tsort_each_child'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:415:in `call'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:415:in `each_strongly_connected_component_from'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:349:in `block in each_strongly_connected_component'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:347:in `each'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:347:in `call'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:347:in `each_strongly_connected_component'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:226:in `tsort_each'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/ruby/tsort.rb:205:in `tsort_each'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/initializable.rb:60:in `run_initializers'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/application.rb:363:in `initialize!'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/railtie.rb:190:in `public_send'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/railtie.rb:190:in `method_missing'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/config/environment.rb:5:in `<top (required)>'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:59:in `require'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:59:in `require'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/polyglot-0.3.5/lib/polyglot.rb:65:in `require'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/dependencies.rb:324:in `block in require'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/dependencies.rb:291:in `load_dependency'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/dependencies.rb:324:in `require'
Oct 24 18:19:18 foreman foreman[21235]: from config.ru:5:in `block in <main>'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/builder.rb:116:in `eval'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/builder.rb:116:in `new_from_string'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/builder.rb:105:in `load_file'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/builder.rb:66:in `parse_file'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/server.rb:349:in `build_app_and_options_from_config'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/server.rb:249:in `app'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/server.rb:422:in `wrapped_app'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/server.rb:312:in `block in start'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/server.rb:379:in `handle_profiling'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/server.rb:311:in `start'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/commands/server/server_command.rb:39:in `start'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/commands/server/server_command.rb:147:in `block in perform'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/commands/server/server_command.rb:138:in `tap'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/commands/server/server_command.rb:138:in `perform'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/thor-1.0.1/lib/thor/command.rb:27:in `run'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/thor-1.0.1/lib/thor/invocation.rb:127:in `invoke_command'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/thor-1.0.1/lib/thor.rb:392:in `dispatch'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/command/base.rb:69:in `perform'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/command.rb:46:in `invoke'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/commands.rb:18:in `<top (required)>'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:135:in `require'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:135:in `rescue in require'
Oct 24 18:19:18 foreman foreman[21235]: from /opt/rh/rh-ruby25/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:39:in `require'
Oct 24 18:19:18 foreman foreman[21235]: from /usr/share/foreman/bin/rails:9:in `<main>'
Oct 24 18:19:18 foreman systemd[1]: foreman.service: main process exited, code=exited, status=1/FAILURE
Oct 24 18:19:18 foreman systemd[1]: Failed to start Foreman.
Oct 24 18:19:18 foreman systemd[1]: Unit foreman.service entered failed state.
Oct 24 18:19:18 foreman systemd[1]: foreman.service failed.
production.log is a bit inconclusive
2022-10-24T18:19:04 [W|app|] Recreating the whole DB cache
2022-10-24T18:19:04 [W|app|] Creating scope :completer_scope. Overwriting existing method Location.completer_scope.
2022-10-24T18:19:04 [W|app|] Creating scope :completer_scope. Overwriting existing method Organization.completer_scope.
2022-10-24T18:19:04 [I|app|] Rails cache backend: File
2022-10-24T18:19:06 [W|app|] Recreating the whole DB cache
2022-10-24T18:19:06 [W|app|] Creating scope :completer_scope. Overwriting existing method Location.completer_scope.
2022-10-24T18:19:06 [W|app|] Creating scope :completer_scope. Overwriting existing method Organization.completer_scope.
2022-10-24T18:19:11 [I|app|] Rails cache backend: File
2022-10-24T18:19:12 [W|app|] Recreating the whole DB cache
2022-10-24T18:19:12 [W|app|] Creating scope :completer_scope. Overwriting existing method Location.completer_scope.
2022-10-24T18:19:12 [W|app|] Creating scope :completer_scope. Overwriting existing method Organization.completer_scope.
2022-10-24T18:19:13 [I|app|] Rails cache backend: File
2022-10-24T18:19:14 [W|app|] Recreating the whole DB cache
2022-10-24T18:19:14 [W|app|] Creating scope :completer_scope. Overwriting existing method Location.completer_scope.
2022-10-24T18:19:14 [W|app|] Creating scope :completer_scope. Overwriting existing method Organization.completer_scope.
2022-10-24T18:19:15 [I|app|] Rails cache backend: File
2022-10-24T18:19:17 [W|app|] Recreating the whole DB cache
2022-10-24T18:19:17 [W|app|] Creating scope :completer_scope. Overwriting existing method Location.completer_scope.
2022-10-24T18:19:17 [W|app|] Creating scope :completer_scope. Overwriting existing method Organization.completer_scope.
2022-10-24T18:19:19 [I|app|] Rails cache backend: File
2022-10-24T18:19:20 [W|app|] Recreating the whole DB cache
2022-10-24T18:19:20 [W|app|] Creating scope :completer_scope. Overwriting existing method Location.completer_scope.
2022-10-24T18:19:20 [W|app|] Creating scope :completer_scope. Overwriting existing method Organization.completer_scope.
2022-10-24T18:19:21 [I|app|] Rails cache backend: File
2022-10-24T18:19:22 [W|app|] Recreating the whole DB cache
2022-10-24T18:19:22 [I|app|] Rails cache backend: File
Thanks for your help
I also got this in cron.log
Tasks: TOP => reports:weekly => dynflow:client
(See full trace by running task with --trace)
Starting expired notifications clean up...
Finished, cleaned 0 notifications
rake aborted!
Sequel::Migrator::Error: More than 1 row in migrator table
And with manual launch
foreman-rake dynflow:client --trace
** Invoke dynflow:client (first_time)
** Invoke environment (first_time)
** Execute environment
** Execute dynflow:client
rake aborted!
Sequel::Migrator::Error: More than 1 row in migrator table
/opt/theforeman/tfm/root/usr/share/gems/gems/sequel-5.7.1/lib/sequel/extensions/migration.rb:619:in `schema_dataset'
/opt/theforeman/tfm/root/usr/share/gems/gems/sequel-5.7.1/lib/sequel/extensions/migration.rb:453:in `initialize'
/opt/theforeman/tfm/root/usr/share/gems/gems/sequel-5.7.1/lib/sequel/extensions/migration.rb:517:in `initialize'
/opt/theforeman/tfm/root/usr/share/gems/gems/sequel-5.7.1/lib/sequel/extensions/migration.rb:401:in `new'
/opt/theforeman/tfm/root/usr/share/gems/gems/sequel-5.7.1/lib/sequel/extensions/migration.rb:401:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/persistence_adapters/sequel.rb:254:in `migrate_db'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/persistence_adapters/sequel.rb:56:in `initialize'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/rails/configuration.rb:200:in `new'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/rails/configuration.rb:200:in `initialize_persistence'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/rails/configuration.rb:142:in `block (2 levels) in world_config'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/config.rb:43:in `method_missing'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/world.rb:29:in `initialize'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/rails/configuration.rb:79:in `new'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/rails/configuration.rb:79:in `initialize_world'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/rails.rb:105:in `init_world'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.8/lib/dynflow/rails.rb:38:in `initialize!'
/usr/share/foreman/lib/tasks/dynflow.rake:36:in `block (2 levels) in <top (required)>'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/task.rb:273:in `block in execute'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/task.rb:273:in `each'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/task.rb:273:in `execute'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/task.rb:214:in `block in invoke_with_call_chain'
/opt/rh/rh-ruby25/root/usr/share/ruby/monitor.rb:235:in `mon_synchronize'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/task.rb:194:in `invoke_with_call_chain'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/task.rb:183:in `invoke'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:160:in `invoke_task'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:116:in `block (2 levels) in top_level'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:116:in `each'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:116:in `block in top_level'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:125:in `run_with_threads'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:110:in `top_level'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:83:in `block in run'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:186:in `standard_exception_handling'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/lib/rake/application.rb:80:in `run'
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.3/exe/rake:27:in `<top (required)>'
/opt/rh/rh-ruby25/root/usr/bin/rake:23:in `load'
/opt/rh/rh-ruby25/root/usr/bin/rake:23:in `<main>'
Tasks: TOP => dynflow:client
