Ok so we were going to try and install an additional plugin.
Before starting we stopped the host to take a snapshot on vmware and started the host again.
Currently running 3.5.1.
Puppet 6
On Rocky Linux 8
Postgres version 12
After a fresh boot foreman no longer starts, we didnt even get to the point of installing a new plugin.
The issues seems to be this and also comes when checking the db:migrate command.
rake aborted!
NoMethodError: undefined method `mutex=' for FastGettext:Module
/usr/share/foreman/lib/foreman/gettext/support.rb:50:in `block in <module:Support>'
/usr/share/foreman/lib/foreman/gettext/support.rb:47:in `class_eval'
/usr/share/foreman/lib/foreman/gettext/support.rb:47:in `<module:Support>'
/usr/share/foreman/lib/foreman/gettext/support.rb:5:in `<module:Gettext>'
/usr/share/foreman/lib/foreman/gettext/support.rb:4:in `<module:Foreman>'
/usr/share/foreman/lib/foreman/gettext/support.rb:3:in `<top (required)>'
/usr/share/gems/gems/polyglot-0.3.5/lib/polyglot.rb:65:in `require'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:332:in `block in require'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:299:in `load_dependency'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:332:in `require'
/usr/share/foreman/config/initializers/1_fast_gettext.rb:6:in `<top (required)>'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:326:in `load'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:326:in `block in load'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:299:in `load_dependency'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:326:in `load'
/usr/share/foreman/config/initializers/0_print_time_spent.rb:38:in `block in load'
/usr/share/foreman/config/initializers/0_print_time_spent.rb:17:in `benchmark'
/usr/share/foreman/config/initializers/0_print_time_spent.rb:38:in `load'
/usr/share/gems/gems/railties-6.1.7/lib/rails/engine.rb:681:in `block in load_config_initializer'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/notifications.rb:205:in `instrument'
/usr/share/gems/gems/railties-6.1.7/lib/rails/engine.rb:680:in `load_config_initializer'
/usr/share/gems/gems/railties-6.1.7/lib/rails/engine.rb:634:in `block (2 levels) in <class:Engine>'
/usr/share/gems/gems/railties-6.1.7/lib/rails/engine.rb:633:in `each'
/usr/share/gems/gems/railties-6.1.7/lib/rails/engine.rb:633:in `block in <class:Engine>'
/usr/share/gems/gems/railties-6.1.7/lib/rails/initializable.rb:32:in `instance_exec'
/usr/share/gems/gems/railties-6.1.7/lib/rails/initializable.rb:32:in `run'
/usr/share/gems/gems/railties-6.1.7/lib/rails/initializable.rb:61:in `block in run_initializers'
/usr/share/gems/gems/railties-6.1.7/lib/rails/initializable.rb:50:in `each'
/usr/share/gems/gems/railties-6.1.7/lib/rails/initializable.rb:50:in `tsort_each_child'
/usr/share/gems/gems/railties-6.1.7/lib/rails/initializable.rb:60:in `run_initializers'
/usr/share/gems/gems/railties-6.1.7/lib/rails/application.rb:391:in `initialize!'
/usr/share/gems/gems/railties-6.1.7/lib/rails/railtie.rb:207:in `public_send'
/usr/share/gems/gems/railties-6.1.7/lib/rails/railtie.rb:207:in `method_missing'
/usr/share/foreman/config/environment.rb:5:in `<top (required)>'
/usr/share/gems/gems/polyglot-0.3.5/lib/polyglot.rb:65:in `require'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:332:in `block in require'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:299:in `load_dependency'
/usr/share/gems/gems/activesupport-6.1.7/lib/active_support/dependencies.rb:332:in `require'
/usr/share/gems/gems/railties-6.1.7/lib/rails/application.rb:367:in `require_environment!'
/usr/share/gems/gems/railties-6.1.7/lib/rails/application.rb:533:in `block in run_tasks_blocks'
/usr/share/gems/gems/rake-13.0.1/exe/rake:27:in `<top (required)>'
Tasks: TOP => db:migrate => db:load_config => environment
(See full trace by running task with --trace)
For fast_gettext we have the following versions installed: fast_gettext (2.3.0, 1.8.0)
We already tried removing 1.8.0
Or replace 2.3.0 with 2.2.0 or 2.1.0 but nothing changes.
Foreman production.log contains only this:
[root@vslr8cfm001 ~] tail -f /var/log/foreman/production.log
2023-05-09T11:25:45 [I|app|] Rails cache backend: File
2023-05-09T11:25:49 [I|app|] Rails cache backend: File
2023-05-09T11:25:50 [I|app|] Rails cache backend: File
2023-05-09T11:25:54 [I|app|] Rails cache backend: File
2023-05-09T11:25:55 [I|app|] Rails cache backend: File
2023-05-09T11:25:59 [I|app|] Rails cache backend: File
2023-05-09T11:26:11 [I|app|] Rails cache backend: File
2023-05-09T11:26:11 [I|app|] Rails cache backend: File
2023-05-09T11:26:21 [I|app|] Rails cache backend: File
2023-05-09T11:30:06 [I|app|] Rails cache backend: File
We have no other idea at this point what else to check or try.
Also tried updating to 3.5.3 or 3.6.1 but the issue with fast_gettext remains.