Cannot promote to environments after upgrade to Foreman 2.0/Katello 3.15

Problem:
I just upgraded Foreman and all smart proxies to 2.0 and Katello to 3.15 as per documentation.
The upgrade went fine without issues with foreman-installer.
But now when I try to promote new version, to Library it goes fine, but not to other environments I created.
Error is NoMethodError: undefined method `>’ for nil:NilClass

Expected outcome:
After new version is published to Library to be promoted to the rest of the Lifecycle environments

Foreman and Proxy versions:
2.0
Foreman and Proxy plugin versions:
Katello 3.15
Distribution and version:
CentOS 7.8
Other relevant data:
Action:

Actions::Katello::ContentView::Promote

Input:

{"content_view"=> {"id"=>4, "name"=>"CentOS_7_content view", "label"=>"CentOS_7_content_view"}, "organization"=> {"id"=>1, "name"=>"Default_Organization", "label"=>"Default_Organization"}, "environments"=>["IO"], "services_checked"=>["pulp", "pulp_auth"]}

Output:

{}

Exception:

NoMethodError: undefined method >’ for nil:NilClass`

Backtrace:

/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/models/katello/content_view_version.rb:164:in promote_puppet_environment?’ /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/lib/actions/katello/content_view/promote_to_environment.rb:23:in block (2 levels) in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:384:in switch_flow’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:420:in concurrence' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/lib/actions/katello/content_view/promote_to_environment.rb:15:in block in plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:384:in switch_flow' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:425:in sequence’ /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/lib/actions/katello/content_view/promote_to_environment.rb:13:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:517:in block (3 levels) in execute_plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:36:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:36:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_request_id.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_request_id.rb:31:in with_current_request_id’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_request_id.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_timezone.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_timezone.rb:31:in with_current_timezone’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_timezone.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_user.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_user.rb:31:in with_current_user’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_user.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:30:in with_current_taxonomies’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:36:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/world.rb:31:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:516:in block (2 levels) in execute_plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:384:in switch_flow' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:420:in concurrence’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:515:in block in execute_plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:475:in block in with_error_handling’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:475:in catch' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:475:in with_error_handling’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:514:in execute_plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:285:in execute’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan/steps/plan_step.rb:55:in block in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan/steps/abstract.rb:167:in with_meta_calculation’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan/steps/plan_step.rb:54:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:448:in plan_action’ /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/lib/actions/katello/content_view/promote.rb:16:in block (2 levels) in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:384:in switch_flow’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:425:in sequence' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/lib/actions/katello/content_view/promote.rb:14:in block in plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/relation/delegation.rb:41:in each' /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/relation/delegation.rb:41:in each’ /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/lib/actions/katello/content_view/promote.rb:13:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:517:in block (3 levels) in execute_plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:36:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:36:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_request_id.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_request_id.rb:31:in with_current_request_id’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_request_id.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_timezone.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_timezone.rb:31:in with_current_timezone’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_timezone.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_user.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_user.rb:31:in with_current_user’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_user.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:10:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:30:in with_current_taxonomies’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/app/lib/actions/middleware/keep_current_taxonomies.rb:9:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:36:in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/world.rb:31:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:516:in block (2 levels) in execute_plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:384:in switch_flow' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:420:in concurrence’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:515:in block in execute_plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:475:in block in with_error_handling’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:475:in catch' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:475:in with_error_handling’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:514:in execute_plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/action.rb:285:in execute’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan/steps/plan_step.rb:55:in block in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan/steps/abstract.rb:167:in with_meta_calculation’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan/steps/plan_step.rb:54:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:286:in block (2 levels) in plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:384:in switch_flow' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:374:in with_planning_scope’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:285:in block in plan' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:44:in plan_phase’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:44:in plan_phase’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:44:in plan_phase’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:44:in plan_phase’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:44:in plan_phase’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:44:in plan_phase’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:27:in pass’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware.rb:19:in pass' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/common/transaction.rb:17:in block in rollback_on_error’ /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/connection_adapters/abstract/database_statements.rb:254:in block in transaction' /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/connection_adapters/abstract/transaction.rb:239:in block in within_new_transaction’ /opt/rh/rh-ruby25/root/usr/share/ruby/monitor.rb:226:in mon_synchronize' /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/connection_adapters/abstract/transaction.rb:236:in within_new_transaction’ /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/connection_adapters/abstract/database_statements.rb:254:in transaction' /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/transactions.rb:212:in transaction’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/transaction_adapters/active_record.rb:6:in transaction' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/common/transaction.rb:16:in rollback_on_error’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/common/transaction.rb:6:in plan_phase' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/stack.rb:23:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/middleware/world.rb:31:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/execution_plan.rb:284:in plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/world.rb:211:in block (2 levels) in plan_with_options' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/coordinator.rb:326:in acquire’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/world.rb:209:in block in plan_with_options' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/world.rb:208:in tap’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/world.rb:208:in plan_with_options' /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/world.rb:204:in plan’ /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.2/lib/dynflow/world.rb:180:in trigger' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/lib/foreman_tasks.rb:23:in trigger’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/lib/foreman_tasks.rb:29:in block in trigger_task' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/lib/foreman_tasks.rb:49:in block in rails_safe_trigger_task’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/dependencies/interlock.rb:48:in block in permit_concurrent_loads' /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/concurrency/share_lock.rb:187:in yield_shares’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/dependencies/interlock.rb:47:in permit_concurrent_loads' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/lib/foreman_tasks.rb:48:in rails_safe_trigger_task’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/lib/foreman_tasks.rb:27:in trigger_task' /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/lib/foreman_tasks.rb:54:in async_task’ /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-1.0.1/lib/foreman_tasks/triggers.rb:18:in async_task' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/controllers/katello/api/v2/content_view_versions_controller.rb:60:in promote’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal/basic_implicit_render.rb:6:in send_action' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/abstract_controller/base.rb:194:in process_action’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal/rendering.rb:30:in process_action' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/abstract_controller/callbacks.rb:42:in block in process_action’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:109:in block in run_callbacks' /usr/share/foreman/app/controllers/api/v2/base_controller.rb:163:in disable_json_root’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:118:in block in run_callbacks' /usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in set_timezone’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:118:in block in run_callbacks' /usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in clear_thread’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:118:in block in run_callbacks' /usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in set_topbar_sweeper_controller’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:118:in block in run_callbacks' /opt/theforeman/tfm/root/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in around’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:118:in block in run_callbacks' /opt/theforeman/tfm/root/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in around’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:118:in block in run_callbacks' /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:136:in run_callbacks’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/abstract_controller/callbacks.rb:41:in process_action' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal/rescue.rb:22:in process_action’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal/instrumentation.rb:34:in block in process_action' /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/notifications.rb:168:in block in instrument’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/notifications/instrumenter.rb:23:in instrument' /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/notifications.rb:168:in instrument’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal/instrumentation.rb:32:in process_action' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal/params_wrapper.rb:256:in process_action’ /opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-5.2.1/lib/active_record/railties/controller_runtime.rb:24:in process_action' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/app/controllers/katello/concerns/api/api_controller.rb:39:in process_action’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/abstract_controller/base.rb:134:in process' /opt/theforeman/tfm/root/usr/share/gems/gems/actionview-5.2.1/lib/action_view/rendering.rb:32:in process’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal.rb:191:in dispatch' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_controller/metal.rb:252:in dispatch’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/route_set.rb:52:in dispatch' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/route_set.rb:34:in serve’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/mapper.rb:18:in block in <class:Constraints>' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/mapper.rb:48:in serve’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/journey/router.rb:52:in block in serve' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/journey/router.rb:35:in each’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/journey/router.rb:35:in serve' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/route_set.rb:840:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/engine.rb:524:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/railtie.rb:190:in public_send’ /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/railtie.rb:190:in method_missing' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/mapper.rb:19:in block in class:Constraints’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/mapper.rb:48:in serve' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/journey/router.rb:52:in block in serve’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/journey/router.rb:35:in each' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/journey/router.rb:35:in serve’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/routing/route_set.rb:840:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/lib/katello/middleware/event_daemon.rb:10:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/static.rb:127:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/static.rb:127:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/static_dispatcher.rb:66:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/extractor/recorder.rb:137:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/static.rb:127:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/static.rb:127:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/static.rb:127:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/static.rb:127:in call’ /usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/middleware/checksum_in_headers.rb:27:in call’ /usr/share/foreman/lib/foreman/middleware/catch_json_parse_errors.rb:9:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/tempfile_reaper.rb:15:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/etag.rb:25:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/conditional_get.rb:38:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/head.rb:12:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/http/content_security_policy.rb:18:in call’ /usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/session/abstract/id.rb:232:in context’ /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/session/abstract/id.rb:226:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/cookies.rb:670:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/callbacks.rb:28:in block in call' /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/callbacks.rb:98:in run_callbacks’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/callbacks.rb:26:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/debug_exceptions.rb:61:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/show_exceptions.rb:33:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/rack/logger.rb:38:in call_app’ /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/rack/logger.rb:28:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/sprockets-rails-3.2.1/lib/sprockets/rails/quiet_assets.rb:13:in call’ /usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/remote_ip.rb:81:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/request_id.rb:27:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.0.1/lib/katello/prevent_json_parsing.rb:12:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/method_override.rb:22:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/runtime.rb:22:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/executor.rb:14:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-5.2.1/lib/action_dispatch/middleware/static.rb:127:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/sendfile.rb:111:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/secure_headers-6.3.0/lib/secure_headers/middleware.rb:11:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/engine.rb:524:in call’ /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/railtie.rb:190:in public_send' /opt/theforeman/tfm/root/usr/share/gems/gems/railties-5.2.1/lib/rails/railtie.rb:190:in method_missing’ /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/urlmap.rb:68:in block in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/urlmap.rb:53:in each’ /opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.0.6/lib/rack/urlmap.rb:53:in call' /usr/share/passenger/phusion_passenger/rack/thread_handler_extension.rb:74:in process_request’ /usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:141:in accept_and_process_next_request' /usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:109:in main_loop’ /usr/share/passenger/phusion_passenger/request_handler.rb:455:in block (3 levels) in start_threads' /opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in block in create_with_logging_context’`

Hello @matemikulic

On the Foreman/Katello server, can you please let me know the contents of the file /etc/foreman/plugins/katello.yaml ? Particularly the :content_types: section.

Thanks!

### File managed with puppet ###
## Module: puppet-katello

:katello:
  :rest_client_timeout: 3600

  :content_types:
    :file: true
    :yum: true
    :deb: true
    :puppet: false
    :docker: true
    :ostree: false

  :candlepin:
    :url: https://p5-al-foreman-1.domain.local:8443/candlepin
    :oauth_key: "katello"
    :oauth_secret: "some-secret"
    :ca_cert_file: /etc/pki/katello/certs/katello-default-ca.crt

  :pulp:
    :url: https://p5-al-foreman-1.domain.local/pulp/api/v2/
    :ca_cert_file: /etc/pki/katello/certs/katello-server-ca.crt

  :use_pulp_2_for_content_type:
    :docker: false
    :file: false

  :qpid:
    :url: amqp:ssl:localhost:5671
    :subscriptions_queue_address: katello_event_queue

  # Internal configuration for communication from server to pulp crane service.
  :container_image_registry:
    :crane_url: https://p5-al-foreman-1.domain.local:5000
    :crane_ca_cert_file: /etc/pki/katello/certs/katello-server-ca.crt

However I only have yum repo’s. Should I disable others and try like that? I made no changes to conf files not to break seamless upgrade to future versions.

Thanks @matemikulic

Even though you only have yum repos, I’m thinking this problem may be due to puppet-related code. Can you try the following:

  1. In that file, change :puppet: to true
  2. Restart all services: foreman-maintain service restart
  3. Enter the console: foreman-rake console
  4. In the Rails console, execute the following command:
::Katello::ContentViewVersion.all.each(&:update_content_counts!)
  1. Exit the console (exit) and try the promotion again.

Let me know how that goes. thanks!

1 Like

Jeremy, thank you so much. This did fix it. I guess the upgrade script did not account that I ran original installation with --no-enable-puppet since I don’t use it. Thank you again. :slight_smile:

2 Likes