Katello 3.1 to 3.2.1 upgrade

Support
1

Hi

When I was running upgrade I had an error:

http://projects.theforeman.org/issues/17703

So I did as it is mentioned in thiissue:

":run_always => true" seems to be a remnant of the previous 30-upgrade.rb
where every upgrade_step had a ":run_always" or ":long_running" option
passed. With the 3.2.1 30-upgrade.rb ":migrate_candlepin" is the only
upgrade_step with an option and since the function only takes one argument
this results in the error seen.

Deleting ", :run_always => true" lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in
return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:inblock in get_response'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:inprocess_result'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in
block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:intransmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in
execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:inexecute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in
get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:inget_response'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:inlist'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in
ensure_sync_notification&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in<top (required)>'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in
load&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inblock in load'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in
load_dependency&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload'
/usr/share/foreman/db/seeds.rb:81:in block in &lt;top (required)&gt;&#39; /usr/share/foreman/db/seeds.rb:79:ineach'
/usr/share/foreman/db/seeds.rb:79:in &lt;top (required)&gt;&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in
block in load&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:inload_dependency'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in
load&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:inload_seed'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in
load_seed&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/railties/databases.rake:183:inblock (2 levels) in <top (required)>'
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs
for more information.
[DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1)
[ERROR 2016-12-17 15:22:47 main] Errors encountered during run:
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in
return!&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:inblock in get_response'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in
call&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:inprocess_result'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in
block in transmit&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:intransmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in
execute&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:inexecute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in
get&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:inget_response'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:inlist'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in
ensure_sync_notification&#39; /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in<top (required)>'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in
load&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inblock in load'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in
load_dependency&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload'
/usr/share/foreman/db/seeds.rb:81:in block in &lt;top (required)&gt;&#39; /usr/share/foreman/db/seeds.rb:79:ineach'
/usr/share/foreman/db/seeds.rb:79:in &lt;top (required)&gt;&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in
block in load&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:inload_dependency'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in
load&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:inload_seed'
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in
load_seed&#39; /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/railties/databases.rake:183:inblock (2 levels) in <top (required)>'
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb
Seeding
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs
for more information.
[DEBUG 2016-12-17 15:22:47 main] Cleaning
/etc/katello-installer/d20161217-45847-jjhsip
[DEBUG 2016-12-17 15:22:47 main] Cleaning
/tmp/kafo_hiera20161217-45847-155fduz
[DEBUG 2016-12-17 15:22:47 main] Cleaning /tmp/default_values.yaml

Can anyone please help.

2

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed in
your issue at Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman Hope it works for
you.

··· On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote: > > Hi > > When I was running upgrade I had an error: > > http://projects.theforeman.org/issues/17703 > > So I did as it is mentioned in thiissue: > > ":run_always => true" seems to be a remnant of the previous 30-upgrade.rb > where every upgrade_step had a ":run_always" or ":long_running" option > passed. With the 3.2.1 30-upgrade.rb ":migrate_candlepin" is the only > upgrade_step with an option and since the function only takes one argument > this results in the error seen. > > Deleting ", :run_always => true" lets the upgrade continue. > > > But after that I have an error: > > [ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed... > [ERROR 2016-12-17 15:22:47 main] rake aborted! > RestClient::ResourceNotFound: 404 Resource Not Found > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in > `return!' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in > `block in get_response' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in > `call' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in > `process_result' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in > `block in transmit' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:in > `transmit' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in > `execute' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:in > `execute' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in > `get' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in > `get_response' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in > `call' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:in > `list' > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in > `ensure_sync_notification' > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in > `' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `block in load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in > `load_dependency' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /usr/share/foreman/db/seeds.rb:81:in `block in ' > /usr/share/foreman/db/seeds.rb:79:in `each' > /usr/share/foreman/db/seeds.rb:79:in `' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `block in load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in > `load_dependency' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in > `load_seed' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in > `load_seed' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/railties/databases.rake:183:in > `block (2 levels) in ' > Tasks: TOP => db:seed > (See full trace by running task with --trace) > Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb > Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb > Seeding /usr/share/foreman/db/seeds.d/03-roles.rb > Seeding /usr/share/foreman/db/seeds.d/04-admin.rb > Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb > Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb > Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb > Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb > Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb > > [ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs > for more information. > [DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1) > [ERROR 2016-12-17 15:22:47 main] Errors encountered during run: > [ERROR 2016-12-17 15:22:47 main] rake aborted! > RestClient::ResourceNotFound: 404 Resource Not Found > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in > `return!' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in > `block in get_response' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in > `call' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in > `process_result' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in > `block in transmit' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:in > `transmit' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in > `execute' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:in > `execute' > /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in > `get' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in > `get_response' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in > `call' > /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:in > `list' > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in > `ensure_sync_notification' > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in > `' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `block in load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in > `load_dependency' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /usr/share/foreman/db/seeds.rb:81:in `block in ' > /usr/share/foreman/db/seeds.rb:79:in `each' > /usr/share/foreman/db/seeds.rb:79:in `' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `block in load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in > `load_dependency' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in > `load' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in > `load_seed' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in > `load_seed' > /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/railties/databases.rake:183:in > `block (2 levels) in ' > Tasks: TOP => db:seed > (See full trace by running task with --trace) > Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb > Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb > Seeding /usr/share/foreman/db/seeds.d/03-roles.rb > Seeding /usr/share/foreman/db/seeds.d/04-admin.rb > Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb > Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb > Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb > Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb > Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb > Seeding > /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb > > [ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs > for more information. > [DEBUG 2016-12-17 15:22:47 main] Cleaning > /etc/katello-installer/d20161217-45847-jjhsip > [DEBUG 2016-12-17 15:22:47 main] Cleaning > /tmp/kafo_hiera20161217-45847-155fduz > [DEBUG 2016-12-17 15:22:47 main] Cleaning /tmp/default_values.yaml > > > > Can anyone please help. >
3

Pascalp,

Were you using the Puppet 3 or Puppet 4 repo on your server?

Thanks,

j

··· From: "pascalp" To: "Foreman users" Sent: Tuesday, December 20, 2016 8:50:45 AM Subject: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed in your issue at [ Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman | Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman ] Hope it works for you.

On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote:

Hi
When I was running upgrade I had an error:

[ Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman | Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman ]

So I did as it is mentioned in thiissue:

“:run_always => true” seems to be a remnant of the previous 30-upgrade.rb where every upgrade_step had a “:run_always” or “:long_running” option passed. With the 3.2.1 30-upgrade.rb “:migrate_candlepin” is the only upgrade_step with an option and since the function only takes one argument this results in the error seen.

Deleting “, :run_always => true” lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:inblock in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:inprocess_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:intransmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:inexecute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:inget_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:inlist’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in<top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inblock in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:ineach’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:inload_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:inload_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/railties/databases.rake:183:inblock (2 levels) in <top (required)>'
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs for more information.
[DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1)
[ERROR 2016-12-17 15:22:47 main] Errors encountered during run:
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:inblock in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:inprocess_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:intransmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:inexecute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:inget_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:inlist’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in<top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inblock in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:ineach’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:inload’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:240:inload_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:inload_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.2.5.1/lib/active_record/railties/databases.rake:183:inblock (2 levels) in <top (required)>'
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs for more information.
[DEBUG 2016-12-17 15:22:47 main] Cleaning /etc/katello-installer/d20161217-45847-jjhsip
[DEBUG 2016-12-17 15:22:47 main] Cleaning /tmp/kafo_hiera20161217-45847-155fduz
[DEBUG 2016-12-17 15:22:47 main] Cleaning /tmp/default_values.yaml

Can anyone please help.

–
You received this message because you are subscribed to the Google Groups “Foreman users” group.
To unsubscribe from this group and stop receiving emails from it, send an email to [ mailto:foreman-users+unsubscribe@googlegroups.com | foreman-users+unsubscribe@googlegroups.com ] .
To post to this group, send email to [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ] .
Visit this group at [ https://groups.google.com/group/foreman-users | https://groups.google.com/group/foreman-users ] .
For more options, visit [ https://groups.google.com/d/optout | https://groups.google.com/d/optout ] .

4

> Pascalp,
>
> Were you using the Puppet 3 or Puppet 4 repo on your server?
>
> Thanks,
>
> j
>
>
Jason,

FWIW - I got this error with Puppet 3 and also again with Puppet 4 repos.
When I have time I'll try the solution posted by Pascalp and report back on
the results.

Thanks,
Peter

··· On Tue, Dec 20, 2016 at 8:55 AM, 'Jason B. Nance' via Foreman users < foreman-users@googlegroups.com> wrote:

*From: *“pascalp” supremerulerxenu@gmail.com
*To: *“Foreman users” foreman-users@googlegroups.com
*Sent: *Tuesday, December 20, 2016 8:50:45 AM
*Subject: *[foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed
in your issue at Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman Hope it
works for you.

On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote:

Hi
When I was running upgrade I had an error:

Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman

So I did as it is mentioned in thiissue:

“:run_always => true” seems to be a remnant of the previous 30-upgrade.rb
where every upgrade_step had a “:run_always” or “:long_running” option
passed. With the 3.2.1 30-upgrade.rb “:migrate_candlepin” is the only
upgrade_step with an option and since the function only takes one argument
this results in the error seen.

Deleting “, :run_always => true” lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9. 0/lib/runcible/resources/event_notifier.rb:48:in list’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1. 1/db/seeds.d/108-ensure_sync_notification.rb:9:in <top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in block in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:in each’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in load_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-
4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- 4.2.5.1/lib/active_record/railties/databases.rake:183:in block (2
levels) in <top (required)>’
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs
for more information.
[DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1)
[ERROR 2016-12-17 15:22:47 main] Errors encountered during run:
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9. 0/lib/runcible/resources/event_notifier.rb:48:in list’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1. 1/db/seeds.d/108-ensure_sync_notification.rb:9:in <top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in block in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:in each’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in load_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-
4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- 4.2.5.1/lib/active_record/railties/databases.rake:183:in block (2
levels) in <top (required)>’
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs
for more information.
[DEBUG 2016-12-17 15:22:47 main] Cleaning /etc/katello-installer/
d20161217-45847-jjhsip
[DEBUG 2016-12-17 15:22:47 main] Cleaning /tmp/kafo_hiera20161217-45847-
155fduz
[DEBUG 2016-12-17 15:22:47 main] Cleaning /tmp/default_values.yaml

Can anyone please help.

–
You received this message because you are subscribed to the Google Groups
“Foreman users” group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at https://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

–
You received this message because you are subscribed to the Google Groups
“Foreman users” group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at https://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

5

I was using Puppet 4.

··· On Tuesday, December 20, 2016 at 3:59:55 PM UTC+1, Peter Kirby wrote: > > > On Tue, Dec 20, 2016 at 8:55 AM, 'Jason B. Nance' via Foreman users < > forema...@googlegroups.com > wrote: > >> Pascalp, >> >> Were you using the Puppet 3 or Puppet 4 repo on your server? >> >> Thanks, >> >> j >> >> > Jason, > > FWIW - I got this error with Puppet 3 and also again with Puppet 4 repos. > When I have time I'll try the solution posted by Pascalp and report back on > the results. > > Thanks, > Peter > > > > > > > >> ------------------------------ >> *From: *"pascalp" <supremer...@gmail.com > >> *To: *"Foreman users" <forema...@googlegroups.com > >> *Sent: *Tuesday, December 20, 2016 8:50:45 AM >> *Subject: *[foreman-users] Re: Katello 3.1 to 3.2.1 upgrade >> >> I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed >> in your issue at http://projects.theforeman.org/issues/17722 Hope it >> works for you. >> >> On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote: >>> >>> Hi >>> When I was running upgrade I had an error: >>> >>> http://projects.theforeman.org/issues/17703 >>> >>> So I did as it is mentioned in thiissue: >>> >>> ":run_always => true" seems to be a remnant of the previous >>> 30-upgrade.rb where every upgrade_step had a ":run_always" or >>> ":long_running" option passed. With the 3.2.1 30-upgrade.rb >>> ":migrate_candlepin" is the only upgrade_step with an option and since the >>> function only takes one argument this results in the error seen. >>> >>> Deleting ", :run_always => true" lets the upgrade continue. >>> >>> >>> But after that I have an error: >>> >>> [ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed... >>> [ERROR 2016-12-17 15:22:47 main] rake aborted! >>> RestClient::ResourceNotFound: 404 Resource Not Found >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in >>> `return!' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in >>> `block in get_response' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in >>> `call' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in >>> `process_result' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in >>> `block in transmit' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:in >>> `transmit' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in >>> `execute' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:in >>> `execute' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in >>> `get' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in >>> `get_response' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in >>> `call' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:in >>> `list' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in >>> `ensure_sync_notification' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in >>> `' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `block in load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:240:in `load_dependency' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /usr/share/foreman/db/seeds.rb:81:in `block in ' >>> /usr/share/foreman/db/seeds.rb:79:in `each' >>> /usr/share/foreman/db/seeds.rb:79:in `' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `block in load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:240:in `load_dependency' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in >>> `load_seed' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- >>> 4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in `load_seed' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- >>> 4.2.5.1/lib/active_record/railties/databases.rake:183:in `block (2 >>> levels) in ' >>> Tasks: TOP => db:seed >>> (See full trace by running task with --trace) >>> Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb >>> Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb >>> Seeding /usr/share/foreman/db/seeds.d/03-roles.rb >>> Seeding /usr/share/foreman/db/seeds.d/04-admin.rb >>> Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb >>> Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb >>> Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb >>> Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb >>> Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb >>> >>> [ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs >>> for more information. >>> [DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1) >>> [ERROR 2016-12-17 15:22:47 main] Errors encountered during run: >>> [ERROR 2016-12-17 15:22:47 main] rake aborted! >>> RestClient::ResourceNotFound: 404 Resource Not Found >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in >>> `return!' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in >>> `block in get_response' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in >>> `call' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in >>> `process_result' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in >>> `block in transmit' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:in >>> `transmit' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in >>> `execute' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:in >>> `execute' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in >>> `get' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in >>> `get_response' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in >>> `call' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:in >>> `list' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in >>> `ensure_sync_notification' >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in >>> `' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `block in load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:240:in `load_dependency' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /usr/share/foreman/db/seeds.rb:81:in `block in ' >>> /usr/share/foreman/db/seeds.rb:79:in `each' >>> /usr/share/foreman/db/seeds.rb:79:in `' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `block in load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:240:in `load_dependency' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- >>> 4.2.5.1/lib/active_support/dependencies.rb:268:in `load' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in >>> `load_seed' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- >>> 4.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in `load_seed' >>> /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- >>> 4.2.5.1/lib/active_record/railties/databases.rake:183:in `block (2 >>> levels) in ' >>> Tasks: TOP => db:seed >>> (See full trace by running task with --trace) >>> Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb >>> Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb >>> Seeding /usr/share/foreman/db/seeds.d/03-roles.rb >>> Seeding /usr/share/foreman/db/seeds.d/04-admin.rb >>> Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb >>> Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb >>> Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb >>> Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb >>> Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb >>> Seeding >>> /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb >>> >>> [ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs >>> for more information. >>> [DEBUG 2016-12-17 15:22:47 main] Cleaning >>> /etc/katello-installer/d20161217-45847-jjhsip >>> [DEBUG 2016-12-17 15:22:47 main] Cleaning >>> /tmp/kafo_hiera20161217-45847-155fduz >>> [DEBUG 2016-12-17 15:22:47 main] Cleaning /tmp/default_values.yaml >>> >>> >>> >>> Can anyone please help. >>> >> -- >> You received this message because you are subscribed to the Google Groups >> "Foreman users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to foreman-user...@googlegroups.com . >> To post to this group, send email to forema...@googlegroups.com >> . >> Visit this group at https://groups.google.com/group/foreman-users. >> For more options, visit https://groups.google.com/d/optout. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Foreman users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to foreman-user...@googlegroups.com . >> To post to this group, send email to forema...@googlegroups.com >> . >> Visit this group at https://groups.google.com/group/foreman-users. >> For more options, visit https://groups.google.com/d/optout. >> > >
6

Now I can get through the --upgrade process - thank you very much Pascal - but if I try and pull packages they are still reporting 404.

http://projects.theforeman.org/issues/17715
http://projects.theforeman.org/issues/17703
http://projects.theforeman.org/issues/17722

On the client I'm doing/seeing:

$ sudo yum clean all
$ sudo rm -rf /var/cache/yum/x86_64/
$ sudo yum upgrade

<snip normal yum stuff>

Transaction Summary

··· ================================================================================ Install 4 Packages (+23 Dependent packages) Upgrade 303 Packages Remove 1 Package

Total download size: 233 M
Is this ok [y/d/N]: y
Downloading packages:
No Presto metadata available for Centric_Group_fedora_people-katello_fedora_people-katello-client3_2-el7
No Presto metadata available for Centric_Group_centos_c7
Centric_Group_centos_c7updates/prestodelta | 37 kB 00:00
Delta RPMs reduced 6.6 M of updates to 2.5 M (62% saved)
(1/330): chrony-2.1.1-1.el7.centos_2.1.1-4.el7.centos.x86_ | 138 kB 00:00
expat-2.1.0-8.el7_2.1.0-10.el7 FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.
To address this issue please refer to the below knowledge base article

https://access.redhat.com/articles/1320623

If above article doesn’t help to resolve this issue please create a bug on https://bugs.centos.org/

(2/330): glibc-2.17-106.el7_2.8_2.17-157.el7_3.1.x86_64.dr | 907 kB 00:00
(3/330): libgcrypt-1.5.3-12.el7_1.1_1.5.3-13.el7_3.1.x86_6 | 29 kB 00:00
(4/330): nss-tools-3.21.0-9.el7_2_3.21.3-2.el7_3.x86_64.dr | 303 kB 00:00
(5/330): nss-util-3.21.0-2.2.el7_2_3.21.3-1.1.el7_3.x86_64 | 20 kB 00:00
(6/330): policycoreutils-2.2.5-20.el7_2.5-9.el7.x86_64.drp | 433 kB 00:00
(7/330): policycoreutils-python-2.2.5-20.el7_2.5-9.el7.x86 | 259 kB 00:00
(8/330): tuned-2.5.1-4.el7_2.6_2.7.1-3.el7_3.1.noarch.drpm | 102 kB 00:00
(9/330): tzdata-2016h-1.el7_2016j-1.el7.noarch.drpm | 298 kB 00:00
NetworkManager-1.4.0-13.el7_3. FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/NetworkManager-1.4.0-13.el7_3.x86_64.rpm: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.

<snip remaining packages that all 404 as well>

On the Katello server I see:

…from journalctl -f:

Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (315): mirror.centos.org
Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: [-] 127.0.0.1 - - [20/Dec/2016:15:15:58 +0000] “GET /var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm HTTP/1.1” 404 - “-” "urlgrabber/3.10 yum/3.4.3"
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (316): mirror.centos.org
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: [-] 127.0.0.1 - - [20/Dec/2016:15:16:00 +0000] “GET /var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm HTTP/1.1” 404 - “-” "urlgrabber/3.10 yum/3.4.3"
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (317): mirror.centos.org

…from /var/log/httpd/foreman-ssl_access_ssl.log:

172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59 -0600] “GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm HTTP/1.1” 302 - “-” "urlgrabber/3.10 yum/3.4.3"
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59 -0600] “GET /streamer/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9kcnBtL2IzLzBkNzE3MGE0ZDk1ZThhYTU3NjIyMzA4OWI5MmYwODE4MmY3Y2NiMWRkNzY5MDk2YWFiNDliMDA5MWZhMDUxL2RycG1zL2V4cGF0LTIuMS4wLTguZWw3XzIuMS4wLTEwLmVsN18zLng4Nl82NC5kcnBtIiwgImV4cGlyYXRpb24iOiAxNDgyMjQ3MDQ5fQ%3D%3D;signature=A-lpzb8dYbdRtYSonH1RuH2D3BucYAdiJpYFvAERtHT04_pzN9x5ARj9rtGDrgTbiqTxhen8D_NL14wSoRT08PZ4VH1uOWGWkfel-WFEZQm_R3drPX23pCDW6MQ42zI2o7S65X5GiZws_ZnAbalS_g_ToOQQvGj7pfOYhf6M-JcKiEfb89WRPA1aaXH8DvnAyd82PSPvBvQnE5-KJ-Ps4wLhS3gCei3Yoni6ntNiCqWuo1hFdvYxOf4mVRQQOh2B18VxGnN0AC9c1LR6zUSDXq4VWVjX59kItbapeh8aQlnxwtHrM3ksT38POYdSdkfmzz4X0OYSvHQ8Gkz9u76B-A%3D%3D HTTP/1.1” 404 - “-” "urlgrabber/3.10 yum/3.4.3"
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:16:00 -0600] “GET /streamer/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vYjYvYzMzOWI0OTkyZDY3NGUwMDFhZDU1MDg4MDJhMmZiYzNkN2NiNDZhZjk5MmM4MzY2ZjZmOTI1MTIyN2QzYjQvTmV0d29ya01hbmFnZXItMS40LjAtMTMuZWw3XzMueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4MjI0NzA1MH0%3D;signature=CehLSHyVEGDJu-6r0SMoHEKJxksW0BqZqdnSDHfqzQom33_-apNDJhn2X965O1wJjk0okw8gv-ITUSM3CoLHrgt2Cg6LRAC5kZ1tSwiNurFJFLjIa2SVtiiUXt13XxBFN_AACAd8i_0uVs29AeMuLiKWkdFAzGcWqWmQS1ixQ4uACGHfy7-DHdbbrupBhWDCzPyURu6wChpDSqhcymRMWsb1JNLIgBo1_qu479zby1hr9Sv2LOpN37sdm4WOq_vkWfu6Tkq7IyDTnxF5hMOn8DiEg1UvfEMOCzDqFQYjGvc1LIJvPaWR1ZBnLz2pT5pTHNPUyIZud0gjpzrRikKytg%3D%3D HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”

…from /var/log/squid/access.log:

1482246959.418 223 127.0.0.1 TCP_MISS/404 385 GET http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm - FIRSTUP_PARENT/127.0.0.1 text/html
1482246961.086 92 127.0.0.1 TCP_MISS/404 385 GET http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm - FIRSTUP_PARENT/127.0.0.1 text/html

…from /var/log/squid/store.log:

1482246959.418 RELEASE -1 FFFFFFFF 50995C9E832B61A47EC237BB0AEBD4E7 ? ? ? ? ?/? ?/? ? ?
1482246961.086 RELEASE -1 FFFFFFFF F26384D752D959E8933E933A500182FB ? ? ? ? ?/? ?/? ? ?

From the Katello host I’m able to “wget” the packages from mirror.centos.org.

From: “Peter Kirby” peter.kirby@objectstream.com
To: foreman-users@googlegroups.com
Sent: Tuesday, December 20, 2016 8:59:52 AM
Subject: Re: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

On Tue, Dec 20, 2016 at 8:55 AM, ‘Jason B. Nance’ via Foreman users < [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ] > wrote:

Pascalp,

Were you using the Puppet 3 or Puppet 4 repo on your server?

Thanks,

j

Jason,

FWIW - I got this error with Puppet 3 and also again with Puppet 4 repos. When I have time I’ll try the solution posted by Pascalp and report back on the results.

Thanks,
Peter

BQ_BEGIN

From: “pascalp” < [ mailto:supremerulerxenu@gmail.com | supremerulerxenu@gmail.com ] >
To: “Foreman users” < [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ] >
Sent: Tuesday, December 20, 2016 8:50:45 AM
Subject: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed in your issue at [ Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman | Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman ] Hope it works for you.

On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote:
BQ_BEGIN

Hi
When I was running upgrade I had an error:

[ Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman | Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman ]

So I did as it is mentioned in thiissue:

“:run_always => true” seems to be a remnant of the previous 30-upgrade.rb where every upgrade_step had a “:run_always” or “:long_running” option passed. With the 3.2.1 30-upgrade.rb “:migrate_candlepin” is the only upgrade_step with an option and since the function only takes one argument this results in the error seen.

Deleting “, :run_always => true” lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:inblock in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:inprocess_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:intransmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:inexecute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:inget_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:inlist’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in<top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:inblock in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:inload’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:ineach’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:inload’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:240:inload_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:inload_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- [ http://4.2.5.1/lib/active_record/ | 4.2.5.1/lib/active_record/ ] tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- [ http://4.2.5.1/lib/active_record/ | 4.2.5.1/lib/active_record/ ] railties/databases.rake:183:inblock (2 levels) in <top (required)>'
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs for more information.
[DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1)
[ERROR 2016-12-17 15:22:47 main] Errors encountered during run:
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:inblock in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:inprocess_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:intransmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:inexecute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:inget_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:inlist’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in<top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ]

7

Just wanted to say that it seems to work fine for me. I installed a package
which I hadn't dowloaded before from a repo with "on demand" set:
Dec 20 17:33:35 katello01 pulp_streamer:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection
(1): mirror.maeh.org
Dec 20 17:33:37 katello01 pulp_streamer: [-] 127.0.0.1 - -
[20/Dec/2016:16:33:37 +0000] "GET
/var/lib/pulp/content/units/rpm/e3/ab15e91514995fd1308ecc6d0190980bb0b849126735bacaa857f2e61fcf36/mariadb-5.5.52-1.el7.x86_64.rpm
HTTP/1.1" 200 9155484 "-" "urlgrabber/3.10 yum/3.4.3"

··· On Tuesday, December 20, 2016 at 4:30:36 PM UTC+1, Jason B. Nance wrote: > > Now I can get through the --upgrade process - thank you very much Pascal - > but if I try and pull packages they are still reporting 404. > > http://projects.theforeman.org/issues/17715 > http://projects.theforeman.org/issues/17703 > http://projects.theforeman.org/issues/17722 > > On the client I'm doing/seeing: > > $ sudo yum clean all > $ sudo rm -rf /var/cache/yum/x86_64/ > $ sudo yum upgrade > > > > Transaction Summary > > ================================================================================ > Install 4 Packages (+23 Dependent packages) > Upgrade 303 Packages > Remove 1 Package > > Total download size: 233 M > Is this ok [y/d/N]: y > Downloading packages: > No Presto metadata available for > Centric_Group_fedora_people-katello_fedora_people-katello-client3_2-el7 > No Presto metadata available for Centric_Group_centos_c7 > Centric_Group_centos_c7updates/prestodelta | 37 kB 00:00 > Delta RPMs reduced 6.6 M of updates to 2.5 M (62% saved) > (1/330): chrony-2.1.1-1.el7.centos_2.1.1-4.el7.centos.x86_ | 138 kB 00:00 > expat-2.1.0-8.el7_2.1.0-10.el7 FAILED > > https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm: > [Errno 14] HTTPS Error 404 - Not Found > Trying other mirror. > To address this issue please refer to the below knowledge base article > > https://access.redhat.com/articles/1320623 > > If above article doesn't help to resolve this issue please create a bug on > https://bugs.centos.org/ > > (2/330): glibc-2.17-106.el7_2.8_2.17-157.el7_3.1.x86_64.dr | 907 kB 00:00 > (3/330): libgcrypt-1.5.3-12.el7_1.1_1.5.3-13.el7_3.1.x86_6 | 29 kB 00:00 > (4/330): nss-tools-3.21.0-9.el7_2_3.21.3-2.el7_3.x86_64.dr | 303 kB 00:00 > (5/330): nss-util-3.21.0-2.2.el7_2_3.21.3-1.1.el7_3.x86_64 | 20 kB 00:00 > (6/330): policycoreutils-2.2.5-20.el7_2.5-9.el7.x86_64.drp | 433 kB 00:00 > (7/330): policycoreutils-python-2.2.5-20.el7_2.5-9.el7.x86 | 259 kB 00:00 > (8/330): tuned-2.5.1-4.el7_2.6_2.7.1-3.el7_3.1.noarch.drpm | 102 kB 00:00 > (9/330): tzdata-2016h-1.el7_2016j-1.el7.noarch.drpm | 298 kB 00:00 > NetworkManager-1.4.0-13.el7_3. FAILED > > https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/NetworkManager-1.4.0-13.el7_3.x86_64.rpm: > [Errno 14] HTTPS Error 404 - Not Found > Trying other mirror. > > > > > On the Katello server I see: > > ...from journalctl -f: > > Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: > requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection > (315): mirror.centos.org > Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: [-] > 127.0.0.1 - - [20/Dec/2016:15:15:58 +0000] "GET > /var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm > HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3" > Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: > requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection > (316): mirror.centos.org > Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: [-] > 127.0.0.1 - - [20/Dec/2016:15:16:00 +0000] "GET > /var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm > HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3" > Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: > requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection > (317): mirror.centos.org > > ...from /var/log/httpd/foreman-ssl_access_ssl.log: > > 172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59 > -0600] "GET > /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm > HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3" > 172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59 > -0600] "GET > /streamer/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9kcnBtL2IzLzBkNzE3MGE0ZDk1ZThhYTU3NjIyMzA4OWI5MmYwODE4MmY3Y2NiMWRkNzY5MDk2YWFiNDliMDA5MWZhMDUxL2RycG1zL2V4cGF0LTIuMS4wLTguZWw3XzIuMS4wLTEwLmVsN18zLng4Nl82NC5kcnBtIiwgImV4cGlyYXRpb24iOiAxNDgyMjQ3MDQ5fQ%3D%3D;signature=A-lpzb8dYbdRtYSonH1RuH2D3BucYAdiJpYFvAERtHT04_pzN9x5ARj9rtGDrgTbiqTxhen8D_NL14wSoRT08PZ4VH1uOWGWkfel-WFEZQm_R3drPX23pCDW6MQ42zI2o7S65X5GiZws_ZnAbalS_g_ToOQQvGj7pfOYhf6M-JcKiEfb89WRPA1aaXH8DvnAyd82PSPvBvQnE5-KJ-Ps4wLhS3gCei3Yoni6ntNiCqWuo1hFdvYxOf4mVRQQOh2B18VxGnN0AC9c1LR6zUSDXq4VWVjX59kItbapeh8aQlnxwtHrM3ksT38POYdSdkfmzz4X0OYSvHQ8Gkz9u76B-A%3D%3D > HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3" > 172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:16:00 > -0600] "GET > /streamer/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vYjYvYzMzOWI0OTkyZDY3NGUwMDFhZDU1MDg4MDJhMmZiYzNkN2NiNDZhZjk5MmM4MzY2ZjZmOTI1MTIyN2QzYjQvTmV0d29ya01hbmFnZXItMS40LjAtMTMuZWw3XzMueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4MjI0NzA1MH0%3D;signature=CehLSHyVEGDJu-6r0SMoHEKJxksW0BqZqdnSDHfqzQom33_-apNDJhn2X965O1wJjk0okw8gv-ITUSM3CoLHrgt2Cg6LRAC5kZ1tSwiNurFJFLjIa2SVtiiUXt13XxBFN_AACAd8i_0uVs29AeMuLiKWkdFAzGcWqWmQS1ixQ4uACGHfy7-DHdbbrupBhWDCzPyURu6wChpDSqhcymRMWsb1JNLIgBo1_qu479zby1hr9Sv2LOpN37sdm4WOq_vkWfu6Tkq7IyDTnxF5hMOn8DiEg1UvfEMOCzDqFQYjGvc1LIJvPaWR1ZBnLz2pT5pTHNPUyIZud0gjpzrRikKytg%3D%3D > HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3" > > ...from /var/log/squid/access.log: > > 1482246959.418 223 127.0.0.1 TCP_MISS/404 385 GET > http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm > - FIRSTUP_PARENT/127.0.0.1 text/html > 1482246961.086 92 127.0.0.1 TCP_MISS/404 385 GET > http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm > - FIRSTUP_PARENT/127.0.0.1 text/html > > ...from /var/log/squid/store.log: > > 1482246959.418 RELEASE -1 FFFFFFFF 50995C9E832B61A47EC237BB0AEBD4E7 > ? ? ? ? ?/? ?/? ? ? > 1482246961.086 RELEASE -1 FFFFFFFF F26384D752D959E8933E933A500182FB > ? ? ? ? ?/? ?/? ? ? > > > From the Katello host I'm able to "wget" the packages from > mirror.centos.org. >
8

All,

Thanks for the dutiful reporting and the workarounds.

We are working on getting 3.2.2 out with patches to these issues, I'll post
when that is available.

-John

John Mitsch
Red Hat Engineering
(860)-967-7285
irc: jomitsch

··· On Tue, Dec 20, 2016 at 10:30 AM, 'Jason B. Nance' via Foreman users < foreman-users@googlegroups.com> wrote:

Now I can get through the --upgrade process - thank you very much Pascal -
but if I try and pull packages they are still reporting 404.

Bug #17715: Katello Server Attempting To Pull From Wrong Upstream Repository - Katello - Foreman
Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman
Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman

On the client I’m doing/seeing:

$ sudo yum clean all
$ sudo rm -rf /var/cache/yum/x86_64/
$ sudo yum upgrade

Transaction Summary

====================
Install 4 Packages (+23 Dependent packages)
Upgrade 303 Packages
Remove 1 Package

Total download size: 233 M
Is this ok [y/d/N]: y
Downloading packages:
No Presto metadata available for Centric_Group_fedora_people-
katello_fedora_people-katello-client3_2-el7
No Presto metadata available for Centric_Group_centos_c7
Centric_Group_centos_c7updates/prestodelta | 37 kB
00:00
Delta RPMs reduced 6.6 M of updates to 2.5 M (62% saved)
(1/330): chrony-2.1.1-1.el7.centos_2.1.1-4.el7.centos.x86_ | 138 kB
00:00
expat-2.1.0-8.el7_2.1.0-10.el7 FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/
pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/
expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm: [Errno 14] HTTPS Error 404

  • Not Found
    Trying other mirror.
    To address this issue please refer to the below knowledge base article

[Errno 14] yum fails with HTTP/HTTPS Error 404 - Red Hat Customer Portal

If above article doesn’t help to resolve this issue please create a bug on
https://bugs.centos.org/

(2/330): glibc-2.17-106.el7_2.8_2.17-157.el7_3.1.x86_64.dr | 907 kB
00:00
(3/330): libgcrypt-1.5.3-12.el7_1.1_1.5.3-13.el7_3.1.x86_6 | 29 kB
00:00
(4/330): nss-tools-3.21.0-9.el7_2_3.21.3-2.el7_3.x86_64.dr | 303 kB
00:00
(5/330): nss-util-3.21.0-2.2.el7_2_3.21.3-1.1.el7_3.x86_64 | 20 kB
00:00
(6/330): policycoreutils-2.2.5-20.el7_2.5-9.el7.x86_64.drp | 433 kB
00:00
(7/330): policycoreutils-python-2.2.5-20.el7_2.5-9.el7.x86 | 259 kB
00:00
(8/330): tuned-2.5.1-4.el7_2.6_2.7.1-3.el7_3.1.noarch.drpm | 102 kB
00:00
(9/330): tzdata-2016h-1.el7_2016j-1.el7.noarch.drpm | 298 kB
00:00
NetworkManager-1.4.0-13.el7_3. FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/
pnp-nonproduction/c7stable/custom/centos/c7updates/
NetworkManager-1.4.0-13.el7_3.x86_64.rpm: [Errno 14] HTTPS Error 404 -
Not Found
Trying other mirror.

<snip remaining packages that all 404 as well>

On the Katello server I see:

…from journalctl -f:

Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (315): mirror.centos.org
Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: [-]
127.0.0.1 - - [20/Dec/2016:15:15:58 +0000] “GET /var/lib/pulp/content/units/
drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa0
51/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm HTTP/1.1” 404 - “-”
“urlgrabber/3.10 yum/3.4.3”
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (316): mirror.centos.org
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: [-]
127.0.0.1 - - [20/Dec/2016:15:16:00 +0000] “GET /var/lib/pulp/content/units/
rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3
b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm HTTP/1.1” 404 - “-”
“urlgrabber/3.10 yum/3.4.3”
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (317): mirror.centos.org

…from /var/log/httpd/foreman-ssl_access_ssl.log:

172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59
-0600] “GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/
centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm
HTTP/1.1” 302 - “-” “urlgrabber/3.10 yum/3.4.3”
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59
-0600] “GET /streamer/var/lib/pulp/content/units/drpm/b3/
0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa0
51/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm?policy=
eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAi
fSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVu
dC91bml0cy9kcnBtL2IzLzBkNzE3MGE0ZDk1ZThhYTU3NjIyMzA4OWI5MmYw
ODE4MmY3Y2NiMWRkNzY5MDk2YWFiNDliMDA5MWZhMDUxL2RycG1zL2V4cGF0
LTIuMS4wLTguZWw3XzIuMS4wLTEwLmVsN18zLng4Nl82NC5kcnBtIiwgImV4
cGlyYXRpb24iOiAxNDgyMjQ3MDQ5fQ%3D%3D;signature=A-
lpzb8dYbdRtYSonH1RuH2D3BucYAdiJpYFvAERtHT04_pzN9x5ARj9rtGDrgTbiqTxhen8D_
NL14wSoRT08PZ4VH1uOWGWkfel-WFEZQm_R3drPX23pCDW6MQ42zI2o7S65X5GiZ
ws_ZnAbalS_g_ToOQQvGj7pfOYhf6M-JcKiEfb89WRPA1aaXH8DvnAyd82PSPvBvQnE5-KJ-
Ps4wLhS3gCei3Yoni6ntNiCqWuo1hFdvYxOf4mVRQQOh2B18VxGnN0AC9c1L
R6zUSDXq4VWVjX59kItbapeh8aQlnxwtHrM3ksT38POYdSdkfmzz4X0OYSvHQ8Gkz9u76B-A%3D%3D
HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:16:00
-0600] “GET /streamer/var/lib/pulp/content/units/rpm/b6/
c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3
b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm?policy=
eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAi
fSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVu
dC91bml0cy9ycG0vYjYvYzMzOWI0OTkyZDY3NGUwMDFhZDU1MDg4MDJhMmZi
YzNkN2NiNDZhZjk5MmM4MzY2ZjZmOTI1MTIyN2QzYjQvTmV0d29ya01hbmFn
ZXItMS40LjAtMTMuZWw3XzMueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjog
MTQ4MjI0NzA1MH0%3D;signature=CehLSHyVEGDJu-6r0SMoHEKJxksW0BqZqdnSDHfqzQom
33_-apNDJhn2X965O1wJjk0okw8gv-ITUSM3CoLHrgt2Cg6LRAC5kZ1tSwiN
urFJFLjIa2SVtiiUXt13XxBFN_AACAd8i_0uVs29AeMuLiKWkdFAzGcWqWmQS1ix
Q4uACGHfy7-DHdbbrupBhWDCzPyURu6wChpDSqhcymRMWsb1JNLIgBo1_
qu479zby1hr9Sv2LOpN37sdm4WOq_vkWfu6Tkq7IyDTnxF5hMOn8DiEg1Uv
fEMOCzDqFQYjGvc1LIJvPaWR1ZBnLz2pT5pTHNPUyIZud0gjpzrRikKytg%3D%3D
HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”

…from /var/log/squid/access.log:

1482246959.418 223 127.0.0.1 TCP_MISS/404 385 GET
http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/
0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa0
51/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm - FIRSTUP_PARENT/
127.0.0.1 text/html
1482246961.086 92 127.0.0.1 TCP_MISS/404 385 GET
http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/
c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3
b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm - FIRSTUP_PARENT/127.0.0.1
text/html

…from /var/log/squid/store.log:

1482246959.418 RELEASE -1 FFFFFFFF 50995C9E832B61A47EC237BB0AEBD4E7
? ? ? ? ?/? ?/? ? ?
1482246961.086 RELEASE -1 FFFFFFFF F26384D752D959E8933E933A500182FB
? ? ? ? ?/? ?/? ? ?

From the Katello host I’m able to “wget” the packages from
mirror.centos.org.

*From: *“Peter Kirby” peter.kirby@objectstream.com
*To: *foreman-users@googlegroups.com
*Sent: *Tuesday, December 20, 2016 8:59:52 AM
*Subject: *Re: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

On Tue, Dec 20, 2016 at 8:55 AM, ‘Jason B. Nance’ via Foreman users < > foreman-users@googlegroups.com> wrote:

Pascalp,

Were you using the Puppet 3 or Puppet 4 repo on your server?

Thanks,

j

Jason,

FWIW - I got this error with Puppet 3 and also again with Puppet 4 repos.
When I have time I’ll try the solution posted by Pascalp and report back on
the results.

Thanks,
Peter

*From: *“pascalp” supremerulerxenu@gmail.com
*To: *“Foreman users” foreman-users@googlegroups.com
*Sent: *Tuesday, December 20, 2016 8:50:45 AM
*Subject: *[foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed
in your issue at Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman Hope it
works for you.

On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote:

Hi
When I was running upgrade I had an error:

Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman

So I did as it is mentioned in thiissue:

“:run_always => true” seems to be a remnant of the previous
30-upgrade.rb where every upgrade_step had a “:run_always” or
“:long_running” option passed. With the 3.2.1 30-upgrade.rb
“:migrate_candlepin” is the only upgrade_step with an option and since the
function only takes one argument this results in the error seen.

Deleting “, :run_always => true” lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9. 0/lib/runcible/resources/event_notifier.rb:48:in list’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1. 1/db/seeds.d/108-ensure_sync_notification.rb:9:in <top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in block in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:in each’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in load_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4
.2.5.1/lib/active_record/tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4 .2.5.1/lib/active_record/railties/databases.rake:183:in block (2
levels) in <top (required)>’
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check logs
for more information.
[DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1)
[ERROR 2016-12-17 15:22:47 main] Errors encountered during run:
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1. 8.0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.
8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9. 0/lib/runcible/resources/event_notifier.rb:48:in list’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.
1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1. 1/db/seeds.d/108-ensure_sync_notification.rb:9:in <top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in block in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:in each’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:268:in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- 4.2.5.1/lib/active_support/dependencies.rb:240:in load_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-
4.2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in load_seed’
/opt/rh/sc

9

two commits that may be helpful in patching 3.2.1 are:

and

John Mitsch
Red Hat Engineering
(860)-967-7285
irc: jomitsch

··· On Tue, Dec 20, 2016 at 10:50 AM, John Mitsch wrote:

All,

Thanks for the dutiful reporting and the workarounds.

We are working on getting 3.2.2 out with patches to these issues, I’ll
post when that is available.

-John

John Mitsch
Red Hat Engineering
(860)-967-7285 <(860)%20967-7285>
irc: jomitsch

On Tue, Dec 20, 2016 at 10:30 AM, ‘Jason B. Nance’ via Foreman users < > foreman-users@googlegroups.com> wrote:

Now I can get through the --upgrade process - thank you very much Pascal

  • but if I try and pull packages they are still reporting 404.

Bug #17715: Katello Server Attempting To Pull From Wrong Upstream Repository - Katello - Foreman
Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman
Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman

On the client I’m doing/seeing:

$ sudo yum clean all
$ sudo rm -rf /var/cache/yum/x86_64/
$ sudo yum upgrade

Transaction Summary

====================
Install 4 Packages (+23 Dependent packages)
Upgrade 303 Packages
Remove 1 Package

Total download size: 233 M
Is this ok [y/d/N]: y
Downloading packages:
No Presto metadata available for Centric_Group_fedora_people-ka
tello_fedora_people-katello-client3_2-el7
No Presto metadata available for Centric_Group_centos_c7
Centric_Group_centos_c7updates/prestodelta | 37 kB
00:00
Delta RPMs reduced 6.6 M of updates to 2.5 M (62% saved)
(1/330): chrony-2.1.1-1.el7.centos_2.1.1-4.el7.centos.x86_ | 138 kB
00:00
expat-2.1.0-8.el7_2.1.0-10.el7 FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp
-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-
2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm: [Errno 14] HTTPS Error 404 - Not
Found
Trying other mirror.
To address this issue please refer to the below knowledge base article

[Errno 14] yum fails with HTTP/HTTPS Error 404 - Red Hat Customer Portal

If above article doesn’t help to resolve this issue please create a bug
on https://bugs.centos.org/

(2/330): glibc-2.17-106.el7_2.8_2.17-157.el7_3.1.x86_64.dr | 907 kB
00:00
(3/330): libgcrypt-1.5.3-12.el7_1.1_1.5.3-13.el7_3.1.x86_6 | 29 kB
00:00
(4/330): nss-tools-3.21.0-9.el7_2_3.21.3-2.el7_3.x86_64.dr | 303 kB
00:00
(5/330): nss-util-3.21.0-2.2.el7_2_3.21.3-1.1.el7_3.x86_64 | 20 kB
00:00
(6/330): policycoreutils-2.2.5-20.el7_2.5-9.el7.x86_64.drp | 433 kB
00:00
(7/330): policycoreutils-python-2.2.5-20.el7_2.5-9.el7.x86 | 259 kB
00:00
(8/330): tuned-2.5.1-4.el7_2.6_2.7.1-3.el7_3.1.noarch.drpm | 102 kB
00:00
(9/330): tzdata-2016h-1.el7_2016j-1.el7.noarch.drpm | 298 kB
00:00
NetworkManager-1.4.0-13.el7_3. FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp
-nonproduction/c7stable/custom/centos/c7updates/NetworkManag
er-1.4.0-13.el7_3.x86_64.rpm: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.

<snip remaining packages that all 404 as well>

On the Katello server I see:

…from journalctl -f:

Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (315): mirror.centos.org
Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: [-]
127.0.0.1 - - [20/Dec/2016:15:15:58 +0000] “GET
/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089
b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm
HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (316): mirror.centos.org
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: [-]
127.0.0.1 - - [20/Dec/2016:15:16:00 +0000] “GET
/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad550880
2a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm
HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (317): mirror.centos.org

…from /var/log/httpd/foreman-ssl_access_ssl.log:

172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59
-0600] “GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/
centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm
HTTP/1.1” 302 - “-” “urlgrabber/3.10 yum/3.4.3”
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59
-0600] “GET /streamer/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa
576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-
2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm?policy=eyJleHRlbnN
pb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc29
1cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9
kcnBtL2IzLzBkNzE3MGE0ZDk1ZThhYTU3NjIyMzA4OWI5MmYwODE4MmY3Y2N
iMWRkNzY5MDk2YWFiNDliMDA5MWZhMDUxL2RycG1zL2V4cGF0LTIuMS4wLTg
uZWw3XzIuMS4wLTEwLmVsN18zLng4Nl82NC5kcnBtIiwgImV4cGlyYXRpb24
iOiAxNDgyMjQ3MDQ5fQ%3D%3D;signature=A-lpzb8dYbdRtYSonH1R
uH2D3BucYAdiJpYFvAERtHT04_pzN9x5ARj9rtGDrgTbiqTxhen8D_NL14wS
oRT08PZ4VH1uOWGWkfel-WFEZQm_R3drPX23pCDW6MQ42zI2o7S65X5GiZws
ZnAbalS_g_ToOQQvGj7pfOYhf6M-JcKiEfb89WRPA1aaXH8DvnAyd82PSPv
BvQnE5-KJ-Ps4wLhS3gCei3Yoni6ntNiCqWuo1hFdvYxOf4mVRQQOh2B18Vx
GnN0AC9c1LR6zUSDXq4VWVjX59kItbapeh8aQlnxwtHrM3ksT38POYdSdkfmzz4X0OYSvHQ8Gkz9u76B-A%3D%3D
HTTP/1.1" 404 - “-” “urlgrabber/3.10 yum/3.4.3”
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:16:00
-0600] "GET /streamer/var/lib/pulp/content/units/rpm/b6/c339b4992d674e00
1ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/
NetworkManager-1.4.0-13.el7_3.x86_64.rpm?policy=eyJleHRlbnNp
b25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291
cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9y
cG0vYjYvYzMzOWI0OTkyZDY3NGUwMDFhZDU1MDg4MDJhMmZiYzNkN2NiNDZh
Zjk5MmM4MzY2ZjZmOTI1MTIyN2QzYjQvTmV0d29ya01hbmFnZXItMS40LjAt
MTMuZWw3XzMueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4MjI0NzA1
MH0%3D;signature=CehLSHyVEGDJu-6r0SMoHEKJxksW0BqZqdnSDHfqzQom33-
apNDJhn2X965O1wJjk0okw8gv-ITUSM3CoLHrgt2Cg6LRAC5kZ1tSwiNurFJ
FLjIa2SVtiiUXt13XxBFN_AACAd8i_0uVs29AeMuLiKWkdFAzGcWqWmQS1ix
Q4uACGHfy7-DHdbbrupBhWDCzPyURu6wChpDSqhcymRMWsb1JNLIgBo1_qu4
79zby1hr9Sv2LOpN37sdm4WOq_vkWfu6Tkq7IyDTnxF5hMOn8DiEg1UvfEMO
CzDqFQYjGvc1LIJvPaWR1ZBnLz2pT5pTHNPUyIZud0gjpzrRikKytg%3D%3D HTTP/1.1”
404 - “-” “urlgrabber/3.10 yum/3.4.3”

…from /var/log/squid/access.log:

1482246959.418 223 127.0.0.1 TCP_MISS/404 385 GET
http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/0d7
170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/
drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm - FIRSTUP_PARENT/
127.0.0.1 text/html
1482246961.086 92 127.0.0.1 TCP_MISS/404 385 GET
http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/c339
b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/
NetworkManager-1.4.0-13.el7_3.x86_64.rpm - FIRSTUP_PARENT/127.0.0.1
text/html

…from /var/log/squid/store.log:

1482246959.418 RELEASE -1 FFFFFFFF 50995C9E832B61A47EC237BB0AEBD4E7
? ? ? ? ?/? ?/? ? ?
1482246961.086 RELEASE -1 FFFFFFFF F26384D752D959E8933E933A500182FB
? ? ? ? ?/? ?/? ? ?

From the Katello host I’m able to “wget” the packages from
mirror.centos.org.

*From: *“Peter Kirby” peter.kirby@objectstream.com
*To: *foreman-users@googlegroups.com
*Sent: *Tuesday, December 20, 2016 8:59:52 AM
*Subject: *Re: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

On Tue, Dec 20, 2016 at 8:55 AM, ‘Jason B. Nance’ via Foreman users < >> foreman-users@googlegroups.com> wrote:

Pascalp,

Were you using the Puppet 3 or Puppet 4 repo on your server?

Thanks,

j

Jason,

FWIW - I got this error with Puppet 3 and also again with Puppet 4
repos. When I have time I’ll try the solution posted by Pascalp and report
back on the results.

Thanks,
Peter

*From: *“pascalp” supremerulerxenu@gmail.com
*To: *“Foreman users” foreman-users@googlegroups.com
*Sent: *Tuesday, December 20, 2016 8:50:45 AM
*Subject: *[foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed
in your issue at Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman Hope it
works for you.

On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote:

Hi
When I was running upgrade I had an error:

Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman

So I did as it is mentioned in thiissue:

“:run_always => true” seems to be a remnant of the previous
30-upgrade.rb where every upgrade_step had a “:run_always” or
“:long_running” option passed. With the 3.2.1 30-upgrade.rb
“:migrate_candlepin” is the only upgrade_step with an option and since the
function only takes one argument this results in the error seen.

Deleting “, :run_always => true” lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/ lib/runcible/resources/event_notifier.rb:48:in list’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1 /db/seeds.d/108-ensure_sync_notification.rb:9:in <top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:268:in block in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:268:in load’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:in each’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:268:in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:240:in load_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in load_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.
2.5.1/lib/active_record/tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4. 2.5.1/lib/active_record/railties/databases.rake:183:in block (2
levels) in <top (required)>’
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check
logs for more information.
[DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1)
[ERROR 2016-12-17 15:22:47 main] Errors encountered during run:
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/ lib/runcible/resources/event_notifier.rb:48:in list’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1 /db/seeds.d/108-ensure_sync_notification.rb:9:in <top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:268:in block in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:240:in `load_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.

10

> All,
>
> Thanks for the dutiful reporting and the workarounds.
>
> We are working on getting 3.2.2 out with patches to these issues, I'll
> post when that is available.
>
>
John,

Thank you for that update. Do you have any estimation on when that release
might be? I don't at all mean to rush you all, I'm just curious so I can
plan if I should let my broken 3.2.1 sit for now and wait for 3.2.2 or if I
should apply those commits myself to get it back up and going.

Thank you,
Peter

··· On Tue, Dec 20, 2016 at 9:50 AM, John Mitsch wrote:

-John

John Mitsch
Red Hat Engineering
(860)-967-7285 <(860)%20967-7285>
irc: jomitsch

On Tue, Dec 20, 2016 at 10:30 AM, ‘Jason B. Nance’ via Foreman users < > foreman-users@googlegroups.com> wrote:

Now I can get through the --upgrade process - thank you very much Pascal

  • but if I try and pull packages they are still reporting 404.

Bug #17715: Katello Server Attempting To Pull From Wrong Upstream Repository - Katello - Foreman
Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman
Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman

On the client I’m doing/seeing:

$ sudo yum clean all
$ sudo rm -rf /var/cache/yum/x86_64/
$ sudo yum upgrade

Transaction Summary

====================
Install 4 Packages (+23 Dependent packages)
Upgrade 303 Packages
Remove 1 Package

Total download size: 233 M
Is this ok [y/d/N]: y
Downloading packages:
No Presto metadata available for Centric_Group_fedora_people-ka
tello_fedora_people-katello-client3_2-el7
No Presto metadata available for Centric_Group_centos_c7
Centric_Group_centos_c7updates/prestodelta | 37 kB
00:00
Delta RPMs reduced 6.6 M of updates to 2.5 M (62% saved)
(1/330): chrony-2.1.1-1.el7.centos_2.1.1-4.el7.centos.x86_ | 138 kB
00:00
expat-2.1.0-8.el7_2.1.0-10.el7 FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp
-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-
2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm: [Errno 14] HTTPS Error 404 - Not
Found
Trying other mirror.
To address this issue please refer to the below knowledge base article

[Errno 14] yum fails with HTTP/HTTPS Error 404 - Red Hat Customer Portal

If above article doesn’t help to resolve this issue please create a bug
on https://bugs.centos.org/

(2/330): glibc-2.17-106.el7_2.8_2.17-157.el7_3.1.x86_64.dr | 907 kB
00:00
(3/330): libgcrypt-1.5.3-12.el7_1.1_1.5.3-13.el7_3.1.x86_6 | 29 kB
00:00
(4/330): nss-tools-3.21.0-9.el7_2_3.21.3-2.el7_3.x86_64.dr | 303 kB
00:00
(5/330): nss-util-3.21.0-2.2.el7_2_3.21.3-1.1.el7_3.x86_64 | 20 kB
00:00
(6/330): policycoreutils-2.2.5-20.el7_2.5-9.el7.x86_64.drp | 433 kB
00:00
(7/330): policycoreutils-python-2.2.5-20.el7_2.5-9.el7.x86 | 259 kB
00:00
(8/330): tuned-2.5.1-4.el7_2.6_2.7.1-3.el7_3.1.noarch.drpm | 102 kB
00:00
(9/330): tzdata-2016h-1.el7_2016j-1.el7.noarch.drpm | 298 kB
00:00
NetworkManager-1.4.0-13.el7_3. FAILED
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp
-nonproduction/c7stable/custom/centos/c7updates/NetworkManag
er-1.4.0-13.el7_3.x86_64.rpm: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.

<snip remaining packages that all 404 as well>

On the Katello server I see:

…from journalctl -f:

Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (315): mirror.centos.org
Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: [-]
127.0.0.1 - - [20/Dec/2016:15:15:58 +0000] “GET
/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089
b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm
HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (316): mirror.centos.org
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: [-]
127.0.0.1 - - [20/Dec/2016:15:16:00 +0000] “GET
/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad550880
2a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm
HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]:
requests.packages.urllib3.connectionpool:INFO: Starting new HTTP
connection (317): mirror.centos.org

…from /var/log/httpd/foreman-ssl_access_ssl.log:

172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59
-0600] “GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/
centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm
HTTP/1.1” 302 - “-” “urlgrabber/3.10 yum/3.4.3”
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59
-0600] “GET /streamer/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa
576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-
2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm?policy=eyJleHRlbnN
pb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc29
1cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9
kcnBtL2IzLzBkNzE3MGE0ZDk1ZThhYTU3NjIyMzA4OWI5MmYwODE4MmY3Y2N
iMWRkNzY5MDk2YWFiNDliMDA5MWZhMDUxL2RycG1zL2V4cGF0LTIuMS4wLTg
uZWw3XzIuMS4wLTEwLmVsN18zLng4Nl82NC5kcnBtIiwgImV4cGlyYXRpb24
iOiAxNDgyMjQ3MDQ5fQ%3D%3D;signature=A-lpzb8dYbdRtYSonH1R
uH2D3BucYAdiJpYFvAERtHT04_pzN9x5ARj9rtGDrgTbiqTxhen8D_NL14wS
oRT08PZ4VH1uOWGWkfel-WFEZQm_R3drPX23pCDW6MQ42zI2o7S65X5GiZws
ZnAbalS_g_ToOQQvGj7pfOYhf6M-JcKiEfb89WRPA1aaXH8DvnAyd82PSPv
BvQnE5-KJ-Ps4wLhS3gCei3Yoni6ntNiCqWuo1hFdvYxOf4mVRQQOh2B18Vx
GnN0AC9c1LR6zUSDXq4VWVjX59kItbapeh8aQlnxwtHrM3ksT38POYdSdkfmzz4X0OYSvHQ8Gkz9u76B-A%3D%3D
HTTP/1.1" 404 - “-” “urlgrabber/3.10 yum/3.4.3”
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:16:00
-0600] "GET /streamer/var/lib/pulp/content/units/rpm/b6/c339b4992d674e00
1ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/
NetworkManager-1.4.0-13.el7_3.x86_64.rpm?policy=eyJleHRlbnNp
b25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291
cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9y
cG0vYjYvYzMzOWI0OTkyZDY3NGUwMDFhZDU1MDg4MDJhMmZiYzNkN2NiNDZh
Zjk5MmM4MzY2ZjZmOTI1MTIyN2QzYjQvTmV0d29ya01hbmFnZXItMS40LjAt
MTMuZWw3XzMueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4MjI0NzA1
MH0%3D;signature=CehLSHyVEGDJu-6r0SMoHEKJxksW0BqZqdnSDHfqzQom33-
apNDJhn2X965O1wJjk0okw8gv-ITUSM3CoLHrgt2Cg6LRAC5kZ1tSwiNurFJ
FLjIa2SVtiiUXt13XxBFN_AACAd8i_0uVs29AeMuLiKWkdFAzGcWqWmQS1ix
Q4uACGHfy7-DHdbbrupBhWDCzPyURu6wChpDSqhcymRMWsb1JNLIgBo1_qu4
79zby1hr9Sv2LOpN37sdm4WOq_vkWfu6Tkq7IyDTnxF5hMOn8DiEg1UvfEMO
CzDqFQYjGvc1LIJvPaWR1ZBnLz2pT5pTHNPUyIZud0gjpzrRikKytg%3D%3D HTTP/1.1”
404 - “-” “urlgrabber/3.10 yum/3.4.3”

…from /var/log/squid/access.log:

1482246959.418 223 127.0.0.1 TCP_MISS/404 385 GET
http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/0d7
170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/
drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm - FIRSTUP_PARENT/
127.0.0.1 text/html
1482246961.086 92 127.0.0.1 TCP_MISS/404 385 GET
http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/c339
b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/
NetworkManager-1.4.0-13.el7_3.x86_64.rpm - FIRSTUP_PARENT/127.0.0.1
text/html

…from /var/log/squid/store.log:

1482246959.418 RELEASE -1 FFFFFFFF 50995C9E832B61A47EC237BB0AEBD4E7
? ? ? ? ?/? ?/? ? ?
1482246961.086 RELEASE -1 FFFFFFFF F26384D752D959E8933E933A500182FB
? ? ? ? ?/? ?/? ? ?

From the Katello host I’m able to “wget” the packages from
mirror.centos.org.

*From: *“Peter Kirby” peter.kirby@objectstream.com
*To: *foreman-users@googlegroups.com
*Sent: *Tuesday, December 20, 2016 8:59:52 AM
*Subject: *Re: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

On Tue, Dec 20, 2016 at 8:55 AM, ‘Jason B. Nance’ via Foreman users < >> foreman-users@googlegroups.com> wrote:

Pascalp,

Were you using the Puppet 3 or Puppet 4 repo on your server?

Thanks,

j

Jason,

FWIW - I got this error with Puppet 3 and also again with Puppet 4
repos. When I have time I’ll try the solution posted by Pascalp and report
back on the results.

Thanks,
Peter

*From: *“pascalp” supremerulerxenu@gmail.com
*To: *“Foreman users” foreman-users@googlegroups.com
*Sent: *Tuesday, December 20, 2016 8:50:45 AM
*Subject: *[foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed
in your issue at Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman Hope it
works for you.

On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote:

Hi
When I was running upgrade I had an error:

Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman

So I did as it is mentioned in thiissue:

“:run_always => true” seems to be a remnant of the previous
30-upgrade.rb where every upgrade_step had a “:run_always” or
“:long_running” option passed. With the 3.2.1 30-upgrade.rb
“:migrate_candlepin” is the only upgrade_step with an option and since the
function only takes one argument this results in the error seen.

Deleting “, :run_always => true” lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/ lib/runcible/resources/event_notifier.rb:48:in list’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1 /db/seeds.d/108-ensure_sync_notification.rb:9:in <top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:268:in block in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:268:in load’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:in each’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:268:in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4. 2.5.1/lib/active_support/dependencies.rb:240:in load_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport-4.
2.5.1/lib/active_support/dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:in load_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4.
2.5.1/lib/active_record/tasks/database_tasks.rb:250:in load_seed' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord-4. 2.5.1/lib/active_record/railties/databases.rake:183:in block (2
levels) in <top (required)>’
Tasks: TOP => db:seed
(See full trace by running task with --trace)
Seeding /usr/share/foreman/db/seeds.d/03-auth_sources.rb
Seeding /usr/share/foreman/db/seeds.d/03-permissions.rb
Seeding /usr/share/foreman/db/seeds.d/03-roles.rb
Seeding /usr/share/foreman/db/seeds.d/04-admin.rb
Seeding /usr/share/foreman/db/seeds.d/05-taxonomies.rb
Seeding /usr/share/foreman/db/seeds.d/06-architectures.rb
Seeding /usr/share/foreman/db/seeds.d/07-provisioning_templates.rb
Seeding /usr/share/foreman/db/seeds.d/08-partition_tables.rb
Seeding /usr/share/foreman/db/seeds.d/10-installation_media.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/101-locations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/102-organizations.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/103-provisioning_templates.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/104-proxy.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/106-mail_notifications.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/107-enable_dynflow.rb
Seeding /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1
/db/seeds.d/108-ensure_sync_notification.rb

[ERROR 2016-12-17 15:22:47 main] Upgrade step db_seed failed. Check
logs for more information.
[DEBUG 2016-12-17 15:22:47 main] Exit with status code: 1 (signal was 1)
[ERROR 2016-12-17 15:22:47 main] Errors encountered during run:
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:in block in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:493:in process_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:413:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8 .0/lib/restclient/request.rb:41:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8
.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in
`call’
/opt/theforeman/tfm/r

11

Thanks for these commits, John.

It looks like there is one more thing missing to complete this pulp.conf issue. Here's what I'm seeing (with these applied):

Start upgrade (foreman-installer --scenario=katello --upgrade)
/etc/httpd/conf.d/pulp.conf is deleted
"Upgrade Step: start_httpd…" runs (without pulp.conf)
"Upgrade Step: Running installer…" runs and creates pulp.conf (with the WSGI configs), then fails with "Failed to call refresh: /usr/sbin/foreman-rake db:seed returned 1 instead of one of [0]".

If I watch /etc/httpd/conf.d for pulp.conf to reappear and manually restart httpd while the upgrade process is running it succeeds. It appears that whatever is creating pulp.conf isn't restarting httpd.

j

··· From: "John Mitsch" To: foreman-users@googlegroups.com Sent: Tuesday, December 20, 2016 9:52:00 AM Subject: Re: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

two commits that may be helpful in patching 3.2.1 are:
[ https://github.com/Katello/katello-installer/pull/456/commits/5624de07a7778246c4a8d7d81f8ba2586a172332 | https://github.com/Katello/katello-installer/pull/456/commits/5624de07a7778246c4a8d7d81f8ba2586a172332 ]
and
[ https://github.com/Katello/katello-installer/pull/456/commits/1198c19194b6d01c3519452060b7de727deba229 | https://github.com/Katello/katello-installer/pull/456/commits/1198c19194b6d01c3519452060b7de727deba229 ]

John Mitsch
Red Hat Engineering
(860)-967-7285
irc: jomitsch

On Tue, Dec 20, 2016 at 10:50 AM, John Mitsch < [ mailto:jomitsch@redhat.com | jomitsch@redhat.com ] > wrote:

All,
Thanks for the dutiful reporting and the workarounds.

We are working on getting 3.2.2 out with patches to these issues, I’ll post when that is available.

-John

John Mitsch
Red Hat Engineering
[ tel:(860)%20967-7285 | (860)-967-7285 ]
irc: jomitsch

On Tue, Dec 20, 2016 at 10:30 AM, ‘Jason B. Nance’ via Foreman users < [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ] > wrote:

BQ_BEGIN

Now I can get through the --upgrade process - thank you very much Pascal - but if I try and pull packages they are still reporting 404.

[ Bug #17715: Katello Server Attempting To Pull From Wrong Upstream Repository - Katello - Foreman | Bug #17715: Katello Server Attempting To Pull From Wrong Upstream Repository - Katello - Foreman ]
[ Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman | Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman ]
[ Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman | Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman ]

On the client I’m doing/seeing:

$ sudo yum clean all
$ sudo rm -rf /var/cache/yum/x86_64/
$ sudo yum upgrade

Transaction Summary

Install 4 Packages (+23 Dependent packages)
Upgrade 303 Packages
Remove 1 Package

Total download size: 233 M
Is this ok [y/d/N]: y
Downloading packages:
No Presto metadata available for Centric_Group_fedora_people-katello_fedora_people-katello-client3_2-el7
No Presto metadata available for Centric_Group_centos_c7
Centric_Group_centos_c7updates/prestodelta | 37 kB 00:00
Delta RPMs reduced 6.6 M of updates to 2.5 M (62% saved)
(1/330): chrony-2.1.1-1.el7.centos_2.1.1-4.el7.centos.x86_ | 138 kB 00:00
expat-2.1.0-8.el7_2.1.0-10.el7 FAILED
[ https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm | https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm ] : [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.
To address this issue please refer to the below knowledge base article

[ https://access.redhat.com/articles/1320623 | https://access.redhat.com/articles/1320623 ]

If above article doesn’t help to resolve this issue please create a bug on [ https://bugs.centos.org/ | https://bugs.centos.org/ ]

(2/330): glibc-2.17-106.el7_2.8_2.17-157.el7_3.1.x86_64.dr | 907 kB 00:00
(3/330): libgcrypt-1.5.3-12.el7_1.1_1.5.3-13.el7_3.1.x86_6 | 29 kB 00:00
(4/330): nss-tools-3.21.0-9.el7_2_3.21.3-2.el7_3.x86_64.dr | 303 kB 00:00
(5/330): nss-util-3.21.0-2.2.el7_2_3.21.3-1.1.el7_3.x86_64 | 20 kB 00:00
(6/330): policycoreutils-2.2.5-20.el7_2.5-9.el7.x86_64.drp | 433 kB 00:00
(7/330): policycoreutils-python-2.2.5-20.el7_2.5-9.el7.x86 | 259 kB 00:00
(8/330): tuned-2.5.1-4.el7_2.6_2.7.1-3.el7_3.1.noarch.drpm | 102 kB 00:00
(9/330): tzdata-2016h-1.el7_2016j-1.el7.noarch.drpm | 298 kB 00:00
NetworkManager-1.4.0-13.el7_3. FAILED
[ https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/NetworkManager-1.4.0-13.el7_3.x86_64.rpm | https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/NetworkManager-1.4.0-13.el7_3.x86_64.rpm ] : [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.

<snip remaining packages that all 404 as well>

On the Katello server I see:

…from journalctl -f:

Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (315): [ http://mirror.centos.org/ | mirror.centos.org ]
Dec 20 09:15:59 katello.ipa.centric.lab pulp_streamer[15150]: [-] 127.0.0.1 - - [20/Dec/2016:15:15:58 +0000] “GET /var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm HTTP/1.1” 404 - “-” "urlgrabber/3.10 yum/3.4.3"
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (316): [ http://mirror.centos.org/ | mirror.centos.org ]
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: [-] 127.0.0.1 - - [20/Dec/2016:15:16:00 +0000] “GET /var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm HTTP/1.1” 404 - “-” "urlgrabber/3.10 yum/3.4.3"
Dec 20 09:16:01 katello.ipa.centric.lab pulp_streamer[15150]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (317): [ http://mirror.centos.org/ | mirror.centos.org ]

…from /var/log/httpd/foreman-ssl_access_ssl.log:

172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59 -0600] “GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm HTTP/1.1” 302 - “-” "urlgrabber/3.10 yum/3.4.3"
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:15:59 -0600] “GET /streamer/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9kcnBtL2IzLzBkNzE3MGE0ZDk1ZThhYTU3NjIyMzA4OWI5MmYwODE4MmY3Y2NiMWRkNzY5MDk2YWFiNDliMDA5MWZhMDUxL2RycG1zL2V4cGF0LTIuMS4wLTguZWw3XzIuMS4wLTEwLmVsN18zLng4Nl82NC5kcnBtIiwgImV4cGlyYXRpb24iOiAxNDgyMjQ3MDQ5fQ%3D%3D;signature=A-lpzb8dYbdRtYSonH1RuH2D3BucYAdiJpYFvAERtHT04_pzN9x5ARj9rtGDrgTbiqTxhen8D_NL14wSoRT08PZ4VH1uOWGWkfel-WFEZQm_R3drPX23pCDW6MQ42zI2o7S65X5GiZws_ZnAbalS_g_ToOQQvGj7pfOYhf6M-JcKiEfb89WRPA1aaXH8DvnAyd82PSPvBvQnE5-KJ-Ps4wLhS3gCei3Yoni6ntNiCqWuo1hFdvYxOf4mVRQQOh2B18VxGnN0AC9c1LR6zUSDXq4VWVjX59kItbapeh8aQlnxwtHrM3ksT38POYdSdkfmzz4X0OYSvHQ8Gkz9u76B-A%3D%3D HTTP/1.1” 404 - “-” "urlgrabber/3.10 yum/3.4.3"
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [20/Dec/2016:09:16:00 -0600] “GET /streamer/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vYjYvYzMzOWI0OTkyZDY3NGUwMDFhZDU1MDg4MDJhMmZiYzNkN2NiNDZhZjk5MmM4MzY2ZjZmOTI1MTIyN2QzYjQvTmV0d29ya01hbmFnZXItMS40LjAtMTMuZWw3XzMueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4MjI0NzA1MH0%3D;signature=CehLSHyVEGDJu-6r0SMoHEKJxksW0BqZqdnSDHfqzQom33_-apNDJhn2X965O1wJjk0okw8gv-ITUSM3CoLHrgt2Cg6LRAC5kZ1tSwiNurFJFLjIa2SVtiiUXt13XxBFN_AACAd8i_0uVs29AeMuLiKWkdFAzGcWqWmQS1ixQ4uACGHfy7-DHdbbrupBhWDCzPyURu6wChpDSqhcymRMWsb1JNLIgBo1_qu479zby1hr9Sv2LOpN37sdm4WOq_vkWfu6Tkq7IyDTnxF5hMOn8DiEg1UvfEMOCzDqFQYjGvc1LIJvPaWR1ZBnLz2pT5pTHNPUyIZud0gjpzrRikKytg%3D%3D HTTP/1.1” 404 - “-” “urlgrabber/3.10 yum/3.4.3”

…from /var/log/squid/access.log:

1482246959.418 223 127.0.0.1 TCP_MISS/404 385 GET [ http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm | http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm ] - FIRSTUP_PARENT/ [ http://127.0.0.1/ | 127.0.0.1 ] text/html
1482246961.086 92 127.0.0.1 TCP_MISS/404 385 GET [ http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm | http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm ] - FIRSTUP_PARENT/ [ http://127.0.0.1/ | 127.0.0.1 ] text/html

…from /var/log/squid/store.log:

1482246959.418 RELEASE -1 FFFFFFFF 50995C9E832B61A47EC237BB0AEBD4E7 ? ? ? ? ?/? ?/? ? ?
1482246961.086 RELEASE -1 FFFFFFFF F26384D752D959E8933E933A500182FB ? ? ? ? ?/? ?/? ? ?

From the Katello host I’m able to “wget” the packages from [ http://mirror.centos.org/ | mirror.centos.org ] .

From: “Peter Kirby” < [ mailto:peter.kirby@objectstream.com | peter.kirby@objectstream.com ] >
To: [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ]
Sent: Tuesday, December 20, 2016 8:59:52 AM
Subject: Re: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

On Tue, Dec 20, 2016 at 8:55 AM, ‘Jason B. Nance’ via Foreman users < [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ] > wrote:

BQ_BEGIN

Pascalp,

Were you using the Puppet 3 or Puppet 4 repo on your server?

Thanks,

j

Jason,

FWIW - I got this error with Puppet 3 and also again with Puppet 4 repos. When I have time I’ll try the solution posted by Pascalp and report back on the results.

Thanks,
Peter

BQ_BEGIN

From: “pascalp” < [ mailto:supremerulerxenu@gmail.com | supremerulerxenu@gmail.com ] >
To: “Foreman users” < [ mailto:foreman-users@googlegroups.com | foreman-users@googlegroups.com ] >
Sent: Tuesday, December 20, 2016 8:50:45 AM
Subject: [foreman-users] Re: Katello 3.1 to 3.2.1 upgrade

I found a solution that worked for me (3.2.0 to 3.2.1). Steps are listed in your issue at [ Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman | Bug #17722: Katello 3.1 upgrade to 3.2.1 - Katello - Foreman ] Hope it works for you.

On Sunday, December 18, 2016 at 12:15:14 PM UTC+1, Martin Õunap wrote:
BQ_BEGIN

Hi
When I was running upgrade I had an error:

[ Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman | Bug #17703: "Wrong Number of Arguments" Upgrading From 3.2 to 3.2.1 - Katello - Foreman ]

So I did as it is mentioned in thiissue:

“:run_always => true” seems to be a remnant of the previous 30-upgrade.rb where every upgrade_step had a “:run_always” or “:long_running” option passed. With the 3.2.1 30-upgrade.rb “:migrate_candlepin” is the only upgrade_step with an option and since the function only takes one argument this results in the error seen.

Deleting “, :run_always => true” lets the upgrade continue.

But after that I have an error:

[ INFO 2016-12-17 15:22:32 main] Upgrade Step: db_seed…
[ERROR 2016-12-17 15:22:47 main] rake aborted!
RestClient::ResourceNotFound: 404 Resource Not Found
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/abstract_response.rb:74:in return!' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:79:inblock in get_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:493:inprocess_result’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:421:in block in transmit' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:intransmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:inexecute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:78:inget_response’
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/base.rb:66:in call' /opt/theforeman/tfm/root/usr/share/gems/gems/runcible-1.9.0/lib/runcible/resources/event_notifier.rb:48:inlist’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/app/models/katello/glue/pulp/repo.rb:32:in ensure_sync_notification' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.2.1.1/db/seeds.d/108-ensure_sync_notification.rb:9:in<top (required)>’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:inblock in load’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:240:in load_dependency' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:inload’
/usr/share/foreman/db/seeds.rb:81:in block in <top (required)>' /usr/share/foreman/db/seeds.rb:79:ineach’
/usr/share/foreman/db/seeds.rb:79:in <top (required)>' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:inload’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:in block in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:240:inload_dependency’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activesupport- [ http://4.2.5.1/lib/active_support/ | 4.2.5.1/lib/active_support/ ] dependencies.rb:268:in load' /opt/rh/sclo-ror42/root/usr/share/gems/gems/railties-4.2.5.1/lib/rails/engine.rb:547:inload_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- [ http://4.2.5.1/lib/active_record/ | 4.2.5.1/lib/active_record/ ] tasks/database_tasks.rb:250:in `load_seed’
/opt/rh/sclo-ror42/root/usr/share/gems/gems/activerecord- [ http://4.2.5.1/lib/active_record/ | 4.2.5.1/lib/active_record/ ] railties/databases.rake:183:in