Upgrade Katello 3.5 -> 3.12 Upgrade step remove_legacy_mongo failed

Stevedd · September 11, 2019, 6:14pm

Problem:
the installer exits with an error, and the foreman services are not running
katello-service status
…
Some services are not running (rh-mongodb34-mongod, qdrouterd, qpidd, squid, pulp_celerybeat, pulp_resource_manager, pulp_streamer, pulp_workers, tomcat, dynflowd, httpd, puppetserver, foreman-proxy)


foreman-installer --scenario katello --upgrade
...
[DEBUG 2019-09-11T10:56:25 main] *******************************************************************************
[DEBUG 2019-09-11T10:56:25 main] Migration to pulp_rpm.plugins.migrations version 46 complete in 41.110 seconds.
[DEBUG 2019-09-11T10:56:25 main] Applying pulp_rpm.plugins.migrations version 47
[DEBUG 2019-09-11T10:56:25 main] *******************************************************************************
[DEBUG 2019-09-11T10:56:25 main] Migration to pulp_rpm.plugins.migrations version 47 complete in 0.002 seconds.
[DEBUG 2019-09-11T10:56:25 main] Database migrations complete.
[DEBUG 2019-09-11T10:56:26 main] su - apache -s /bin/bash -c pulp-manage-db finished successfully!
[ INFO 2019-09-11T10:56:26 main] Upgrade Step: migrate_candlepin...
[DEBUG 2019-09-11T10:56:28 main] Configuring PostgreSQL with JDBC URL: jdbc:postgresql://localhost/candlepin
[DEBUG 2019-09-11T10:56:28 main] Migrating Candlepin database
[DEBUG 2019-09-11T10:56:28 main] --driver=org.postgresql.Driver --classpath=/var/lib/tomcat/webapps/candlepin/WEB-INF/lib/postgresql-42.2.2.jar:/var/lib/tomcat/webapps/candlepin/WEB-INF/classes/ --changeLogFile=db/changelog/changelog-update.xml --url=jdbc:postgresql://localhost/candlepin --username=$DBUSERNAME --password=$DBPASSWORD --logLevel=severe
[DEBUG 2019-09-11T10:56:28 main] Liquibase Update Successful
[DEBUG 2019-09-11T10:56:28 main] /usr/share/candlepin/cpdb --update --database '//localhost/candlepin' --user 'candlepin' --password 'redacted' finished successfully!
[ INFO 2019-09-11T10:56:28 main] Upgrade Step: migrate_foreman...
[DEBUG 2019-09-11T10:56:49 main] foreman-rake db:migrate finished successfully!
[ INFO 2019-09-11T10:56:49 main] Upgrade Step: mongo_mmapv1_check...
[DEBUG 2019-09-11T10:56:49 main] systemctl stop mongod finished successfully!
[ INFO 2019-09-11T10:56:49 main] Detecting Pulp database and no WiredTiger files, keeping storage engine as MMAPv1
[ INFO 2019-09-11T10:56:49 main] To upgrade to WiredTiger at a later time run foreman-installer with the --upgrade-mongo-storage-engine flag.
[ INFO 2019-09-11T10:56:49 main] Upgrade Step: remove_legacy_mongo...
[ WARN 2019-09-11T10:56:49 main] removing MongoDB 2.x packages, config and log files.
[DEBUG 2019-09-11T10:56:50 main] yum remove -y mongodb-2* mongodb-server-2* > /dev/null 2>&1 finished successfully!
[ERROR 2019-09-11T10:56:50 main] Upgrade step remove_legacy_mongo failed. Check logs for more information.
[DEBUG 2019-09-11T10:56:50 main] Exit with status code: 1 (signal was 1)
[ERROR 2019-09-11T10:56:50 main] Errors encountered during run:
[ERROR 2019-09-11T10:56:50 main] Upgrade step remove_legacy_mongo failed. Check logs for more information.
[DEBUG 2019-09-11T10:56:50 main] Cleaning /tmp/kafo_puppet20190911-23013-1bn0bj4.conf
[DEBUG 2019-09-11T10:56:50 main] Cleaning /tmp/default_values.yaml
[ INFO 2019-09-11T10:56:50 main] Installer finished in 286.261874272 seconds

Looks like newer mongodb is installed:
rpm -qa | grep mongo rh-mongodb34-mongodb-3.4.9-1.el7.x86_64 rh-mongodb34-boost-thread-1.60.0-2.el7.x86_64 rh-mongodb34-libunwind-1.2-3.el7.x86_64 python-pymongo-3.2-2.el7.x86_64 rh-mongodb34-boost-system-1.60.0-2.el7.x86_64 rh-mongodb34-libstemmer-0-5.585svn.el7.x86_64 rh-mongodb34-gperftools-libs-2.5-4.el7.x86_64 rh-mongodb34-3.0-14.el7.x86_64 rh-mongodb34-runtime-3.0-14.el7.x86_64 rh-mongodb34-boost-chrono-1.60.0-2.el7.x86_64 rh-mongodb34-boost-iostreams-1.60.0-2.el7.x86_64 rh-mongodb34-boost-program-options-1.60.0-2.el7.x86_64 rh-mongodb34-mongodb-server-3.4.9-1.el7.x86_64 rh-mongodb34-yaml-cpp-0.5.3-1.el7.x86_64 python-mongoengine-0.10.5-1.el7.noarch python-pymongo-gridfs-3.2-2.el7.x86_64 rh-mongodb34-boost-regex-1.60.0-2.el7.x86_64 rh-mongodb34-mongo-tools-3.4.7-1.el7.x86_64 rh-mongodb34-boost-filesystem-1.60.0-2.el7.x86_64

I have not attempted to start katello services after the installer finished.

Expected outcome:
installer finishes and katello services start

Foreman and Proxy versions:
foreman 1.22 / katello 3.12
Haven’t got to the capsules yet.

Stevedd · September 11, 2019, 6:38pm

From https://bugzilla.redhat.com/show_bug.cgi?id=1640686 I installed rh-mongodb34-syspaths and re-ran the installer.

Having some issues with pulp:

hammer ping
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:27: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:45: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:45: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:48: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:49: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:50: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:51: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:51: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:51: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:52: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:52: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:53: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:53: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:54: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:55: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:55: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:55: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:57: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:57: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:57: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:59: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:60: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:60: warning: constant ::Fixnum is deprecated
candlepin:      
    Status:          ok
    Server Response: Duration: 11ms
candlepin_auth: 
    Status:          ok
    Server Response: Duration: 11ms
pulp:           
    Status:          FAIL
    Server Response:
pulp_auth:      
    Status: FAIL
foreman_tasks:  
    Status:          ok
    Server Response: Duration: 3ms

katello-service status
...
● httpd.service - The Apache HTTP Server
   Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2019-09-11 11:19:08 PDT; 6min ago
     Docs: man:httpd(8)
           man:apachectl(8)
 Main PID: 29895 (httpd)
   Status: "Total requests: 0; Current requests/sec: 0; Current traffic:   0 B/sec"
    Tasks: 245
   CGroup: /system.slice/httpd.service
           ├─29895 /usr/sbin/httpd -DFOREGROUND 
           ├─29916 (wsgi:pulp)     -DFOREGROUND 
           ├─29917 (wsgi:pulp)     -DFOREGROUND 
           ├─29918 (wsgi:pulp)     -DFOREGROUND 
           ├─29919 (wsgi:pulp-cont -DFOREGROUND 
           ├─29920 (wsgi:pulp-cont -DFOREGROUND 
           ├─29921 (wsgi:pulp-cont -DFOREGROUND 
           ├─29922 (wsgi:pulp_forg -DFOREGROUND 
           ├─29923 PassengerWatchdog
           ├─29926 PassengerHelperAgent
           ├─29931 PassengerLoggingAgent
           ├─29941 /usr/sbin/httpd -DFOREGROUND 
           ├─29942 /usr/sbin/httpd -DFOREGROUND 
           ├─29943 /usr/sbin/httpd -DFOREGROUND 
           ├─29944 /usr/sbin/httpd -DFOREGROUND 
           ├─29945 /usr/sbin/httpd -DFOREGROUND 
           ├─29946 /usr/sbin/httpd -DFOREGROUND 
           ├─29947 /usr/sbin/httpd -DFOREGROUND 
           ├─29948 /usr/sbin/httpd -DFOREGROUND 
           ├─30249 /usr/sbin/httpd -DFOREGROUND 
           ├─30275 /usr/sbin/httpd -DFOREGROUND 
           ├─30898 /bin/bash /usr/bin/tfm-ruby /usr/share/passenger/helper-scripts/rack-preloader.rb
           ├─30904 scl enable tfm bash /tmp/tmp.N8Rm2pHuEG
           ├─30905 /bin/bash /var/tmp/sclkHzNMB 
           ├─30934 bash /tmp/tmp.N8Rm2pHuEG
           ├─30935 Passenger AppPreloader: /usr/share/foreman
           ├─31227 Passenger RackApp: /usr/share/foreman
           ├─31245 Passenger RackApp: /usr/share/foreman
           ├─31279 Passenger RackApp: /usr/share/foreman
           ├─31298 Passenger RackApp: /usr/share/foreman
           ├─31615 /usr/sbin/httpd -DFOREGROUND 
           ├─31658 /usr/sbin/httpd -DFOREGROUND 
           ├─31774 /usr/sbin/httpd -DFOREGROUND 
           ├─31778 /usr/sbin/httpd -DFOREGROUND 
           ├─31779 /usr/sbin/httpd -DFOREGROUND 
           ├─31922 Passenger RackApp: /usr/share/foreman
           └─31941 Passenger RackApp: /usr/share/foreman

Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608)   The database has not been migrated to the current
 version. Run pulp-manage-db and restart the application.
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608) Traceback (most recent call last):
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608)   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 111, in wsgi_application
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608)     _initialize_web_services()
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608)   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 74, in _initialize_web_services
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608)     migration_models.check_package_versions()
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608)   File "/usr/lib/python2.7/site-packages/pulp/server/db/migrate/models.py", line 314, in check_package_versions
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608)     raise Exception(error_message)
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:ERROR: (29916-36608) InitializationException: The database has not been migrated to the current version. Run pulp-manage-db and restart the application.
Sep 11 11:24:22 foreman001.domain.zone pulp[29916]: pulp.server.webservices.application:CRITICAL: *************************************************************


# sudo -u apache pulp-manage-db
Attempting to connect to localhost:27017
Attempting to connect to localhost:27017
Write concern for Mongo connection: {}

The following processes might still be running:
        scheduler@foreman001.domain.zone
        reserved_resource_worker-0@foreman001.domain.zone
        resource_manager@foreman001.domain.zone
Please wait 66 seconds while Pulp confirms this.^[[A^[[A^[[A^[[A^[[A^[[A^[[A^[[A^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[[B^[Please wait 1 seconds while Pulp confirms this.  

The following processes are still running, please stop the running workers before retrying the pulp-manage-db command.
        scheduler@foreman001.domain.zone
        reserved_resource_worker-0@foreman001.domain.zone
        resource_manager@foreman001.domain.zone

systemctl stop pulp_resource_manager pulp_worker pulp_scheduler pulp_celerybeat

sudo -u apache pulp-manage-db

Attempting to connect to localhost:27017
Attempting to connect to localhost:27017
Write concern for Mongo connection: {}
Loading content types.
Loading type descriptors [deb.json]
Parsing type descriptors
Validating type descriptor syntactic integrity
Validating type descriptor semantic integrity
Loading unit model: deb_release = pulp_deb.plugins.db.models:DebRelease
Loading unit model: deb = pulp_deb.plugins.db.models:DebPackage
Loading unit model: deb_component = pulp_deb.plugins.db.models:DebComponent
Loading unit model: puppet_module = pulp_puppet.plugins.db.models:Module
Loading unit model: docker_manifest = pulp_docker.plugins.models:Manifest
Loading unit model: docker_blob = pulp_docker.plugins.models:Blob
Loading unit model: docker_manifest_list = pulp_docker.plugins.models:ManifestList
Loading unit model: docker_image = pulp_docker.plugins.models:Image
Loading unit model: docker_tag = pulp_docker.plugins.models:Tag
Loading unit model: modulemd_defaults = pulp_rpm.plugins.db.models:ModulemdDefaults
Loading unit model: erratum = pulp_rpm.plugins.db.models:Errata
Loading unit model: distribution = pulp_rpm.plugins.db.models:Distribution
Loading unit model: srpm = pulp_rpm.plugins.db.models:SRPM
Loading unit model: package_group = pulp_rpm.plugins.db.models:PackageGroup
Loading unit model: package_category = pulp_rpm.plugins.db.models:PackageCategory
Loading unit model: iso = pulp_rpm.plugins.db.models:ISO
Loading unit model: package_environment = pulp_rpm.plugins.db.models:PackageEnvironment
Loading unit model: drpm = pulp_rpm.plugins.db.models:DRPM
Loading unit model: package_langpacks = pulp_rpm.plugins.db.models:PackageLangpacks
Loading unit model: modulemd = pulp_rpm.plugins.db.models:Modulemd
Loading unit model: rpm = pulp_rpm.plugins.db.models:RPM
Loading unit model: yum_repo_metadata_file = pulp_rpm.plugins.db.models:YumMetadataFile
Loading auxiliary model: erratum_pkglists = pulp_rpm.plugins.db.models:ErratumPkglist
Updating the database with types [deb, deb_component, deb_release]
Found the following type definitions that were not present in the update collection [puppet_module, drpm, modulemd_defaults, package_langpacks, erratum, docker_blob, docker_manifest, yum_repo_metadata_file, package_group, package_category, iso, package_environment, docker_tag, srpm, modulemd, rpm, distribution, docker_image, docker_manifest_list]
Updating the database with types [puppet_module, deb, docker_tag, package_environment, rpm, docker_image, deb_component, package_category, package_langpacks, modulemd_defaults, docker_blob, distribution, deb_release, package_group, drpm, yum_repo_metadata_file, docker_manifest_list, docker_manifest, erratum, modulemd, iso, srpm]
Content types loaded.
Ensuring the admin role and user are in place.
Admin role and user are in place.
Beginning database migrations.
Loading unit model: deb_release = pulp_deb.plugins.db.models:DebRelease
Loading unit model: deb = pulp_deb.plugins.db.models:DebPackage
Loading unit model: deb_component = pulp_deb.plugins.db.models:DebComponent
Loading unit model: puppet_module = pulp_puppet.plugins.db.models:Module
Loading unit model: docker_manifest = pulp_docker.plugins.models:Manifest
Loading unit model: docker_blob = pulp_docker.plugins.models:Blob
Loading unit model: docker_manifest_list = pulp_docker.plugins.models:ManifestList
Loading unit model: docker_image = pulp_docker.plugins.models:Image
Loading unit model: docker_tag = pulp_docker.plugins.models:Tag
Loading unit model: modulemd_defaults = pulp_rpm.plugins.db.models:ModulemdDefaults
Loading unit model: erratum = pulp_rpm.plugins.db.models:Errata
Loading unit model: distribution = pulp_rpm.plugins.db.models:Distribution
Loading unit model: srpm = pulp_rpm.plugins.db.models:SRPM
Loading unit model: package_group = pulp_rpm.plugins.db.models:PackageGroup
Loading unit model: package_category = pulp_rpm.plugins.db.models:PackageCategory
Loading unit model: iso = pulp_rpm.plugins.db.models:ISO
Loading unit model: package_environment = pulp_rpm.plugins.db.models:PackageEnvironment
Loading unit model: drpm = pulp_rpm.plugins.db.models:DRPM
Loading unit model: package_langpacks = pulp_rpm.plugins.db.models:PackageLangpacks
Loading unit model: modulemd = pulp_rpm.plugins.db.models:Modulemd
Loading unit model: rpm = pulp_rpm.plugins.db.models:RPM
Loading unit model: yum_repo_metadata_file = pulp_rpm.plugins.db.models:YumMetadataFile
Loading auxiliary model: erratum_pkglists = pulp_rpm.plugins.db.models:ErratumPkglist
Migration package pulp.server.db.migrations is up to date at version 29
Applying pulp_deb.plugins.migrations version 1
Migration to pulp_deb.plugins.migrations version 1 complete in 0.002 seconds.
Applying pulp_deb.plugins.migrations version 2
*******************************************************************************
Migration to pulp_deb.plugins.migrations version 2 complete in 0.002 seconds.
Applying pulp_deb.plugins.migrations version 3
*******************************************************************************
Migration to pulp_deb.plugins.migrations version 3 complete in 0.002 seconds.
Migration package pulp_docker.plugins.migrations is up to date at version 6
Migration package pulp_puppet.plugins.migrations is up to date at version 5
Migration package pulp_rpm.plugins.migrations is up to date at version 47
Database migrations complete.

katello-services restart


hammer ping
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:27: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:45: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:45: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:48: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:49: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:50: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:51: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:51: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:51: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:52: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:52: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:53: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:53: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:54: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:55: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:55: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:55: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:57: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:57: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:57: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:59: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:60: warning: constant ::Fixnum is deprecated
/opt/theforeman/tfm/root/usr/share/gems/gems/hammer_cli_import-0.11.3/lib/hammer_cli_import/persistentmap.rb:60: warning: constant ::Fixnum is deprecated
candlepin:      
    Status:          ok
    Server Response: Duration: 12ms
candlepin_auth: 
    Status:          ok
    Server Response: Duration: 11ms
pulp:           
    Status:          ok
    Server Response: Duration: 89ms
pulp_auth:      
    Status:          ok
    Server Response: Duration: 12ms
foreman_tasks:  
    Status:          ok
    Server Response: Duration: 2ms

John_Mitsch · September 12, 2019, 12:28am

Hey @Stevedd, thanks for writing in, if you are going from 3.5 to 3.12 directly (not sure if that is the case but guessing from the title) , that is a really large jump and we recommend upgrading to each version incrementally.

Stevedd · September 13, 2019, 7:09pm

The upgrade process actually worked out pretty well. I’m still stuck on some issues with red hat repositories. All my centos / 3rd party repos are syncing without issue.

For the RH repos hammer shows the following repo ids:
1862 | Red Hat Ansible Engine 2.7 RPMs for Red Hat Enterprise Linux 7 Server x86_64 | Red Hat Ansible Engine | yum | https://cdn.redha
t.com/content/dist/rhel/server/7/7Server/x86_64/ansible/2.7/os
1870 | Red Hat Enterprise Linux 7 Server - Extras RPMs x86_64 | Red Hat Enterprise Linux Server | yum | https://cdn.redha
t.com/content/dist/rhel/server/7/7Server/x86_64/extras/os
1867 | Red Hat Enterprise Linux 7 Server Kickstart x86_64 7.6 | Red Hat Enterprise Linux Server | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7.6/x86_64/kickstart
1869 | Red Hat Enterprise Linux 7 Server - Optional RPMs x86_64 7Server | Red Hat Enterprise Linux Server | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/optional/os
1871 | Red Hat Enterprise Linux 7 Server - RH Common RPMs x86_64 7Server | Red Hat Enterprise Linux Server | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/rh-common/os
1922 | Red Hat Enterprise Linux 7 Server RPMs x86_64 7Server | Red Hat Enterprise Linux Server | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/os
1872 | Red Hat Enterprise Linux 7 Server - Supplementary RPMs x86_64 7Server | Red Hat Enterprise Linux Server | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/supplementar…
1873 | Red Hat Satellite Tools 6.3 for RHEL 7 Server RPMs x86_64 | Red Hat Enterprise Linux Server | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/sat-tools/6…
1866 | Red Hat Virtualization 4 Management Agents for RHEL 7 RPMs x86_64 7Server | Red Hat Virtualization | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/rhv-mgmt-age…
1864 | Red Hat Virtualization Host 7 RPMs x86_64 | Red Hat Virtualization Host | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/rhvh/4/os
1865 | Red Hat Virtualization Manager v4.2 RHEL 7 Server RPMs x86_64 | Red Hat Virtualization Manager | yum | https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/rhv-manager/…

The web ui under red hat subscriptions appears to be using entirely different id’s. I’ve attempted to remove a red hat repository ‘Red Hat Virtualization 4 Management Agents for RHEL 7 RPMs x86_64 7Server’ and the error I get is ‘Couldn’t find repository set with id ‘5132’.’

I can’t delete red hat repos with hammer:
hammer repository delete --id 1866
Could not delete the Repository:
Red Hat repositories cannot be manipulated.

and seeing as I can’t remove through the web ui I’m a bit stuck.

Whats the best method for purging all red hat repos both on disk and in the web ui?

I executed foreman-rake katello:delete_orphaned_content RAILS_ENV=production >/dev/null and although the postgres process was active for quite some time it doesn’t seem to have cleaned up any packages.

Stevedd · September 13, 2019, 7:30pm

Actually this may be resolved now.

I removed the RH manifest previously which left me with (orphaned) listings in RH repositories section. I just readded my manifest and it looks like the id’s between foreman web ui and hammer cli now match as I can remove any RH repo I’d like from the web ui now.