RPM1008: Checksum type "sha256" is not available for all units in the repository

Support
23

@kraba Thanks for the info, this may be an actual bug on an incremental update. Pulp changed the way they handle checksum types and we accounted for this in katello with the upgrade task, but its possible we missed cases dealing with an incremental update.

I’m trying to reproduce myself and will get back to you on any related issues or fixes.

For now, if you want to work around this, you can set the download policies of the repos that are giving you trouble to ‘immediate’ and resyncing.

Hope this helps!

24

Thanks a lot John, if you need logs/test/something feel free to ask that!

25

@kraba what repository(ies) were triggering the incremental update?

26

Our repositories are the follows:

---|-----------------------------------------------------------------------------|
ID | NAME                                                           REPOSITORIES |
---|-----------------------------------------------------------------------------|
9  | Red Hat Developer Toolset (for RHEL Server)                    2            |
6  | Red Hat Developer Tools (for RHEL Server)                      1            |
2  | Red Hat Enterprise Linux Server                                7            |
11 | Red Hat Enterprise Linux Server - Extended Life Cycle Support  1            |
10 | Red Hat Software Collections (for RHEL Server)                 2            |
---|-----------------------------------------------------------------------------|

and they are configured as the follow:

SHA1
=> #<Katello::Repository id: 1142, name: "Red Hat Enterprise Linux 7 Server RPMs x86_64 7Ser...", pulp_id: "d8946303-7782-4197-a43d-7e60be8a11a6", created_at: "2018-10-16 15:29:44", updated_at: "2018-11-28 13:21:55", major: 7, minor: "7Server", gpg_key_id: nil, cp_label: "rhel-7-server-rpms", library_instance_id: nil, content_id: "2456", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_7_Server_RPMs_x86_64_7Ser...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/7/7Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/7/...", unprotected: false, content_type: "yum", product_id: 2, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">
=> #<Katello::Repository id: 1154, name: "Red Hat Software Collections RPMs for Red Hat Ente...", pulp_id: "92304746-5061-436a-abb6-67ae17fda5d3", created_at: "2018-10-16 15:41:28", updated_at: "2018-11-28 13:22:03", major: 6, minor: "6Server", gpg_key_id: nil, cp_label: "rhel-server-rhscl-6-rpms", library_instance_id: nil, content_id: "1997", arch: "x86_64", label: "Red_Hat_Software_Collections_RPMs_for_Red_Hat_Ente...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/6/6Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/6/...", unprotected: false, content_type: "yum", product_id: 10, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">
=> #<Katello::Repository id: 1220, name: "Red Hat Software Collections RPMs for Red Hat Ente...", pulp_id: "afe43e60-de92-4047-9314-4b1e2203cb00", created_at: "2018-10-17 11:24:34", updated_at: "2018-11-28 13:22:04", major: 7, minor: "7Server", gpg_key_id: nil, cp_label: "rhel-server-rhscl-7-rpms", library_instance_id: nil, content_id: "2808", arch: "x86_64", label: "Red_Hat_Software_Collections_RPMs_for_Red_Hat_Ente...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/7/7Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/7/...", unprotected: false, content_type: "yum", product_id: 10, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">
=> #<Katello::Repository id: 1146, name: "Red Hat Enterprise Linux 6 Server RPMs x86_64 6Ser...", pulp_id: "4bd34ff5-3f67-44b0-94ac-56c5a921c3b1", created_at: "2018-10-16 15:31:09", updated_at: "2018-11-28 13:21:58", major: 6, minor: "6Server", gpg_key_id: nil, cp_label: "rhel-6-server-rpms", library_instance_id: nil, content_id: "168", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_6_Server_RPMs_x86_64_6Ser...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/6/6Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/6/...", unprotected: false, content_type: "yum", product_id: 2, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">
=> #<Katello::Repository id: 1145, name: "Red Hat Enterprise Linux 7 Server - Extras RPMs x8...", pulp_id: "b669c18e-0c25-43a2-82ee-93cad0db2d14", created_at: "2018-10-16 15:30:32", updated_at: "2018-11-28 13:21:58", major: nil, minor: nil, gpg_key_id: nil, cp_label: "rhel-7-server-extras-rpms", library_instance_id: nil, content_id: "3030", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_7_Server_-_Extras_RPMs_x8...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/7/7Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/7/...", unprotected: false, content_type: "yum", product_id: 2, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">
=> #<Katello::Repository id: 1151, name: "Red Hat Enterprise Linux 6 Server - Extras RPMs x8...", pulp_id: "ea2ab144-f6e8-4f43-8537-a31c7faf724d", created_at: "2018-10-16 15:40:01", updated_at: "2018-11-28 13:22:02", major: nil, minor: nil, gpg_key_id: nil, cp_label: "rhel-6-server-extras-rpms", library_instance_id: nil, content_id: "3026", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_6_Server_-_Extras_RPMs_x8...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/6/6Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/6/...", unprotected: false, content_type: "yum", product_id: 2, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">
=> #<Katello::Repository id: 1153, name: "Red Hat Developer Toolset 2 RPMs for Red Hat Enter...", pulp_id: "41b4c3c0-c519-4c9a-a2ab-2e63484fdb85", created_at: "2018-10-16 15:41:13", updated_at: "2018-11-28 13:22:02", major: 6, minor: "6Server", gpg_key_id: nil, cp_label: "rhel-server-dts2-6-rpms", library_instance_id: nil, content_id: "1979", arch: "x86_64", label: "Red_Hat_Developer_Toolset_2_RPMs_for_Red_Hat_Enter...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/6/6Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/6/...", unprotected: false, content_type: "yum", product_id: 9, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">
=> #<Katello::Repository id: 1152, name: "Red Hat Developer Toolset RPMs for Red Hat Enterpr...", pulp_id: "deee1c9a-d43e-4a75-8897-1e57bd90631f", created_at: "2018-10-16 15:40:52", updated_at: "2018-11-28 13:22:02", major: 6, minor: "6Server", gpg_key_id: nil, cp_label: "rhel-server-dts-6-rpms", library_instance_id: nil, content_id: "1449", arch: "x86_64", label: "Red_Hat_Developer_Toolset_RPMs_for_Red_Hat_Enterpr...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/6/6Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/6/...", unprotected: false, content_type: "yum", product_id: 9, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha1">

SHA256
=> #<Katello::Repository id: 1150, name: "Red Hat Developer Tools RPMs for Red Hat Enterpris...", pulp_id: "143b5b70-43bb-41cf-b7d0-49b0ae5914b6", created_at: "2018-10-16 15:35:30", updated_at: "2018-11-17 13:00:44", major: nil, minor: nil, gpg_key_id: nil, cp_label: "rhel-7-server-devtools-rpms", library_instance_id: nil, content_id: "6054", arch: "x86_64", label: "Red_Hat_Developer_Tools_RPMs_for_Red_Hat_Enterpris...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/7/7Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/7/...", unprotected: false, content_type: "yum", product_id: 6, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha256">
=> #<Katello::Repository id: 1149, name: "Red Hat Enterprise Linux 6 Server - RH Common RPMs...", pulp_id: "1ea42c3f-b364-4fde-8768-26e11939b55a", created_at: "2018-10-16 15:32:11", updated_at: "2018-11-17 12:58:08", major: 6, minor: "6Server", gpg_key_id: nil, cp_label: "rhel-6-server-rh-common-rpms", library_instance_id: nil, content_id: "2396", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_6_Server_-_RH_Common_RPMs...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/6/6Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/6/...", unprotected: false, content_type: "yum", product_id: 2, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha256">
=> #<Katello::Repository id: 1143, name: "Red Hat Enterprise Linux 7 Server - RH Common RPMs...", pulp_id: "6ade5a8b-cb88-40bd-b1b8-1441c92e7a8c", created_at: "2018-10-16 15:30:02", updated_at: "2018-11-19 09:16:40", major: 7, minor: "7Server", gpg_key_id: nil, cp_label: "rhel-7-server-rh-common-rpms", library_instance_id: nil, content_id: "2472", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_7_Server_-_RH_Common_RPMs...", content_view_version_id: 1, relative_path: "our-organization/Library/content/dist/rhel/server/7/7Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/7/...", unprotected: false, content_type: "yum", product_id: 2, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha256">
=> #<Katello::Repository id: 1217, name: "Red Hat Enterprise Linux 6 Server - Extended Life ...", pulp_id: "3fed9433-1140-47a2-a0c4-4782663149b7", created_at: "2018-10-17 11:14:23", updated_at: "2018-11-17 12:57:10", major: nil, minor: nil, gpg_key_id: nil, cp_label: "rhel-6-server-els-optional-rpms", library_instance_id: nil, content_id: "7408", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_6_Server_-_Extended_Life_...", content_view_version_id: 1, relative_path: "our-organization/Library/content/els/rhel/server/6/6Ser...", url: "https://cdn.redhat.com/content/els/rhel/server/6/6...", unprotected: false, content_type: "yum", product_id: 11, environment_id: 1, checksum_type: nil, docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha256">

Our new errata are present now into:

Red Hat Enterprise Linux 7 Server RPMs x86_64 7Server

who have SHA1 on source_repo_checksum_type.
What is not weird is we have 8 errors as checksum type sha256 and the SHA1 is setted on 8 repos.

Previously I tried also (w/out success) to force the repos to SHA256:

   repo = Katello::Repository.find_by_pulp_id("$pulp_id")
   repo.checksum_type = "sha256"
   repo.save!

If you want I can retry this and check.

27

I wrote the wrong command, the correct one is repo.source_repo_checksum_type = "sha256". The result was the same (just tried). Into /var/log/messages I’ve 8 errors like this:

pulp: celery.beat:INFO: Scheduler: Sending due task download_deferred_content (pulp.server.controllers.repository.queue_download_deferred)
pulp: celery.worker.strategy:INFO: Received task: pulp.server.controllers.repository.queue_download_deferred[c28bbb28-df15-4022-a713-9d82710e2d69]
pulp: qpid.messaging:WARNING: [c28bbb28] process forked, child must not use parent qpid.messaging
pulp: kombu.transport.qpid:INFO: [c28bbb28] Connected to qpid with SASL mechanism ANONYMOUS
pulp: celery.worker.strategy:INFO: Received task: pulp.server.controllers.repository.download_deferred[a9f737da-8b98-4eff-b039-9b079c6f782b]
pulp: celery.app.trace:INFO: [c28bbb28] Task pulp.server.controllers.repository.queue_download_deferred[c28bbb28-df15-4022-a713-9d82710e2d69] succeeded in 0.0689762160182s: None
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Write concern for Mongo connection: {}
mongod.27017[22924]: [conn3973] command pulp_database.repo_content_units command: getMore { getMore: 79648581097, collection: "repo_content_units" } originatingCommand: { find: "repo_content_units", filter: { repo_id: "1-RHEL_Views-v18_1-d8946303-7782-4197-a43d-7e60be8a11a6", unit_type_id: "rpm" }, noCursorTimeout: true } planSummary: IXSCAN { repo_id: -1, unit_type_id: -1 } cursorid:79648581097 keysExamined:23105 docsExamined:23105 cursorExhausted:1 numYields:180 nreturned:23105 reslen:5487999 locks:{ Global: { acquireCount: { r: 362 } }, Database: { acquireCount: { r: 181 } }, Collection: { acquireCount: { r: 181 } } } protocol:op_query 144ms
mongod.27017[22924]: [conn3973] command pulp_database.repo_content_units command: getMore { getMore: 77459390620, collection: "repo_content_units" } originatingCommand: { find: "repo_content_units", filter: { repo_id: "d8946303-7782-4197-a43d-7e60be8a11a6", unit_type_id: "rpm" }, noCursorTimeout: true } planSummary: IXSCAN { repo_id: -1, unit_type_id: -1 } cursorid:77459390620 keysExamined:23105 docsExamined:23105 cursorExhausted:1 numYields:180 nreturned:23105 reslen:5049004 locks:{ Global: { acquireCount: { r: 362 } }, Database: { acquireCount: { r: 181 } }, Collection: { acquireCount: { r: 181 } } } protocol:op_query 112ms
mongod.27017[22924]: [conn3973] command pulp_database.repo_content_units command: aggregate { aggregate: "repo_content_units", pipeline: [ { $match: { repo_id: "1-RHEL_Views-v18_1-d8946303-7782-4197-a43d-7e60be8a11a6" } }, { $group: { sum: { $sum: 1 }, _id: "$unit_type_id" } } ], cursor: {} } planSummary: IXSCAN { repo_id: 1, unit_type_id: 1, unit_id: 1 } keysExamined:26704 docsExamined:0 cursorExhausted:1 numYields:209 nreturned:5 reslen:304 locks:{ Global: { acquireCount: { r: 428 } }, Database: { acquireCount: { r: 214 } }, Collection: { acquireCount: { r: 213 } } } protocol:op_query 105ms
pulp: celery.app.trace:INFO: [5d312311] Task pulp.server.managers.repo.unit_association.associate_from_repo[5d312311-155c-4e63-8f1a-b335e37291bd] succeeded in 847.000600081s: {'units_successful': [{'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'unit_key': {...}, 'type_id': 'erratum'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'unit_key': {...}, 'type_id': 'erratum'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}, {'signing_key': None, 'unit_key': {...}, 'type_id': 'rpm'}], 'units_failed_signature_filter': []}
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Write concern for Mongo connection: {}
pulp: py.warnings:WARNING: [441fc1f0] (4171-49664) /usr/lib64/python2.7/site-packages/pymongo/topology.py:74: UserWarning: MongoClient opened before fork. Create MongoClient with connect=False, or create client after forking. See PyMongo's documentation for details: http://api.mongodb.org/python/current/faq.html#using-pymongo-with-multiprocessing>
pulp: py.warnings:WARNING: [441fc1f0] (4171-49664)   "MongoClient opened before fork. Create MongoClient "
pulp: py.warnings:WARNING: [441fc1f0] (4171-49664)
pulp: celery.app.trace:INFO: [441fc1f0] Task pulp.server.async.tasks._release_resource[441fc1f0-5b01-48e6-91d2-3f1921d2382d] succeeded in 0.0193273266777s: None
pulp: celery.app.trace:INFO: [a9f737da] Task pulp.server.controllers.repository.download_deferred[a9f737da-8b98-4eff-b039-9b079c6f782b] succeeded in 0.0482160113752s: None
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Write concern for Mongo connection: {}
mongod.27017[22924]: [conn3229] command pulp_database.repo_content_units command: getMore { getMore: 81311342213, collection: "repo_content_units" } originatingCommand: { find: "repo_content_units", filter: { repo_id: "1-RHEL_Views-v18_1-d8946303-7782-4197-a43d-7e60be8a11a6", unit_type_id: "rpm" }, projection: { unit_id: 1 }, noCursorTimeout: true } planSummary: IXSCAN { repo_id: -1, unit_type_id: -1 } cursorid:81311342213 keysExamined:23105 docsExamined:23105 cursorExhausted:1 numYields:181 nreturned:23105 reslen:1814304 locks:{ Global: { acquireCount: { r: 364 } }, Database: { acquireCount: { r: 182 } }, Collection: { acquireCount: { r: 182 } } } protocol:op_query 164ms
pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[651a5785-4102-4870-ad0d-a3d890b52ee6]
pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[85394fd7-69aa-43db-9f61-a472776d02d1]
pulp: celery.app.trace:INFO: [651a5785] Task pulp.server.async.tasks._queue_reserved_task[651a5785-4102-4870-ad0d-a3d890b52ee6] succeeded in 0.0481885029003s: None
pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[616da798-b48f-44fb-9317-1cba9440fb6b]
pulp: py.warnings:WARNING: [85394fd7] (4188-49664) /usr/lib64/python2.7/site-packages/pymongo/topology.py:74: UserWarning: MongoClient opened before fork. Create MongoClient with connect=False, or create client after forking. See PyMongo's documentation for details: http://api.mongodb.org/python/current/faq.html#using-pymongo-with-multiprocessing>
pulp: py.warnings:WARNING: [85394fd7] (4188-49664)   "MongoClient opened before fork. Create MongoClient "
pulp: py.warnings:WARNING: [85394fd7] (4188-49664)
mongod.27017[22924]: [conn4029] command pulp_database.repo_content_units command: getMore { getMore: 77345549584, collection: "repo_content_units" } originatingCommand: { find: "repo_content_units", filter: { repo_id: "1-RHEL_Views-v18_1-d8946303-7782-4197-a43d-7e60be8a11a6", unit_type_id: "rpm" }, projection: { unit_id: 1 }, noCursorTimeout: true } planSummary: IXSCAN { repo_id: -1, unit_type_id: -1 } cursorid:77345549584 keysExamined:23105 docsExamined:23105 cursorExhausted:1 numYields:181 nreturned:23105 reslen:1814304 locks:{ Global: { acquireCount: { r: 364 } }, Database: { acquireCount: { r: 182 } }, Collection: { acquireCount: { r: 182 } } } protocol:op_query 159ms
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664) Exception caught from plugin during publish for repo [1-RHEL_Views-v18_1-d8946303-7782-4197-a43d-7e60be8a11a6]
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664) Traceback (most recent call last):
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1258, in _do_publish
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     publish_report = publish_repo(transfer_repo, conduit, call_config)
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 737, in wrap_f
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     return f(*args, **kwargs)
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     return self._publisher.process_lifecycle()
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 572, in process_lifecycle
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     super(PluginStep, self).process_lifecycle()
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     step.process()
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 239, in process
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     self._process_block(item=item)
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 301, in _process_block
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     self.process_main(item=item)
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 496, in process_main
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     context.add_unit_metadata(unit)
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/metadata/filelists.py", line 42, in add_unit_metadata
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     self.metadata_file_handle.write(unit.render_filelists(self.checksum_type))
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/db/models.py", line 863, in render_filelists
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     context = Context({'pkgid': self.get_or_calculate_and_save_checksum(checksumtype)})
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/db/models.py", line 258, in get_or_calculate_and_save_checksum
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664)     checksumtype=checksumtype)
pulp: pulp.server.controllers.repository:ERROR: [85394fd7] (4188-49664) PulpCodedException: Checksum type "sha256" is not available for all units in the repository. Make sure those units have been downloaded.
pulp: pulp.server.async.tasks:INFO: [85394fd7] Task failed : [85394fd7-69aa-43db-9f61-a472776d02d1] : Checksum type "sha256" is not available for all units in the repository. Make sure those units have been downloaded.
pulp: celery.app.trace:INFO: [85394fd7] Task pulp.server.managers.repo.publish.publish[85394fd7-69aa-43db-9f61-a472776d02d1] raised expected: PulpCodedException()
pulp: celery.app.trace:INFO: [616da798] Task pulp.server.async.tasks._release_resource[616da798-b48f-44fb-9317-1cba9440fb6b] succeeded in 0.0048699202016s: None
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Attempting to connect to localhost:27017
pulp: pulp.server.db.connection:INFO: Write concern for Mongo connection: {}

and the all repository are sha256:


=> #<Katello::Repository id: 1151, name: "Red Hat Enterprise Linux 6 Server - Extras RPMs x8...", pulp_id: "ea2ab144-f6e8-4f43-8537-a31c7faf724d", created_at: "2018-10-16 15:40:01", updated_at: "2018-11-30 15:23:27", major: nil, minor: nil, gpg_key_id: nil, cp_label: "rhel-6-server-extras-rpms", library_instance_id: nil, content_id: "3026", arch: "x86_64", label: "Red_Hat_Enterprise_Linux_6_Server_-_Extras_RPMs_x8...", content_view_version_id: 1, relative_path: "ATS-vCentre/Library/content/dist/rhel/server/6/6Se...", url: "https://cdn.redhat.com/content/dist/rhel/server/6/...", unprotected: false, content_type: "yum", product_id: 2, environment_id: 1, checksum_type: "sha256", docker_upstream_name: nil, distribution_version: nil, distribution_arch: nil, distribution_bootable: nil, distribution_family: nil, distribution_variant: nil, distribution_uuid: nil, mirror_on_sync: true, download_policy: "on_demand", verify_ssl_on_sync: true, upstream_username: nil, upstream_password: nil, ostree_upstream_sync_policy: nil, ostree_upstream_sync_depth: nil, container_repository_name: nil, deb_releases: nil, deb_components: nil, deb_architectures: nil, ssl_ca_cert_id: nil, ssl_client_cert_id: nil, ssl_client_key_id: nil, ignore_global_proxy: false, ignorable_content: nil, description: nil, source_repo_checksum_type: "sha256">
28

I solved the issue (maybe). I deleted all repos in my CV, I readd they and resync all. Now the incremental update are up & running…
I think something gone wrong or misconfiogurations on repos were present.

1 Like