Content-view fails to publish

Problem:
Content-view version fails to publish with 404 errors and a Bad Request

Error in journal:

okt 26 17:04:07 foreman.isbank.is pulpcore-api[6357]: pulp [a5b10c2b-dcfa-408b-94da-8a71462ab78d]: django.request:WARNING: Bad Request: /pulp/api/v3/repositories/rpm/rpm/a86cf17c-bae5-4dda-b692-1f7c12cc42e2/modify/

Errors in task:

Error message: the server returns an error
HTTP status code: 400
Response headers: {"date"=>"Tue, 26 Oct 2021 17:04:07 GMT", "server"=>"gunicorn", "content-type"=>"application/json", "vary"=>"Accept,Cookie", "allow"=>"POST, OPTIONS", "x-frame-options"=>"SAMEORIGIN", "content-length"=>"8903", "correlation-id"=>"a5b10c2b-dcfa-408b-94da-8a71462ab78d", "access-control-expose-headers"=>"Correlation-ID", "via"=>"1.1 foreman.isbank.is", "connection"=>"close"}
Response body: ["Could not find the following content units: ['/pulp/api/v3/content/rpm/advisories/6d7e90ae-6fee-47b8-a037-0573f12ad1b6/', '/pulp/api/v3/content/rpm/advisories/518d3421-9e17-4096-b2db-393c898e0177/', '/pulp/api/v3/content/rpm/advisories/6fa37830-cd06-481a-987b-53ac5565af1a/', '/pulp/api/v3/content/rpm/advisories/29ff56d3-6694-47ae-b858-b1b4e7024cc5/', '/pulp/api/v3/content/rpm/advisories/9d35f000-74b3-44e3-b6c0-0f54281bfd54/', '/pulp/api/v3/content/rpm/advisories/f7c0a9be-e3ac-4f67-aaf3-3ba0c44bb83c/', '/pulp/api/v3/content/rpm/advisories/8a6298e7-8084-4858-bb64-2f2779e83176/', '/pulp/api/v3/content/rpm/advisories/4ec05cd7-105d-4a00-9d68-e6be7f2ac78e/', '/pulp/api/v3/content/rpm/advisories/925cdb44-6880-4fbd-ab75-7194d28f6cac/', '/pulp/api/v3/content/rpm/advisories/53be0462-cd23-481d-95c8-2b7f21a31723/', '/pulp/api/v3/content/rpm/advisories/b6e0f71e-2629-4627-b17a-c0e04ee13c29/', '/pulp/api/v3/content/rpm/advisories/703e8a79-1f74-448b-b5d8-6e79769e027d/', '/pulp/api/v3/content/rpm/advisories/32282ce7-8658-4d40-939c-6ce30763d6d6/', '/pulp/api/v3/content/rpm/advisories/35dddcc5-2fc3-4ac9-888e-9819421a0e8d/', '/pulp/api/v3/content/rpm/advisories/d847c279-7e6c-4946-841e-957579682af9/', '/pulp/api/v3/content/rpm/advisories/f370af88-73ee-4822-bfdf-2ff43a0ff16a/', '/pulp/api/v3/content/rpm/advisories/81fa988d-d4d4-4873-97ec-603d51d35da9/', '/pulp/api/v3/content/rpm/advisories/1804dc07-8854-4f08-9a0f-28d9277f180c/', '/pulp/api/v3/content/rpm/advisories/af02a21d-eb3c-4d63-b7c3-33b1432488f9/', '/pulp/api/v3/content/rpm/advisories/15f03ff3-382c-4777-b3e6-7c7f5a818d4d/', '/pulp/api/v3/content/rpm/advisories/42814348-7df1-4910-8289-511b2eb11645/', '/pulp/api/v3/content/rpm/advisories/4dcd1ac9-f960-4fbd-a4fa-3aa6b05a517a/', '/pulp/api/v3/content/rpm/advisories/4c61292c-a461-4eb3-8d24-a173a07d91a3/', '/pulp/api/v3/content/rpm/advisories/3e43edca-5c29-4d90-b331-099c5c469da7/', '/pulp/api/v3/content/rpm/advisories/430c62b3-6e3a-4376-9282-9b143c976e10/', '/pulp/api/v3/content/rpm/advisories/7838c6d5-7c3d-4164-af87-8934e24395b6/', '/pulp/api/v3/content/rpm/advisories/6c0bfc81-6f8b-4079-a729-4c64a35de961/', '/pulp/api/v3/content/rpm/advisories/4d94d858-e638-4a44-a43d-93746f2439c5/', '/pulp/api/v3/content/rpm/advisories/75563eba-1d03-4be9-94dc-be49fb5692a4/', '/pulp/api/v3/content/rpm/advisories/81a3c46e-a926-42a2-9a21-82d01b16f77d/', '/pulp/api/v3/content/rpm/advisories/95828323-00df-4202-9838-fa76f09eccf1/', '/pulp/api/v3/content/rpm/advisories/ffbc65b1-c866-4e8e-807f-3578357a62e0/', '/pulp/api/v3/content/rpm/advisories/ae725135-3d45-45cc-9a2a-8c032d944bc6/', '/pulp/api/v3/content/rpm/advisories/2e83f274-946b-4b24-b31a-c2de6ac4c8a1/', '/pulp/api/v3/content/rpm/advisories/547438ef-cdc2-4759-90ae-61ca5d3d45ad/', '/pulp/api/v3/content/rpm/advisories/818d3787-ca4a-4c5b-94e2-a573dbbd7b68/', '/pulp/api/v3/content/rpm/advisories/8fc19f59-b825-4b24-9637-4371c648e15e/', '/pulp/api/v3/content/rpm/advisories/f01fddc9-b786-47cb-96c4-25589c156c40/', '/pulp/api/v3/content/rpm/advisories/2be2bb42-28d0-4b93-87ab-3ed52fbca0e2/', '/pulp/api/v3/content/rpm/advisories/9f5d9a90-6eee-4f79-8301-100155b1c8c9/', '/pulp/api/v3/content/rpm/advisories/434c8e8f-935d-4706-8d79-a3fe317bd9ee/', '/pulp/api/v3/content/rpm/advisories/a389ee41-7418-4598-b700-4a395442cef9/', '/pulp/api/v3/content/rpm/advisories/92cd9b18-a3bd-4020-88ed-75e7660c8ada/', '/pulp/api/v3/content/rpm/advisories/3051f193-3f71-45fd-a286-1803b69e54a6/', '/pulp/api/v3/content/rpm/advisories/778c7fe5-c9cc-4bc8-851d-b294399d2952/', '/pulp/api/v3/content/rpm/advisories/b8c80fcb-c08b-4bc0-b9d7-ed752ae99316/', '/pulp/api/v3/content/rpm/advisories/73e4574b-3dff-41f6-8e27-a0d5110b56ef/', '/pulp/api/v3/content/rpm/advisories/fb045d6a-a81c-471b-aaf1-3e5b5d9a1099/', '/pulp/api/v3/content/rpm/advisories/0a9b9ab7-0df2-4c1c-813d-89b7b9098b8b/', '/pulp/api/v3/content/rpm/advisories/1c9e0093-7127-41c5-b092-2b986057e209/', '/pulp/api/v3/content/rpm/advisories/1f99fe78-680b-42db-bfd6-c84799a6736f/', '/pulp/api/v3/content/rpm/advisories/bbd6808b-008b-4002-a95d-3ec2310070d4/', '/pulp/api/v3/content/rpm/advisories/1d127dd3-ad0d-421d-a8f0-dc78d2bd9fb2/', '/pulp/api/v3/content/rpm/advisories/ae8189e1-edb3-473b-af3d-1eff4c6e73f3/', '/pulp/api/v3/content/rpm/advisories/00370575-0881-4fd5-8147-427ff7e214ed/', '/pulp/api/v3/content/rpm/advisories/b361d60f-b641-4edf-b42f-29dcc535044c/', '/pulp/api/v3/content/rpm/advisories/ab6e6a08-5da3-4529-aacb-2708962df278/', '/pulp/api/v3/content/rpm/advisories/76821dae-b8fe-45d0-9b54-13912230b656/', '/pulp/api/v3/content/rpm/advisories/b9b61ba3-2ad5-49b5-8549-9bd5e22cdf4f/', '/pulp/api/v3/content/rpm/advisories/9bddc775-940e-4f68-b667-c0ac1df89bc1/', '/pulp/api/v3/content/rpm/advisories/23fb5dee-9e58-4d48-9134-a59e1ac7a86f/', '/pulp/api/v3/content/rpm/advisories/8f0e4571-bab3-46b8-bbe9-f639ce8f465e/', '/pulp/api/v3/content/rpm/advisories/3d498de2-83f1-45bb-9d66-163a40b574e1/', '/pulp/api/v3/content/rpm/advisories/63edff8a-6a12-4be0-8e66-a9d74e618d21/', '/pulp/api/v3/content/rpm/advisories/758d2ef8-4eac-421e-914a-5b4af5d65705/', '/pulp/api/v3/content/rpm/advisories/d033ab1b-a1e6-455d-80fd-29f263de1b3f/', '/pulp/api/v3/content/rpm/advisories/1f9bd6f7-479c-402f-b3da-f9142aaa5842/', '/pulp/api/v3/content/rpm/advisories/38575c3e-a20e-4174-a43f-7581f435af81/', '/pulp/api/v3/content/rpm/advisories/3d976698-9fc8-4a36-96ed-a57f667bc573/', '/pulp/api/v3/content/rpm/advisories/ddb36ed3-72b1-4872-b282-c12d0598e539/', '/pulp/api/v3/content/rpm/advisories/f53e1fb7-d27e-4534-93a3-33369f88a9e2/', '/pulp/api/v3/content/rpm/advisories/f40dc9ec-0566-47e9-b4b8-46a1047305cc/', '/pulp/api/v3/content/rpm/advisories/eb78b44b-bed5-4c81-97f5-d3044d3657e3/', '/pulp/api/v3/content/rpm/advisories/e8c654fc-c237-47f5-8bc3-46cd44b283c5/', '/pulp/api/v3/content/rpm/advisories/e60bafe7-5239-4a83-ad48-8906c8e76934/', '/pulp/api/v3/content/rpm/advisories/439bcaeb-4c8b-4027-ba2d-51cee04e0fb7/', '/pulp/api/v3/content/rpm/advisories/4c7e6cad-6fb3-4d45-b59e-7410e4c334ec/', '/pulp/api/v3/content/rpm/advisories/50c28135-7ae7-414a-a093-9324c4d3e1ff/', '/pulp/api/v3/content/rpm/advisories/7bb2335a-7d68-43f5-b109-6047b2877f1f/', '/pulp/api/v3/content/rpm/advisories/0c198312-5c10-4aa0-a5d9-54f29a5bc968/', '/pulp/api/v3/content/rpm/advisories/a21d5291-8492-4585-95fb-323600c7e695/', '/pulp/api/v3/content/rpm/advisories/48ddcaf7-d43a-48d1-8d70-68b7dffc9430/', '/pulp/api/v3/content/rpm/advisories/ab03d19a-55a9-4d83-889e-fbaa3573010a/', '/pulp/api/v3/content/rpm/advisories/d37958ba-7c5f-427b-a4c0-f39f09277701/', '/pulp/api/v3/content/rpm/advisories/d3f64f97-eb08-41d3-8afb-ca2015b3e3cf/', '/pulp/api/v3/content/rpm/advisories/c7544e86-19a8-4fc3-87e9-077769a2180a/', '/pulp/api/v3/content/rpm/advisories/40694b12-71de-42fc-914d-3f2ef2e093e2/', '/pulp/api/v3/content/rpm/advisories/1ef5ef5d-b6a2-4a1f-ba7e-51bdd3aee086/', '/pulp/api/v3/content/rpm/advisories/2cd5953d-020f-4656-98cc-98d4288372f3/', '/pulp/api/v3/content/rpm/advisories/8386d273-2d94-4c0e-828e-84699f9d8c4c/', '/pulp/api/v3/content/rpm/advisories/e0dcdd0c-5a2e-4ad0-a7bc-ab2553b9d380/', '/pulp/api/v3/content/rpm/advisories/646a1ea0-1d0a-4844-b255-d0aedfc86e50/', '/pulp/api/v3/content/rpm/advisories/1c87d023-11bb-4033-9901-cb90aa5dddca/', '/pulp/api/v3/content/rpm/advisories/1f784c22-33a6-4989-a0f1-2e0c19683e02/', '/pulp/api/v3/content/rpm/advisories/c1de3340-f15e-4d18-834d-bf292c07e922/', '/pulp/api/v3/content/rpm/advisories/ad69cc5c-1804-4424-85af-a7543e13393c/', '/pulp/api/v3/content/rpm/advisories/4eea0f5f-4659-44fa-811b-d20849d36272/', '/pulp/api/v3/content/rpm/advisories/761a8888-bbfc-4806-a8ac-9071936ee455/', '/pulp/api/v3/content/rpm/advisories/bc64243d-7f79-4501-9f13-42512fc3eb1e/', '/pulp/api/v3/content/rpm/advisories/dd77646b-6b2a-4a56-84dd-ef018256ecc1/', '/pulp/api/v3/content/rpm/advisories/db2076ea-993f-4231-bab2-b7c91f918817/', '/pulp/api/v3/content/rpm/advisories/3871b416-43d8-48b3-a509-9223dc8cb171/', '/pulp/api/v3/content/rpm/advisories/093b2dd9-4ce5-4b5f-a9f9-1e90f06dd22d/', '/pulp/api/v3/content/rpm/advisories/cb1498ce-4c69-47ca-a70e-2820c4e68c29/', '/pulp/api/v3/content/rpm/advisories/dc990b45-370a-49e3-8758-80fcb56a5eea/', '/pulp/api/v3/content/rpm/advisories/c32bfafa-bf65-494b-8c24-c2c2fd90c175/', '/pulp/api/v3/content/rpm/advisories/e809d2fb-c3ec-4e84-ba63-eaa8532de628/', '/pulp/api/v3/content/rpm/advisories/865bd0c2-78b9-479b-9372-c2eca6e6b733/', '/pulp/api/v3/content/rpm/advisories/70c00834-11c5-4928-9a68-720ca31fd5ae/', '/pulp/api/v3/content/rpm/advisories/082de697-ebe1-4a9c-8c04-50a34d34584d/', '/pulp/api/v3/content/rpm/advisories/4f812969-2c69-4f0a-8943-dae9994ede97/', '/pulp/api/v3/content/rpm/advisories/3e81d6b6-35bf-491c-bee6-e3da08d746f9/', '/pulp/api/v3/content/rpm/advisories/87ac2a56-4f27-44d0-bc8f-e4f7dee4d862/', '/pulp/api/v3/content/rpm/advisories/4aabb391-d300-4bb9-b1f8-1cf93db90a16/', '/pulp/api/v3/content/rpm/advisories/6dd82bab-3f33-4224-8f31-b43547dd7442/']"]Error message: the server returns an error
HTTP status code: 400
Response headers: {"date"=>"Tue, 26 Oct 2021 17:03:03 GMT", "server"=>"gunicorn", "content-type"=>"application/json", "vary"=>"Accept,Cookie", "allow"=>"POST, OPTIONS", "x-frame-options"=>"SAMEORIGIN", "content-length"=>"125", "correlation-id"=>"a5b10c2b-dcfa-408b-94da-8a71462ab78d", "access-control-expose-headers"=>"Correlation-ID", "via"=>"1.1 foreman.isbank.is", "connection"=>"close"}
Response body: ["Could not find the following content units: ['/pulp/api/v3/content/rpm/advisories/10654684-6442-4f4e-ae27-08e694799a0c/']"]Error message: the server returns an error
HTTP status code: 400
Response headers: {"date"=>"Tue, 26 Oct 2021 17:03:03 GMT", "server"=>"gunicorn", "content-type"=>"application/json", "vary"=>"Accept,Cookie", "allow"=>"POST, OPTIONS", "x-frame-options"=>"SAMEORIGIN", "content-length"=>"664", "correlation-id"=>"a5b10c2b-dcfa-408b-94da-8a71462ab78d", "access-control-expose-headers"=>"Correlation-ID", "via"=>"1.1 foreman.isbank.is", "connection"=>"close"}
Response body: ["Could not find the following content units: ['/pulp/api/v3/content/rpm/advisories/87a3ea00-5faf-4f26-9552-5351b853aa51/', '/pulp/api/v3/content/rpm/advisories/feaf1842-a489-4a94-a954-e4965511638f/', '/pulp/api/v3/content/rpm/advisories/37c91ff2-f55b-400d-810f-d56441e5a298/', '/pulp/api/v3/content/rpm/advisories/fb994aa1-1d52-4be6-b31e-a29590bbb883/', '/pulp/api/v3/content/rpm/advisories/ed2b0506-e773-486a-9f40-d177bb83c471/', '/pulp/api/v3/content/rpm/advisories/853aef58-7f4f-4663-a144-f26b969b1f9c/', '/pulp/api/v3/content/rpm/advisories/3b18e24b-bf07-4b0f-b685-3ed8afa4b9bc/', '/pulp/api/v3/content/rpm/advisories/9f0ee31a-d6f0-4e03-a6d1-24cb20c81f9d/']"]

Error from Production.log

2021-10-26T17:04:07 [E|bac|a5b10c2b] Error message: the server returns an error                                                                                                                                                                                                              β”‚
 a5b10c2b | HTTP status code: 400                                                                                                                                                                                                                                                            β”‚
 a5b10c2b | Response headers: {"date"=>"Tue, 26 Oct 2021 17:04:07 GMT", "server"=>"gunicorn", "content-type"=>"application/json", "vary"=>"Accept,Cookie", "allow"=>"POST, OPTIONS", "x-frame-options"=>"SAMEORIGIN", "content-length"=>"8903", "correlation-id"=>"a5b10c2b-dcfa-408b-94da-8aβ”‚
 a5b10c2b | Response body: ["Could not find the following content units: ['/pulp/api/v3/content/rpm/advisories/6d7e90ae-6fee-47b8-a037-0573f12ad1b6/', '/pulp/api/v3/content/rpm/advisories/518d3421-9e17-4096-b2db-393c898e0177/', '/pulp/api/v3/content/rpm/advisories/6fa37830-cd06-481a-9β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/pulp_rpm_client-3.13.3/lib/pulp_rpm_client/api_client.rb:83:in `call_api'                                                                                                                                                           β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/pulp_rpm_client-3.13.3/lib/pulp_rpm_client/api/repositories_rpm_api.rb:300:in `modify_with_http_info'                                                                                                                               β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/pulp_rpm_client-3.13.3/lib/pulp_rpm_client/api/repositories_rpm_api.rb:244:in `modify'                                                                                                                                              β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/services/katello/pulp3/repository.rb:459:in `add_content'                                                                                                                                                       β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/services/katello/pulp3/repository/yum.rb:202:in `block in copy_units'                                                                                                                                           β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/services/katello/pulp3/repository/yum.rb:201:in `each'                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/services/katello/pulp3/repository/yum.rb:201:in `each_slice'                                                                                                                                                    β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/services/katello/pulp3/repository/yum.rb:201:in `copy_units'                                                                                                                                                    β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/services/katello/pulp3/repository/yum.rb:355:in `copy_content_for_source'                                                                                                                                       β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/repository/copy_content.rb:18:in `invoke_external_task'                                                                                                                                       β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/polling.rb:84:in `initiate_external_action'                                                                                                                                                        β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/polling.rb:19:in `run'                                                                                                                                                                             β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/cancellable.rb:14:in `run'                                                                                                                                                                         β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'                                                                                                                                                            β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:572:in `block (3 levels) in execute_run'                                                                                                                                                        β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:32:in `run'                                                                                                                                                                                 β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:16:in `block in run'                                                                                                                                                    β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'                                                                                                                                         β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'                                                                                                                                                    β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'                                                                                                                                                      β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'                                                                                                                                                  β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.2.0.1/app/lib/actions/middleware/remote_action.rb:16:in `run'                                                                                                                                                             β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/execution_wrapper.rb:88:in `wrap'                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'                                                                                                                                                   β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'                                                                                                                                                      β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action/progress.rb:17:in `run'                                                                                                                                                                            β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/load_setting_values.rb:20:in `run'                                                                                                                                                   β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'                                                                                                                                      β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'                                                                                                                        β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'                                                                                                                                               β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'                                                                                                                                        β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'                                                                                                                             β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'                                                                                                                                                 β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'                                                                                                                                      β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'                                                                                                                        β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'                                                                                                                                               β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:32:in `run'                                                                                                                                                                                 β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:27:in `pass'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware.rb:19:in `pass'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'                                                                                                                                            β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'                                                                                                                                     β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-5.1.0/app/lib/actions/middleware/keep_current_user.rb:15:in `run'                                                                                                                                                     β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/stack.rb:23:in `call'                                                                                                                                                                          β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/middleware/world.rb:31:in `execute'                                                                                                                                                                       β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:571:in `block (2 levels) in execute_run'                                                                                                                                                        β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:570:in `catch'                                                                                                                                                                                  β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:570:in `block in execute_run'                                                                                                                                                                   β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in `block in with_error_handling'                                                                                                                                                           β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in `catch'                                                                                                                                                                                  β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:473:in `with_error_handling'                                                                                                                                                                    β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:565:in `execute_run'                                                                                                                                                                            β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/action.rb:286:in `execute'                                                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'                                                                                                                            β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'                                                                                                                                           β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'                                                                                                                                       β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'                                                                                                                                            β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'                                                                                                                                                β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/director.rb:69:in `execute'                                                                                                                                                                               β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'                                                                                                                                      β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors.rb:18:in `run_user_code'                                                                                                                                                                        β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'                                                                                                                                                  β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'                                                                                                                                                   β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'                                                                                                                                                           β”‚
 a5b10c2b | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.5.0/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'                                                                                                                                                        β”‚
 a5b10c2b | [ sidekiq ]                                                                                                                                                                                                                                                                      β”‚
 a5b10c2b | [ concurrent-ruby ]

Expected outcome:
Content-view gets properly published

Foreman and Proxy versions:
Foreman 3.0 / Katello 4.2 latest updates installed

Foreman and Proxy plugin versions:

Distribution and version:
CentOS7

Other relevant data:

This only happens on our most annoying repos (that we’re thankfully working to stop using): OracleLinux 7 - Other repositories work fantastically

considering the amount of issues i’ve had with OracleLinux repos and the fact that OL7 was the first ever repo in my Foreman instance, i’m thinking of cleaning it out completely, content-views and products, and recreating it to see if that alleviates some of the garbage it appears to have collected over the last couple years and hopefully stop some of these endless errors i keep having.
Will post back results

Hi @birkirf,

I believe you are hitting this bug: Bug #33648: Errata changing in the upstream repo is not being reflected in the Katello DB - Katello - Foreman

The issue has to do with repositories that edit existing errata and reissue them with the same ID. Unless you want to apply the issue’s two PRs as a patch, cleaning out that repository and running orphan cleanup (foreman-rake katello:delete_orphaned_content) should do the trick. The fix will be out in Katello 4.2.1.

If cleaning out the repository doesn’t fix it, it might mean you have other repositories that share the edited errata. We can debug further if it gets to that point.

Also, a guaranteed workaround is to remove all of your content view filters from that particular content view. That may not make any sense for your environment, but if it’s safe to do so I’d recommend it until Katello 4.2.1.

To safely work around the paused task, you can skip the errored dynflow steps and then delete the half-created content view version.

If you do apply the two PRs as patches, you’ll only need to re-sync the repository (or better yet run ::Katello::Repository.find(<id>).index_content in the console) before retrying the content view publish.

1 Like

thanks for the help.

a bit offtopic but: is there some kind of cleanup task which deletes everything in pulpcore which is no longer present in katello. due some manual DB β€œfixing” i might guess we have some stuff laying around which got deleted because of the recent bugs.
or something which deletes pulpcore content entirely and resyncs all repos would be great too

Orphan cleanup (foreman-rake katello:delete_orphaned_content) is the closest thing we have. It might be possible to expand orphan cleanup further. If you find that it doesn’t delete things that you’d like, making a specific feature request on projects.theforeman.org would be very helpful.

Thanks for the reply, got it working for now by cleaning it out and recreating the repos.
I will wait for the katello update to properly fix this, thanks

1 Like