katello-nightly-rpm-pipeline 812 failed


#1

Katello nightly pipeline failed:

https://ci.theforeman.org/job/katello-nightly-rpm-pipeline/812/


#2

This looks like the transient deadlock on org delete:

1..1
not ok 1 Delete an Organization
# (in test file fb-destroy-organization.bats, line 15)
#   `hammer organization delete --name="${ORGANIZATION}"' failed with status 70
# Task 0e604533-ad33-44be-9a6e-aae45c80261e planned: 0.0/1, 0%, elapsed: 00:00:00
# Task 0e604533-ad33-44be-9a6e-aae45c80261e running: 0.043478260869565216/1, 4%, 0.0/s, elapsed: 00:00:02, ETA: 00:00:47
# Task 0e604533-ad33-44be-9a6e-aae45c80261e running: 0.21739130434782608/1, 21%, 0.0/s, elapsed: 00:00:04, ETA: 00:00:16
# Task 0e604533-ad33-44be-9a6e-aae45c80261e running: 0.30434782608695654/1, 30%, 0.0/s, elapsed: 00:00:06, ETA: 00:00:15
# Task 0e604533-ad33-44be-9a6e-aae45c80261e running: 0.5869565217391305/1, 58%, 0.1/s, elapsed: 00:00:08, ETA: 00:00:06
# Task 0e604533-ad33-44be-9a6e-aae45c80261e running: 0.7391304347826086/1, 73%, 0.1/s, elapsed: 00:00:10, ETA: 00:00:03
# Task 0e604533-ad33-44be-9a6e-aae45c80261e error: 0.75/1, 75%, 0.1/s, elapsed: 00:00:13, ETA: 00:00:04
# Task 0e604533-ad33-44be-9a6e-aae45c80261e error: 0.75/1, 75%, 0.1/s, elapsed: 00:00:13, ETA: 00:00:04
# Error: PG::TRDeadlockDetected: ERROR:  deadlock detected
# DETAIL:  Process 8058 waits for ShareLock on transaction 15831; blocked by process 5352.
# Process 5352 waits for ShareLock on transaction 15817; blocked by process 8058.
# HINT:  See server log for query details.
# : DELETE FROM "katello_pool_products" WHERE "katello_pool_products"."id" = $1

This seems to occur around 10-20% of the runs, would be good to try and find the root cause to reduce the noise.


closed #3

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.