Resources not found on content view creation

Support
#1

Finally got a chance to get back to cutting our next release. I'm
documenting what I did and saw below and in the attachments. In the past
i've tried looking through logs in /var/log but to no avail.

What other information should I be gathering?

thanks

greg

Cutting a release of a composite view.
Composite view contains 6 content views.
Each content view contains 27, 2, 2, 1, 1, and 2 repositories, yum only.

I initiated publishing of a new release… a while later it paused on
several tasks erroring. Here is the title and related pulp_id for these,
see attached katello-promote-fail-1.dynflow.txt for their data.

949: Actions::Pulp::Repository::PurgeEmptyPackageGroups (error) [ 659.26s /
659.26s ] Skip
pulp_id: Default-CV-5_0-EPEL-el7-64

1016: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-Subscription-Manager-el6-64

1810: Actions::Pulp::Repository::RemoveDistribution (error) [ 1.22s / 1.22s
] Skip
pulp_id: Default-Library-CV-PostgreSQL-el6-64-93

2078: Actions::Pulp::Repository::RemoveRpm (error) [ 1.20s / 1.20s ] Skip
pulp_id: Default-Library-CV-PostgreSQL-el7-64-95

2136: Actions::Pulp::Repository::Create (error) [ 0.11s / 0.11s ] Skip
pulp_id: Default-Library-CV-VMWare-el6-64-tools

2190: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-JPackage-el6-64

I then told all of these to skip… which i realize is not a good solution.

Two of the steps then failed, and I've attached their failed output as
separate files. I then ran skip on those 2 jobs again and resumed the task.

1810: Actions::Pulp::Repository::RemoveDistribution (error) [ 1.22s / 1.22s
] Skip
pulp_id: Default-Library-CV-PostgreSQL-el6-64-93
2190: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-JPackage-el6-64

Things almost seemed to finish and then 2093 failed. skip/resumed.

2093: Actions::Pulp::Repository::CopyPackageGroup (error) [ 0.21s / 0.21s ]
Skip
source_pulp_id: Default-CV-5_0-PostgreSQL-el7-64-95
target_pulp_id: Default-Library-CV-PostgreSQL-el7-64-95

and done…

now to get it promoted to where one of the systems can check to see if the
new repos are available. The VMWare and JPackage are new to this Composite
view and they were on that list of errors.

katello-promote-fail-1.dynflow.txt (8.55 KB)

#2

fwiw, promoted up the next 2 tiers with 0 errors.

··· On Tue, Jul 19, 2016 at 3:34 PM Greg Swift wrote:

Finally got a chance to get back to cutting our next release. I’m
documenting what I did and saw below and in the attachments. In the past
i’ve tried looking through logs in /var/log but to no avail.

What other information should I be gathering?

thanks

greg

Cutting a release of a composite view.
Composite view contains 6 content views.
Each content view contains 27, 2, 2, 1, 1, and 2 repositories, yum only.

I initiated publishing of a new release… a while later it paused on
several tasks erroring. Here is the title and related pulp_id for these,
see attached katello-promote-fail-1.dynflow.txt for their data.

949: Actions::Pulp::Repository::PurgeEmptyPackageGroups (error) [ 659.26s
/ 659.26s ] Skip
pulp_id: Default-CV-5_0-EPEL-el7-64

1016: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-Subscription-Manager-el6-64

1810: Actions::Pulp::Repository::RemoveDistribution (error) [ 1.22s /
1.22s ] Skip
pulp_id: Default-Library-CV-PostgreSQL-el6-64-93

2078: Actions::Pulp::Repository::RemoveRpm (error) [ 1.20s / 1.20s ] Skip
pulp_id: Default-Library-CV-PostgreSQL-el7-64-95

2136: Actions::Pulp::Repository::Create (error) [ 0.11s / 0.11s ] Skip
pulp_id: Default-Library-CV-VMWare-el6-64-tools

2190: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-JPackage-el6-64

I then told all of these to skip… which i realize is not a good solution.

Two of the steps then failed, and I’ve attached their failed output as
separate files. I then ran skip on those 2 jobs again and resumed the task.

1810: Actions::Pulp::Repository::RemoveDistribution (error) [ 1.22s /
1.22s ] Skip
pulp_id: Default-Library-CV-PostgreSQL-el6-64-93
2190: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-JPackage-el6-64

Things almost seemed to finish and then 2093 failed. skip/resumed.

2093: Actions::Pulp::Repository::CopyPackageGroup (error) [ 0.21s / 0.21s
] Skip
source_pulp_id: Default-CV-5_0-PostgreSQL-el7-64-95
target_pulp_id: Default-Library-CV-PostgreSQL-el7-64-95

and done…

now to get it promoted to where one of the systems can check to see if the
new repos are available. The VMWare and JPackage are new to this Composite
view and they were on that list of errors.

#3

Move forward a few days… same composite view. different but similar set
of errors:

First round:
622: Actions::Pulp::Repository::RemoveRpm (error) [ 0.16s / 0.16s ] Skip
pulp_id: Default-Library-CV-CentOS-el7-64-os

709: Actions::Pulp::Repository::CopyPackageGroup (error) [ 1.76s / 1.76s ]
Skip
source_pulp_id: Default-CV-6_0-CentOS-el7-64-extras
target_pulp_id: Default-Library-CV-CentOS-el7-64-extras

772: Actions::Pulp::Repository::RemoveDistribution (error) [ 0.27s / 0.27s
] Skip
pulp_id: Default-Library-CV-CentOS-el7-64-fasttrack

1005: Actions::Pulp::Repository::PurgeEmptyErrata (error) [ 5.88s / 5.88s ]
Skip
pulp_id: Default-CV-6_0-Subscription-Manager-el6-64

1067: Actions::Pulp::Repository::PurgeEmptyPackageGroups (error) [ 1.67s /
1.67s ] Skip
pulp_id: Default-CV-6_0-Katello-Agent-el6-64-2_3

1603: Actions::Pulp::Repository::CopyRpm (error) [ 1.35s / 1.35s ] Skip
source_pulp_id: Default-CV-6_0-Puppet-puppet-r10k-el7
target_pulp_id: Default-Library-CV-Puppet-puppet-r10k-el7

2140: Actions::Pulp::Repository::RemoveRpm (error) [ 0.25s / 0.25s ] Skip
pulp_id: Default-Library-CV-VMWare-el6-64-tools

2357: Actions::Pulp::Repository::CopyDistribution (error) [ 0.15s / 0.15s ]
Skip
source_pulp_id: Default-CV-6_0-Internal-Developed-el6-64-tool
target_pulp_id: Default-Library-CV-Internal-Developed-el6-64-tool

second round:
777: Actions::Pulp::Repository::CopyRpm (skipping) [ 0.30s / 0.30s ]
source_pulp_id: Default-CV-6_0-CentOS-el7-64-fasttrack
target_pulp_id: Default-Library-CV-CentOS-el7-64-fasttrack

I've attached dynflow output again.

When it finished it says 100% and i see the version but the task shows
state=stopped and result=warning. When i look at the task's error output it
is the steps I mentioned and have attached.

does no one have a suggestion on troubleshooting this?

katello-publish-fail-622.txt (4.74 KB)

··· On Tue, Jul 19, 2016 at 5:05 PM Greg Swift wrote:

fwiw, promoted up the next 2 tiers with 0 errors.

On Tue, Jul 19, 2016 at 3:34 PM Greg Swift gregswift@gmail.com wrote:

Finally got a chance to get back to cutting our next release. I’m
documenting what I did and saw below and in the attachments. In the past
i’ve tried looking through logs in /var/log but to no avail.

What other information should I be gathering?

thanks

greg

Cutting a release of a composite view.
Composite view contains 6 content views.
Each content view contains 27, 2, 2, 1, 1, and 2 repositories, yum only.

I initiated publishing of a new release… a while later it paused on
several tasks erroring. Here is the title and related pulp_id for these,
see attached katello-promote-fail-1.dynflow.txt for their data.

949: Actions::Pulp::Repository::PurgeEmptyPackageGroups (error) [ 659.26s
/ 659.26s ] Skip
pulp_id: Default-CV-5_0-EPEL-el7-64

1016: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-Subscription-Manager-el6-64

1810: Actions::Pulp::Repository::RemoveDistribution (error) [ 1.22s /
1.22s ] Skip
pulp_id: Default-Library-CV-PostgreSQL-el6-64-93

2078: Actions::Pulp::Repository::RemoveRpm (error) [ 1.20s / 1.20s ] Skip
pulp_id: Default-Library-CV-PostgreSQL-el7-64-95

2136: Actions::Pulp::Repository::Create (error) [ 0.11s / 0.11s ] Skip
pulp_id: Default-Library-CV-VMWare-el6-64-tools

2190: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-JPackage-el6-64

I then told all of these to skip… which i realize is not a good
solution.

Two of the steps then failed, and I’ve attached their failed output as
separate files. I then ran skip on those 2 jobs again and resumed the task.

1810: Actions::Pulp::Repository::RemoveDistribution (error) [ 1.22s /
1.22s ] Skip
pulp_id: Default-Library-CV-PostgreSQL-el6-64-93
2190: Actions::Pulp::Repository::Create (error) [ 0.12s / 0.12s ] Skip
pulp_id: Default-Library-CV-JPackage-el6-64

Things almost seemed to finish and then 2093 failed. skip/resumed.

2093: Actions::Pulp::Repository::CopyPackageGroup (error) [ 0.21s / 0.21s
] Skip
source_pulp_id: Default-CV-5_0-PostgreSQL-el7-64-95
target_pulp_id: Default-Library-CV-PostgreSQL-el7-64-95

and done…

now to get it promoted to where one of the systems can check to see if
the new repos are available. The VMWare and JPackage are new to this
Composite view and they were on that list of errors.