[Katello 2.2] Don't see puppet module after upload

Hello,

I'm using Katello 2.2 and Foreman nightly to manage puppet modules
repository and configuration. I have 2 puppet repositories in a product,
one for in-house puppet modules and one which is synced with puppet forge.
I've been able to go from a puppet module upload to its use
in configuration. I had some intermittent problem with some puppet modules
uploaded but not showing in foreman repository list.

But my installation was a bit crappy (had some FS full problems), so I've
deleted every element in foreman (views, repos, etc), done the same with
pulp and cleaned the DB.

Now the puppet modules which I upload never show in foreman list. I've
tried several methods:

  • upload via foreman UI
  • pulp-admin puppet repo uploads upload
  • hammer repository upload-content

The upload went fine. There's no error in production.log . The puppet
module can be seen in pulp repo but not via hammer.
So it seem that foreman doesn't get this puppet module list via pulp.
What is the sync mechanism for this module list ?
I'm using foreman task, can I start this sync manually ?

Is there anything else I can do to debug this problem ?

Thanks,

Sylvain Avril

>
>
>
I've investigated more and I found the following error in the
production.log of foreman :
2015-05-20 09:58:03 [I] Processing by
Katello::Api::V2::RepositoriesController#upload_content as HTML
2015-05-20 09:58:03 [I] Parameters:
{"content"=>[#<ActionDispatch::Http::UploadedFile:0x0000000e8dfcf8
@original_filename="sample_module-0.0.1.tar.gz",
@content_type="application/gzip", @headers="Content-Disposition: form-data;
name=&quot;content[]&quot;;
filename=&quot;sample_module-0.0.1.tar.gz&quot;\r\nContent-Type:
application/gzip\r\n",
@tempfile=#<File:/tmp/RackMultipart20150520-13070-15b7csh>>],
"authenticity_token"=>"XXXXXXX=", "api_version"=>"v2", "id"=>"33"}
[ERROR 2015-05-20 09:58:04 pulp_rest #20296] RestClient.put "
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207/0//",
2479 byte(s) length, "Accept"=>"/; q=0.5, application/xml",
"Accept-Encoding"=>"gzip, deflate", "Authorization"=>"OAuth
oauth_body_hash=&quot;XXXXXXX&quot;, oauth_consumer_key=&quot;katello&quot;,
oauth_nonce=&quot;XXXXXXX&quot;, oauth_signature=&quot;XXXXXXX&quot;,
oauth_signature_method=&quot;HMAC-SHA1&quot;, oauth_timestamp=&quot;1432108684&quot;,
oauth_version=&quot;1.0&quot;", "Content-Length"=>"2479",
"accept"=>"application/json", "content_type"=>"application/json",
"pulp-user"=>"user-7881e1e5"
> \n# => 200 OK | application/json 24 bytes
>
[ERROR 2015-05-20 09:58:05 pulp_rest #20296] RestClient.delete "
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207//",
"Accept"=>"/; q=0.5, application/xml", "Accept-Encoding"=>"gzip,
deflate", "Authorization"=>"OAuth oauth_consumer_key=&quot;katello&quot;,
oauth_nonce=&quot;XXXXXXX&quot;, oauth_signature=&quot;XXXXXXX&quot;,
oauth_signature_method=&quot;HMAC-SHA1&quot;, oauth_timestamp=&quot;1432108685&quot;,
oauth_version=&quot;1.0&quot;", "accept"=>"application/json",
"content_type"=>"application/json", "pulp-user"=>"user-7881e1e5"
> \n# => 200 OK | application/json 24 bytes
>
2015-05-20 09:58:05 [I] Completed 200 OK in 2498ms (Views: 0.4ms |
ActiveRecord: 29.3ms)
2015-05-20 09:58:11 [I] Processing by
Katello::Api::V2::RepositoriesController#show as JSON
2015-05-20 09:58:11 [I] Parameters: {"organization_id"=>"4",
"api_version"=>"v2", "id"=>"33"}
The HTTP return code for pulp is 200 OK so it should be right. In
/var/log/messages, pulp has no error :
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
succeeded in 0.0470762171317s: None
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
succeeded in 0.0471452909987s: {'details': {}, 'success_flag': True,
'summary': ''}
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
succeeded in 0.0123673789203s: None
And when I use the command 'pulp-admin puppet repo modules', I can see the
module I uploaded.
In foreman there is a task 'Actions::Katello::Repository::UploadFiles'
which is stopped and has succeded.

I'm using foreman nightly rpms and may be there's a mismatch between the
pulp version and foreman. I'm using pulp 2.6.0-1, is it correct ?

Thanks,

Sylvain Avril

You say you are using Katello 2.2 and Foreman nightly RPMs – how did you
get into that setup?

Eric

··· On Wed, May 20, 2015 at 4:10 AM, Sylvain Binome wrote:

I’ve investigated more and I found the following error in the
production.log of foreman :
2015-05-20 09:58:03 [I] Processing by
Katello::Api::V2::RepositoriesController#upload_content as HTML
2015-05-20 09:58:03 [I] Parameters:
{“content”=>[#<ActionDispatch::Http::UploadedFile:0x0000000e8dfcf8
@original_filename=“sample_module-0.0.1.tar.gz”,
@content_type=“application/gzip”, @headers=“Content-Disposition: form-data;
name=“content[]”;
filename=“sample_module-0.0.1.tar.gz”\r\nContent-Type:
application/gzip\r\n”,
@tempfile=#<File:/tmp/RackMultipart20150520-13070-15b7csh>>],
“authenticity_token”=>“XXXXXXX=”, “api_version”=>“v2”, “id”=>“33”}
[ERROR 2015-05-20 09:58:04 pulp_rest #20296] RestClient.put “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207/0//”,
2479 byte(s) length, “Accept”=>"/; q=0.5, application/xml",
“Accept-Encoding”=>“gzip, deflate”, “Authorization”=>"OAuth
oauth_body_hash=“XXXXXXX”, oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108684”,
oauth_version=“1.0"”, “Content-Length”=>“2479”,
“accept”=>“application/json”, “content_type”=>“application/json”,
“pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

[ERROR 2015-05-20 09:58:05 pulp_rest #20296] RestClient.delete “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207//”,
“Accept”=>"/; q=0.5, application/xml", “Accept-Encoding”=>“gzip,
deflate”, “Authorization”=>"OAuth oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108685”,
oauth_version=“1.0"”, “accept”=>“application/json”,
“content_type”=>“application/json”, “pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

2015-05-20 09:58:05 [I] Completed 200 OK in 2498ms (Views: 0.4ms |
ActiveRecord: 29.3ms)
2015-05-20 09:58:11 [I] Processing by
Katello::Api::V2::RepositoriesController#show as JSON
2015-05-20 09:58:11 [I] Parameters: {“organization_id”=>“4”,
“api_version”=>“v2”, “id”=>“33”}
The HTTP return code for pulp is 200 OK so it should be right. In
/var/log/messages, pulp has no error :
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
succeeded in 0.0470762171317s: None
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
succeeded in 0.0471452909987s: {‘details’: {}, ‘success_flag’: True,
‘summary’: ‘’}
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
succeeded in 0.0123673789203s: None
And when I use the command ‘pulp-admin puppet repo modules’, I can see
the module I uploaded.
In foreman there is a task 'Actions::Katello::Repository::UploadFiles’
which is stopped and has succeded.

I’m using foreman nightly rpms and may be there’s a mismatch between the
pulp version and foreman. I’m using pulp 2.6.0-1, is it correct ?

Thanks,

Sylvain Avril


You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

Well, that's the recommanded way :
http://www.katello.org/docs/2.2/installation/index.html
And then I used the katello-installer.

Then I changed the katello repo to nightly by installed the nightly repo
RPM (which configure yum).
To be safe, I ran the katello-installer --upgrade .

Since my last post, I have found a method that work to publish the module.
I use pulp-puppet-module-builder to populate a local folder with my modules
and then sync a reposistory with this folder URL. It work but it is slow
and is not a nice solution but at least I can't continue my work with it.

But upload via CLI or Web UI doesn't work. That really puzzle me. I've done
a extensive research on all that was in /var/log and didn't found a clue,
except what I have posted before.

··· Le mercredi 20 mai 2015 16:33:20 UTC+2, Eric Helms a écrit :

You say you are using Katello 2.2 and Foreman nightly RPMs – how did you
get into that setup?

Eric

On Wed, May 20, 2015 at 4:10 AM, Sylvain Binome <avr...@gmail.com > <javascript:>> wrote:

I’ve investigated more and I found the following error in the
production.log of foreman :
2015-05-20 09:58:03 [I] Processing by
Katello::Api::V2::RepositoriesController#upload_content as HTML
2015-05-20 09:58:03 [I] Parameters:
{“content”=>[#<ActionDispatch::Http::UploadedFile:0x0000000e8dfcf8
@original_filename=“sample_module-0.0.1.tar.gz”,
@content_type=“application/gzip”, @headers=“Content-Disposition: form-data;
name=“content[]”;
filename=“sample_module-0.0.1.tar.gz”\r\nContent-Type:
application/gzip\r\n”,
@tempfile=#<File:/tmp/RackMultipart20150520-13070-15b7csh>>],
“authenticity_token”=>“XXXXXXX=”, “api_version”=>“v2”, “id”=>“33”}
[ERROR 2015-05-20 09:58:04 pulp_rest #20296] RestClient.put “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207/0//”,
2479 byte(s) length, “Accept”=>"/; q=0.5, application/xml",
“Accept-Encoding”=>“gzip, deflate”, “Authorization”=>"OAuth
oauth_body_hash=“XXXXXXX”, oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108684”,
oauth_version=“1.0"”, “Content-Length”=>“2479”,
“accept”=>“application/json”, “content_type”=>“application/json”,
“pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

[ERROR 2015-05-20 09:58:05 pulp_rest #20296] RestClient.delete “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207//”,
“Accept”=>"/; q=0.5, application/xml", “Accept-Encoding”=>“gzip,
deflate”, “Authorization”=>"OAuth oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108685”,
oauth_version=“1.0"”, “accept”=>“application/json”,
“content_type”=>“application/json”, “pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

2015-05-20 09:58:05 [I] Completed 200 OK in 2498ms (Views: 0.4ms |
ActiveRecord: 29.3ms)
2015-05-20 09:58:11 [I] Processing by
Katello::Api::V2::RepositoriesController#show as JSON
2015-05-20 09:58:11 [I] Parameters: {“organization_id”=>“4”,
“api_version”=>“v2”, “id”=>“33”}
The HTTP return code for pulp is 200 OK so it should be right. In
/var/log/messages, pulp has no error :
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
succeeded in 0.0470762171317s: None
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
succeeded in 0.0471452909987s: {‘details’: {}, ‘success_flag’: True,
‘summary’: ‘’}
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
succeeded in 0.0123673789203s: None
And when I use the command ‘pulp-admin puppet repo modules’, I can see
the module I uploaded.
In foreman there is a task 'Actions::Katello::Repository::UploadFiles’
which is stopped and has succeded.

I’m using foreman nightly rpms and may be there’s a mismatch between the
pulp version and foreman. I’m using pulp 2.6.0-1, is it correct ?

Thanks,

Sylvain Avril


You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-user...@googlegroups.com <javascript:>.
To post to this group, send email to forema...@googlegroups.com
<javascript:>.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

Switching a 2.2 to nightly Katello and/or Foreman is not a supported path.
SInce we do not test this type of change, we can't guarantee what may or
may not work. If you wanted nightlies, you could just install the nightly
versions directly?

Can you specify which page you are looking at exactly when trying to see
the uploaded puppet modules? There are a few places that you can view
modules so this would help to narrow the problem.

Eric

··· On Wed, May 20, 2015 at 11:53 AM, Sylvain Binome wrote:

Well, that’s the recommanded way :
http://www.katello.org/docs/2.2/installation/index.html
And then I used the katello-installer.

Then I changed the katello repo to nightly by installed the nightly repo
RPM (which configure yum).
To be safe, I ran the katello-installer --upgrade .

Since my last post, I have found a method that work to publish the module.
I use pulp-puppet-module-builder to populate a local folder with my modules
and then sync a reposistory with this folder URL. It work but it is slow
and is not a nice solution but at least I can’t continue my work with it.

But upload via CLI or Web UI doesn’t work. That really puzzle me. I’ve
done a extensive research on all that was in /var/log and didn’t found a
clue, except what I have posted before.

Le mercredi 20 mai 2015 16:33:20 UTC+2, Eric Helms a écrit :

You say you are using Katello 2.2 and Foreman nightly RPMs – how did you
get into that setup?

Eric

On Wed, May 20, 2015 at 4:10 AM, Sylvain Binome avr...@gmail.com wrote:

I’ve investigated more and I found the following error in the
production.log of foreman :
2015-05-20 09:58:03 [I] Processing by
Katello::Api::V2::RepositoriesController#upload_content as HTML
2015-05-20 09:58:03 [I] Parameters:
{“content”=>[#<ActionDispatch::Http::UploadedFile:0x0000000e8dfcf8
@original_filename=“sample_module-0.0.1.tar.gz”,
@content_type=“application/gzip”, @headers=“Content-Disposition: form-data;
name=“content[]”;
filename=“sample_module-0.0.1.tar.gz”\r\nContent-Type:
application/gzip\r\n”,
@tempfile=#<File:/tmp/RackMultipart20150520-13070-15b7csh>>],
“authenticity_token”=>“XXXXXXX=”, “api_version”=>“v2”, “id”=>“33”}
[ERROR 2015-05-20 09:58:04 pulp_rest #20296] RestClient.put “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207/0//”,
2479 byte(s) length, “Accept”=>"/; q=0.5, application/xml",
“Accept-Encoding”=>“gzip, deflate”, “Authorization”=>"OAuth
oauth_body_hash=“XXXXXXX”, oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108684”,
oauth_version=“1.0"”, “Content-Length”=>“2479”,
“accept”=>“application/json”, “content_type”=>“application/json”,
“pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

[ERROR 2015-05-20 09:58:05 pulp_rest #20296] RestClient.delete “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207//”,
“Accept”=>"/; q=0.5, application/xml", “Accept-Encoding”=>“gzip,
deflate”, “Authorization”=>"OAuth oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108685”,
oauth_version=“1.0"”, “accept”=>“application/json”,
“content_type”=>“application/json”, “pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

2015-05-20 09:58:05 [I] Completed 200 OK in 2498ms (Views: 0.4ms |
ActiveRecord: 29.3ms)
2015-05-20 09:58:11 [I] Processing by
Katello::Api::V2::RepositoriesController#show as JSON
2015-05-20 09:58:11 [I] Parameters: {“organization_id”=>“4”,
“api_version”=>“v2”, “id”=>“33”}
The HTTP return code for pulp is 200 OK so it should be right. In
/var/log/messages, pulp has no error :
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
succeeded in 0.0470762171317s: None
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
succeeded in 0.0471452909987s: {‘details’: {}, ‘success_flag’: True,
‘summary’: ‘’}
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
succeeded in 0.0123673789203s: None
And when I use the command ‘pulp-admin puppet repo modules’, I can see
the module I uploaded.
In foreman there is a task 'Actions::Katello::Repository::UploadFiles’
which is stopped and has succeded.

I’m using foreman nightly rpms and may be there’s a mismatch between the
pulp version and foreman. I’m using pulp 2.6.0-1, is it correct ?

Thanks,

Sylvain Avril


You received this message because you are subscribed to the Google
Groups “Foreman users” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to foreman-user...@googlegroups.com.
To post to this group, send email to forema...@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.

This morning, I tried to reproduced what was not working, but this time the
upload worked with 'hammer repository upload-content'.
I tried to make a new repository without sync URL and the upload worked
also.
I couldn't reproduce the issue.

I created a new organization and a new location to put the
product/repository into, this may have solved the problem.
My installation was messy at first and I think there's was a problem with
the organisation record in the database. But this can be also because of
some other things I tried.

In my memory, I have done the following actions:

  • migration to katello nightly
  • katello-installer --upgrade
  • tried to upload, no success
  • created a new organization and location, recreated a repository with no
    sync URL
  • recreated the repo with a local folder sync URL
  • synced the repository to test it with 1 module with success
  • synced it with more modules (myne and some katello puppet modules not
    published on puppet forge)

So the problem is gone, thanks for your help.

··· -------- *Sylvain Avril *- Architecte informatique indépendant Tél: *06 28 97 02 20* / 0952 817 718 Fax: 0957 817 718 Mail: *savril@savril.fr * 17 rue Louise Pinchon / 17000 La Rochelle

2015-05-20 17:58 GMT+02:00 Eric D Helms ericdhelms@gmail.com:

Switching a 2.2 to nightly Katello and/or Foreman is not a supported path.
SInce we do not test this type of change, we can’t guarantee what may or
may not work. If you wanted nightlies, you could just install the nightly
versions directly?

Can you specify which page you are looking at exactly when trying to see
the uploaded puppet modules? There are a few places that you can view
modules so this would help to narrow the problem.

Eric

On Wed, May 20, 2015 at 11:53 AM, Sylvain Binome avrils@gmail.com wrote:

Well, that’s the recommanded way :
http://www.katello.org/docs/2.2/installation/index.html
And then I used the katello-installer.

Then I changed the katello repo to nightly by installed the nightly repo
RPM (which configure yum).
To be safe, I ran the katello-installer --upgrade .

Since my last post, I have found a method that work to publish the
module. I use pulp-puppet-module-builder to populate a local folder with my
modules and then sync a reposistory with this folder URL. It work but it is
slow and is not a nice solution but at least I can’t continue my work with
it.

But upload via CLI or Web UI doesn’t work. That really puzzle me. I’ve
done a extensive research on all that was in /var/log and didn’t found a
clue, except what I have posted before.

Le mercredi 20 mai 2015 16:33:20 UTC+2, Eric Helms a écrit :

You say you are using Katello 2.2 and Foreman nightly RPMs – how did
you get into that setup?

Eric

On Wed, May 20, 2015 at 4:10 AM, Sylvain Binome avr...@gmail.com >>> wrote:

I’ve investigated more and I found the following error in the
production.log of foreman :
2015-05-20 09:58:03 [I] Processing by
Katello::Api::V2::RepositoriesController#upload_content as HTML
2015-05-20 09:58:03 [I] Parameters:
{“content”=>[#<ActionDispatch::Http::UploadedFile:0x0000000e8dfcf8
@original_filename=“sample_module-0.0.1.tar.gz”,
@content_type=“application/gzip”, @headers=“Content-Disposition: form-data;
name=“content[]”;
filename=“sample_module-0.0.1.tar.gz”\r\nContent-Type:
application/gzip\r\n”,
@tempfile=#<File:/tmp/RackMultipart20150520-13070-15b7csh>>],
“authenticity_token”=>“XXXXXXX=”, “api_version”=>“v2”, “id”=>“33”}
[ERROR 2015-05-20 09:58:04 pulp_rest #20296] RestClient.put “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207/0//”,
2479 byte(s) length, “Accept”=>"/; q=0.5, application/xml",
“Accept-Encoding”=>“gzip, deflate”, “Authorization”=>"OAuth
oauth_body_hash=“XXXXXXX”, oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108684”,
oauth_version=“1.0"”, “Content-Length”=>“2479”,
“accept”=>“application/json”, “content_type”=>“application/json”,
“pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

[ERROR 2015-05-20 09:58:05 pulp_rest #20296] RestClient.delete “
https://foremanhost/pulp/api/v2/content/uploads/4907f75e-57d2-4e8a-81d6-d231f11f6207//”,
“Accept”=>"/; q=0.5, application/xml", “Accept-Encoding”=>“gzip,
deflate”, “Authorization”=>"OAuth oauth_consumer_key=“katello”,
oauth_nonce=“XXXXXXX”, oauth_signature=“XXXXXXX”,
oauth_signature_method=“HMAC-SHA1”, oauth_timestamp=“1432108685”,
oauth_version=“1.0"”, “accept”=>“application/json”,
“content_type”=>“application/json”, “pulp-user”=>“user-7881e1e5”

\n# => 200 OK | application/json 24 bytes

2015-05-20 09:58:05 [I] Completed 200 OK in 2498ms (Views: 0.4ms |
ActiveRecord: 29.3ms)
2015-05-20 09:58:11 [I] Processing by
Katello::Api::V2::RepositoriesController#show as JSON
2015-05-20 09:58:11 [I] Parameters: {“organization_id”=>“4”,
“api_version”=>“v2”, “id”=>“33”}
The HTTP return code for pulp is 200 OK so it should be right. In
/var/log/messages, pulp has no error :
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._queue_reserved_task[9ad47446-accc-4c7f-bd9c-bca0ee264691]
succeeded in 0.0470762171317s: None
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.strategy:INFO:
Received task:
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.managers.content.upload.import_uploaded_unit[b0a2bc09-b0a8-44b9-ae12-75eb4cbd0d10]
succeeded in 0.0471452909987s: {‘details’: {}, ‘success_flag’: True,
‘summary’: ‘’}
May 20 09:58:04 dlpmasterpoca2001 pulp: celery.worker.job:INFO: Task
pulp.server.async.tasks._release_resource[901ed2fd-ab4a-4db4-bf9c-4e2b61d33a76]
succeeded in 0.0123673789203s: None
And when I use the command ‘pulp-admin puppet repo modules’, I can see
the module I uploaded.
In foreman there is a task 'Actions::Katello::Repository::UploadFiles’
which is stopped and has succeded.

I’m using foreman nightly rpms and may be there’s a mismatch between
the pulp version and foreman. I’m using pulp 2.6.0-1, is it correct ?

Thanks,

Sylvain Avril


You received this message because you are subscribed to the Google
Groups “Foreman users” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to foreman-user...@googlegroups.com.
To post to this group, send email to forema...@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to a topic in the
Google Groups “Foreman users” group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/foreman-users/O3MtokZpurk/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.