Exception when talking to remote client

Greetings all,

I was doing some cleanup recently that consisted of removing some old

content views I'm no longer using. It appears that I broke something
in the process. Now, when I try to go to Hosts -> Content Hosts, it
spins on the Loading screen. The very long error below appears in the
/var/log/foreman/production.log file.

Has anyone seen this before?  Any idea what's going on here and how

to fix it?

Thanks!

2015-09-01 17:42:23 [app] [I]
>
> Started GET
"/katello/api/v2/systems?organization_id=3&page=1&search=&sort_by=name&s
ort_order=ASC"
for 172.17.1.85 at 2015-09-01 17:42:23 -0400
2015-09-01 17:42:23 [app] [I] Processing by
Katello::Api::V2::SystemsController#index as JSON
2015-09-01 17:42:23 [app] [I] Parameters: {"organization_id"=>"3",
"page"=>"1", "search"=>"", "sort_by"=>"name", "sort_order"=>"ASC",
"api_version"=>"v2"}
2015-09-01 17:42:23 [app] [I]
>
> Started GET
"/assets/bastion/font-awesome//fontawesome-webfont.woff?v=4.2.0" for
172.17.1.85 at 2015-09-01 17:42:23 -0400
2015-09-01 17:42:23 [app] [E] Failed to retrieve all Katello::System
search results (20/20 found.)
2015-09-01 17:42:23 [app] [I] Rendered
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/views/katello
/api/v2/systems/index.json.rabl
within katello/api/v2/layouts/collection (53.5ms)
2015-09-01 17:42:23 [app] [E] exception when talking to a remote
client: Katello::Resources::Candlepin::Consumer: 410 Gone
{"displayMessage":"Unit 990255a9-8089-4de5-8be3-a1bbdf9fedca has been
deleted","requestUuid":"04573f36-8f10-4152-948f-eea1fdc61fc9","deletedId
":"990255a9-8089-4de5-8be3-a1bbdf9fedca"}
(GET /candlepin/consumers/990255a9-8089-4de5-8be3-a1bbdf9fedca)
RestClient::Gone: Katello::Resources::Candlepin::Consumer: 410 Gone
{"displayMessage":"Unit 990255a9-8089-4de5-8be3-a1bbdf9fedca has been
deleted","requestUuid":"04573f36-8f10-4152-948f-eea1fdc61fc9","deletedId
":"990255a9-8089-4de5-8be3-a1bbdf9fedca"}
(GET /candlepin/consumers/990255a9-8089-4de5-8be3-a1bbdf9fedca)
> Body: {"displayMessage":"Unit 990255a9-8089-4de5-8be3-a1bbdf9fedca
has been
deleted","requestUuid":"04573f36-8f10-4152-948f-eea1fdc61fc9","deletedId
":"990255a9-8089-4de5-8be3-a1bbdf9fedca"}
>
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien
t/abstract_response.rb:48:in
return!' > /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien t/request.rb:230:inprocess_result'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.35/lib/restclient_e
xt/request.rb:50:in
block in transmit' > /opt/rh/ruby193/root/usr/share/ruby/net/http.rb:746:instart'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.35/lib/restclient_e
xt/request.rb:44:in
transmit' > /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien t/request.rb:64:inexecute'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien
t/request.rb:33:in
execute' > /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien t/resource.rb:51:inget'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/h
ttp_resource.rb:84:in
get' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/r esources/candlepin.rb:99:inget'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/models/katell
o/glue/candlepin/consumer.rb:25:in
block (2 levels) in included' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l azy_accessor.rb:163:ininstance_eval'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:163:in
run_initializer' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l azy_accessor.rb:142:inlazy_attribute_get'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:62:in
block (2 levels) in lazy_accessor' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l azy_accessor.rb:163:ininstance_eval'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:163:in
run_initializer' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l azy_accessor.rb:142:inlazy_attribute_get'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:62:in
block (2 levels) in lazy_accessor' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/models/katell o/glue/candlepin/consumer.rb:237:indistribution_name'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/models/katell
o/glue/candlepin/consumer.rb:245:in
distribution' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/helpers.rb :20:indata_object_attribute'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:140:in
attribute' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :114:inblock in compile_settings'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:113:in
each' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :113:incompile_settings'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:53:in
block in to_hash' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :248:incache_results'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:49:in
to_hash' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb: 86:into_hash'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
48:in
block in render' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb: 382:incache_results'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
47:in
render' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :127:inblock in merge_engines_into_result'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:119:in
each' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :119:inmerge_engines_into_result'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:55:in
block in to_hash' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :248:incache_results'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:49:in
to_hash' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/multi_buil der.rb:27:inmap'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/multi_buil
der.rb:27:in
to_a' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb: 88:into_hash'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
48:in
block in render' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb: 382:incache_results'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
47:in
render' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :124:inblock (2 levels) in merge_engines_into_result'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:123:in
each' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :123:inblock in merge_engines_into_result'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:119:in
each' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :119:inmerge_engines_into_result'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:55:in
block in to_hash' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb :248:incache_results'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:49:in
to_hash' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb: 86:into_hash'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
101:in
to_dumpable' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb: 110:into_json'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
48:in
block in render' > /opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb: 382:incache_results'
>
/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
47:in
render' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/views/katello /api/v2/systems/index.json.rabl:1:inopt_rh_ruby____root_usr_share_gems_gems_katello_______app_views_katel
lo_api_v__systems_index_json_rabl___2916583999245977695_128906540'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/template.rb:145:in
block in render' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/notifications.rb:125:ininstrument'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/template.rb:143:in
render' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie w/renderer/template_renderer.rb:47:inblock (2 levels) in render_template'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/abstract_renderer.rb:38:in
block in instrument' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/notifications.rb:123:inblock in instrument'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/notifications/instrumenter.rb:20:in
instrument' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/notifications.rb:123:ininstrument'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/abstract_renderer.rb:38:in
instrument' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie w/renderer/template_renderer.rb:46:inblock in render_template'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/template_renderer.rb:54:in
render_with_layout' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie w/renderer/template_renderer.rb:45:inrender_template'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/template_renderer.rb:18:in
render' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie w/renderer/renderer.rb:36:inrender_template'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/renderer.rb:17:in
render' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c ontroller/rendering.rb:110:inrender_template'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/streaming.rb:225:in
_render_template' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c ontroller/rendering.rb:103:inrender_to_body'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/renderers.rb:28:in
render_to_body' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con troller/metal/compatibility.rb:50:inrender_to_body'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/rendering.rb:88:in
render' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con troller/metal/rendering.rb:16:inrender'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/instrumentation.rb:40:in
block (2 levels) in render' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/core_ext/benchmark.rb:5:inblock in ms'
> /opt/rh/ruby193/root/usr/share/ruby/benchmark.rb:295:in realtime' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/core_ext/benchmark.rb:5:inms'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/instrumentation.rb:40:in
block in render' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con troller/metal/instrumentation.rb:83:incleanup_view_runtime'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_r
ecord/railties/controller_runtime.rb:24:in
cleanup_view_runtime' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con troller/metal/instrumentation.rb:39:inrender'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a
pi/v2/rendering.rb:48:in
respond_with_template' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a pi/v2/rendering.rb:63:inrespond_with_template_collection'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a
pi/v2/rendering.rb:76:in
try_specific_collection_template' > /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a pi/v2/rendering.rb:11:inrespond_for_index'
>
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/controllers/k
atello/api/v2/systems_controller.rb:92:in
index' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con troller/metal/implicit_render.rb:4:insend_action'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/base.rb:167:in
process_action' > /opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con troller/metal/rendering.rb:10:inprocess_action'
>
/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/callbacks.rb:18:in
block in process_action' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:595:inblock (5 levels) in
run__376552264904071017__process_action__1371562488298702952__callbacks
'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/callbacks.rb:215:in
block in _conditional_callback_around_11522' > /usr/share/foreman/app/controllers/api/v2/base_controller.rb:151:indisable_json_root'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/callbacks.rb:214:in
_conditional_callback_around_11522' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:528:inblock (4 levels) in
run__376552264904071017__process_action__1371562488298702952__callbacks
'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/callbacks.rb:215:in
block in _conditional_callback_around_11521' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:326:inaround'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/callbacks.rb:310:in
_callback_around_4210' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:214:inconditional_callback_around_11521'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/callbacks.rb:516:in
block (3 levels) in _run__376552264904071017__process_action__1371562488298702952__callbacks ' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:215:inblock in _conditional_callback_around_11520'
>
/usr/share/foreman/app/controllers/concerns/application_shared.rb:13:in
set_timezone' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:214:inconditional_callback_around_11520'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/callbacks.rb:515:in
block (2 levels) in _run__376552264904071017__process_action__1371562488298702952__callbacks ' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:215:inblock in _conditional_callback_around_11519'
>
/usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in
clear_thread' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:214:inconditional_callback_around_11519'
>
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active

support/callbacks.rb:448:in
block in _run__376552264904071017__process_action__1371562488298702952__callbacks ' > /opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_ support/callbacks.rb:215:inblock in _conditional_callback_around_11518'
>
/opt/r

The content views that you cleaned up, were any of them composites?

You can run 'foreman-rake katello:clean_backend_objects' to clear up this
mismatch between Katello's data and Candlepins.

··· On Tue, Sep 1, 2015 at 5:47 PM, Jason 'XenoPhage' Frisvold < xenophage@godshell.com> wrote:

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Greetings all,

    I was doing some cleanup recently that consisted of removing some

old
content views I’m no longer using. It appears that I broke something
in the process. Now, when I try to go to Hosts -> Content Hosts, it
spins on the Loading screen. The very long error below appears in the
/var/log/foreman/production.log file.

    Has anyone seen this before?  Any idea what's going on here and how

to fix it?

Thanks!

2015-09-01 17:42:23 [app] [I]

Started GET
"/katello/api/v2/systems?organization_id=3&page=1&search=&sort_by=name&s
ort_order=ASC"
for 172.17.1.85 at 2015-09-01 17:42:23 -0400
2015-09-01 17:42:23 [app] [I] Processing by
Katello::Api::V2::SystemsController#index as JSON
2015-09-01 17:42:23 [app] [I] Parameters: {“organization_id”=>“3”,
“page”=>“1”, “search”=>"", “sort_by”=>“name”, “sort_order”=>“ASC”,
“api_version”=>“v2”}
2015-09-01 17:42:23 [app] [I]

Started GET
"/assets/bastion/font-awesome//fontawesome-webfont.woff?v=4.2.0" for
172.17.1.85 at 2015-09-01 17:42:23 -0400
2015-09-01 17:42:23 [app] [E] Failed to retrieve all Katello::System
search results (20/20 found.)
2015-09-01 17:42:23 [app] [I] Rendered
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/views/katello
/api/v2/systems/index.json.rabl
within katello/api/v2/layouts/collection (53.5ms)
2015-09-01 17:42:23 [app] [E] exception when talking to a remote
client: Katello::Resources::Candlepin::Consumer: 410 Gone
{“displayMessage”:“Unit 990255a9-8089-4de5-8be3-a1bbdf9fedca has been
deleted”,“requestUuid”:“04573f36-8f10-4152-948f-eea1fdc61fc9”,“deletedId
”:“990255a9-8089-4de5-8be3-a1bbdf9fedca”}
(GET /candlepin/consumers/990255a9-8089-4de5-8be3-a1bbdf9fedca)
RestClient::Gone: Katello::Resources::Candlepin::Consumer: 410 Gone
{“displayMessage”:“Unit 990255a9-8089-4de5-8be3-a1bbdf9fedca has been
deleted”,“requestUuid”:“04573f36-8f10-4152-948f-eea1fdc61fc9”,“deletedId
”:“990255a9-8089-4de5-8be3-a1bbdf9fedca”}
(GET /candlepin/consumers/990255a9-8089-4de5-8be3-a1bbdf9fedca)
Body: {“displayMessage”:“Unit 990255a9-8089-4de5-8be3-a1bbdf9fedca
has been
deleted”,“requestUuid”:“04573f36-8f10-4152-948f-eea1fdc61fc9”,“deletedId
”:“990255a9-8089-4de5-8be3-a1bbdf9fedca”}

/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien
t/abstract_response.rb:48:in
`return!’

/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien
t/request.rb:230:in
`process_result’

/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.35/lib/restclient_e
xt/request.rb:50:in
`block in transmit’

/opt/rh/ruby193/root/usr/share/ruby/net/http.rb:746:in `start’

/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.35/lib/restclient_e
xt/request.rb:44:in
`transmit’

/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien
t/request.rb:64:in
`execute’

/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien
t/request.rb:33:in
`execute’

/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclien
t/resource.rb:51:in
`get’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/h
ttp_resource.rb:84:in
`get’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/r
esources/candlepin.rb:99:in
`get’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/models/katell
o/glue/candlepin/consumer.rb:25:in
`block (2 levels) in included’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:163:in
`instance_eval’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:163:in
`run_initializer’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:142:in
`lazy_attribute_get’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:62:in
`block (2 levels) in lazy_accessor’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:163:in
`instance_eval’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:163:in
`run_initializer’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:142:in
`lazy_attribute_get’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/l
azy_accessor.rb:62:in
`block (2 levels) in lazy_accessor’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/models/katell
o/glue/candlepin/consumer.rb:237:in
`distribution_name’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/models/katell
o/glue/candlepin/consumer.rb:245:in
`distribution’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/helpers.rb
:20:in
`data_object_attribute’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:140:in
`attribute’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:114:in
`block in compile_settings’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:113:in
`each’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:113:in
`compile_settings’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:53:in
`block in to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:248:in
`cache_results’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:49:in
`to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
86:in
`to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
48:in
`block in render’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
382:in
`cache_results’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
47:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:127:in
`block in merge_engines_into_result’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:119:in
`each’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:119:in
`merge_engines_into_result’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:55:in
`block in to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:248:in
`cache_results’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:49:in
`to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/multi_buil
der.rb:27:in
`map’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/multi_buil
der.rb:27:in
`to_a’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
88:in
`to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
48:in
`block in render’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
382:in
`cache_results’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
47:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:124:in
`block (2 levels) in merge_engines_into_result’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:123:in
`each’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:123:in
`block in merge_engines_into_result’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:119:in
`each’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:119:in
`merge_engines_into_result’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:55:in
`block in to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:248:in
`cache_results’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/builder.rb
:49:in
`to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
86:in
`to_hash’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
101:in
`to_dumpable’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
110:in
`to_json’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
48:in
`block in render’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
382:in
`cache_results’

/opt/rh/ruby193/root/usr/share/gems/gems/rabl-0.11.6/lib/rabl/engine.rb:
47:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/views/katello
/api/v2/systems/index.json.rabl:1:in
`__opt_rh_ruby____root_usr_share_gems_gems_katello_______app_views_katel
lo_api_v__systems_index_json_rabl___2916583999245977695_128906540’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/template.rb:145:in
`block in render’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/notifications.rb:125:in
`instrument’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/template.rb:143:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/template_renderer.rb:47:in
`block (2 levels) in render_template’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/abstract_renderer.rb:38:in
`block in instrument’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/notifications.rb:123:in
`block in instrument’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/notifications/instrumenter.rb:20:in
`instrument’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/notifications.rb:123:in
`instrument’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/abstract_renderer.rb:38:in
`instrument’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/template_renderer.rb:46:in
`block in render_template’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/template_renderer.rb:54:in
`render_with_layout’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/template_renderer.rb:45:in
`render_template’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/template_renderer.rb:18:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/renderer.rb:36:in
`render_template’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_vie
w/renderer/renderer.rb:17:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/rendering.rb:110:in
`_render_template’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/streaming.rb:225:in
`_render_template’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/rendering.rb:103:in
`render_to_body’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/renderers.rb:28:in
`render_to_body’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/compatibility.rb:50:in
`render_to_body’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/rendering.rb:88:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/rendering.rb:16:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/instrumentation.rb:40:in
`block (2 levels) in render’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/core_ext/benchmark.rb:5:in
`block in ms’

/opt/rh/ruby193/root/usr/share/ruby/benchmark.rb:295:in `realtime’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/core_ext/benchmark.rb:5:in
`ms’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/instrumentation.rb:40:in
`block in render’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/instrumentation.rb:83:in
`cleanup_view_runtime’

/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_r
ecord/railties/controller_runtime.rb:24:in
`cleanup_view_runtime’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/instrumentation.rb:39:in
`render’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a
pi/v2/rendering.rb:48:in
`respond_with_template’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a
pi/v2/rendering.rb:63:in
`respond_with_template_collection’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a
pi/v2/rendering.rb:76:in
`try_specific_collection_template’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/lib/katello/a
pi/v2/rendering.rb:11:in
`respond_for_index’

/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.3.0/app/controllers/k
atello/api/v2/systems_controller.rb:92:in
`index’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/implicit_render.rb:4:in
`send_action’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/base.rb:167:in
`process_action’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_con
troller/metal/rendering.rb:10:in
`process_action’

/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_c
ontroller/callbacks.rb:18:in
`block in process_action’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:595:in
`block (5 levels) in
_run__376552264904071017__process_action__1371562488298702952__callbacks

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:215:in
`block in _conditional_callback_around_11522’

/usr/share/foreman/app/controllers/api/v2/base_controller.rb:151:in
`disable_json_root’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:214:in
`_conditional_callback_around_11522’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:528:in
`block (4 levels) in
_run__376552264904071017__process_action__1371562488298702952__callbacks

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:215:in
`block in _conditional_callback_around_11521’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:326:in
`around’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:310:in
`_callback_around_4210’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:214:in
`_conditional_callback_around_11521’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:516:in
`block (3 levels) in
_run__376552264904071017__process_action__1371562488298702952__callbacks

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:215:in
`block in _conditional_callback_around_11520’

/usr/share/foreman/app/controllers/concerns/application_shared.rb:13:in
`set_timezone’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:214:in
`_conditional_callback_around_11520’

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callbacks.rb:515:in
`block (2 levels) in
_run__376552264904071017__process_action__1371562488298702952__callbacks

/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_
support/callb

> The content views that you cleaned up, were any of them
> composites?

Yup, it was the composite that I think caused the problems… That one
is stuck with an error at the moment :

"Cannot delete record because of dependent hosts"

> You can run 'foreman-rake katello:clean_backend_objects' to clear
> up this mismatch between Katello's data and Candlepins.

Ok, lots of output about partially missing hosts and that they were
cleaned. So now I can get to the content hosts list, but there only 4
hosts showing now. There were 24.

I still can't complete the content view deletion either. It's at
100%, but in an error state. Resume just drops back to error.



Jason 'XenoPhage' Frisvold
xenophage@godshell.com


"Any sufficiently advanced magic is indistinguishable from technology."

    • Niven's Inverse of Clarke's Third Law
··· On 9/3/15 07:39, Eric D Helms wrote: