Problem:
All of sudden im facing below issue.
Organization Delete:
Oops, we’re sorry but something went wrong There was an issue with the backend service pulp3: 503 Service Unavailable
Repo Sync:
A smart proxy seems to have been refreshed without pulpcore being running. You may want to
Additional Logs
2020-06-03T23:00:55 [W|app|] Creating scope :completer_scope. Overwriting existing method Location.completer_scope.
2020-06-03T23:00:56 [W|app|] 503 Service Unavailable
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:223:in exception_with_response' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:103:in return!’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:809:in process_result' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:725:in block in transmit’
/opt/rh/rh-ruby25/root/usr/share/ruby/net/http.rb:910:in start' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in transmit’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in execute' /opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in execute’
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/resource.rb:51:in get' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.1.1/app/models/katello/ping.rb:227:in backend_status’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.1.1/app/models/katello/ping.rb:184:in pulp3_without_auth' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.1.1/app/models/katello/ping.rb:74:in block in ping_pulp3_without_auth’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.1.1/app/models/katello/ping.rb:136:in exception_watch' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.1.1/app/models/katello/ping.rb:73:in ping_pulp3_without_auth’
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.1.1/app/models/katello/ping.rb:22:in ping' /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.15.1.1/lib/katello/tasks/reimport.rake:7:in block (2 levels) in <top (required)>’
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:251:in block in execute' /opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:251:in each’
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:251:in execute' /opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:195:in block in invoke_with_call_chain’
/opt/rh/rh-ruby25/root/usr/share/ruby/monitor.rb:226:in mon_synchronize' /opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:188:in invoke_with_call_chain’
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:217:in block in invoke_prerequisites' /opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:215:in each’
/opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:215:in invoke_prerequisites' /opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:194:in block in invoke_with_call_chain’
/opt/rh/rh-ruby25/root/usr/share/ruby/monitor.rb:226:in mon_synchronize' /opt/rh/rh-ruby25/root/usr/share/gems/gems/rake-12.3.0/lib/rake/task.rb:188:in invoke_with_call_chain’
see anything interesting with:
journalctl -u pulpcore-api
Did you find the problem/solution to this?
Hey @jmskone,
Can you check status of and try restarting the pulpcore-api service? Also an output for journalctl -u pulpcore-api will be helpful to debug.
Thanks,
Samir Jha
I am also experiencing this. I can neither sync nor add repositories.
Foreman 2.0.1-1
Katello 3.15.3-1
python3-pulpcore 3.0.1-2
@poulterer : Do you have any logs from this system. Also, Katello 3.16 is now released. I would suggest upgrading and running with the updated pulpcore that comes with 3.16.
@sajha — I resolved this issue and forgot to update. After reading this post, I found a pip-installed Redis 3.4.1 on my system. After removing it, everything worked. We will upgrade in the near future. Thanks.
@poulterer: Thanks for the update. Pulpcore 3.5 that ships with Katello 3.16 installs redis 3.5.3 so the issue shouldn’t appear again upon upgrade.