Foreman tasks not proceeding

I have a number of tasks queued under foreman tasks that are in stuck in Stopped State and Pending Results
(E.g. Create RSS notifications, Clean up StoredValues…)

New tasks (E.g. Running of Ansible Command through remote job invocation) would end up with “Status ?N/A” within job_invocation UI page and show up as planned state and pending result.

Foreman and Proxy versions:
Foreman 2.1.4
Katello 3.16

Other relevant data:

  1. I have tried running foreman-rake foreman-tasks:cleanup to clear the queue but it doesn’t help.
  2. Running hammer ping shows all services including foreman-tasks are [ok]
  3. I have an issue with Pulp redis connection issue at that I can’t resolve.

Would anyone be able to share on how I may try to debug or know of any remedy. Feel free to let me know if there are any logs that are worth looking into.

what does the output of systemctl status 'dynflow-sidekiq@*' say? You could also try checking the sidekiq console $foreman_url/foreman_tasks/sidekiq to see if there are any jobs piling up.