Foreman 3.17.0 and Katello 4.19.0 - Proxy Task and sync status out of sync/stuck

Support
1

Problem: The Proxy Status sync doest update, it get stuck

Expected outcome: Proxy sync job and actual status task expected to sync

Foreman and Proxy versions: Foreman 3.17.0, Proxy 3.17.0, Katello 4.19.0

Foreman and Proxy plugin versions: 3.17.0

Distribution and version: RHEL 9.6

Other relevant data:

After performing the upgrade to foreman 3.17.0 and katello 4.19.0, I have observed that the proxies status are getting stuck at less than 50%, but the sync task is completing correctly. I am guessing this is some sort of bug in the sync process. Is there any way tot roubleshot this o a workaround to get the sync status sync with the actual task status. See reference below

Foreman_Proxy_Sync_Status
Foreman_Proxy_Sync_Status3356×1177 128 KB

Foreman_Sync_Task
Foreman_Sync_Task2550×1038 80.6 KB

2

See below, it looks like the proxy completed synching fine, yet the actual status bar remains not finish and/or stuck.

proxy_sync_status_out
proxy_sync_status_out1722×744 33.4 KB

3

Hi @jeremylenz /@ekohl , any ideas about this issue? Thank you in advance for the input.

4

What does the Dynflow console show? Any errors?

@sajha knows more about smart proxy syncs than me..

5

Hi @jeremylenz , thank you for the quick reply. I see the following under the dynflow console:

image
image1052×653 92.2 KB

6

Hi @sajha , any idea on what might be causing this issue as it relates to sync status for proxies?

7

I see this as a UI-only issue here with status saying “Synchronized” on Capsule page while the sync task is in progress. That shouldn’t cause any issues with your content workflows as long as the sync itself completes successfully.

Can you make sure all Capsule sync tasks are succeeding and running?

8

The task progress bar provides a more accurate representation of the sync status compared to the “Smart proxy is synchronized” text. If you see the progress bar, that means an active sync is currently running on the capsule.

9

Hi @sajha , thank you for the reply. Yes the synchronization is happening without issues, but is now to have the status bar working. I always keep an eye on that status bar, not urgent but it would be nice to get this working in the next lifecycle patch/release. Thoughts ?

10

Hi @sajha , The challenge remains the status bar gets stuck and never completes….but the task itself does complete without issues, I suspect this is bug somewhere that need further review/investigation. PLease advise on direction.

11

What is the state of the task you land on when you click on the progress bar? Does it take you to to completed task?

12

Looking at the page, there are 2 tasks that present the progress bar on the capsule page:

  1. Sync task
  2. Reclaim Space task
    We should also check if there are any pending reclaim space tasks running on the capsule.
13

Hi @sajha , yes….it takes me to the complete task. But the status bar remains uncompleted, forever…..

14

My hunch is there is a stuck granular sync task aka CV or Repo sync triggered task or a reclaim space task running against the capsule. The UI is showing the data it gets from the API at the endpoint server_url/katello/api/v2/capsules/"capsule_id"/content/sync which has this key: active_sync_tasks which shows up as the progress bar. You could try looking at what you see in that and get to the task it is pointing to if that helps.