Katello 2.4 / Foreman 1.10.1 on CentOS 7.2
My capsule synchronization never seems to complete. It gets to 75% and
then hangs indefinitely.
This is what I see when I attempt it (it will stay like this for hours
until i Ctrl-C it)
------- errors ------
[root@katello1~]# hammer -u admin -p <password> capsule content synchronize
–id 4
[…
] [75%]^
------- errors ------
If I attempt to promote content through the web interface, the synchronize
task that gets spawned fails :
------- errors ------
Host did not respond within 20 seconds. Sync has been cancelled. Is katello-agent installed and goferd running on the Host?
------- errors ------
The goferd service is defintely running :
---- troubleshooting --------
[root@katello1 ~]# systemctl | grep goferd
goferd.service
loaded active running Gofer Agent
------ troubleshooting ------
Also, I did a network capture, and there is definitely a SSL handshake
going on between the 2 servers and some data transfer, but regardless, the
content never actually shows up on the capsule :
No. Time Source Destination Protocol
Length Info
1 0.000000 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=1 Ack=1 Win=1432 Len=425 TSval=15011609
TSecr=14701871
2 0.000656 10.128.17.110 10.178.0.110 TCP
485 43052 → 5646 [PSH, ACK] Seq=1 Ack=426 Win=1424 Len=419
TSval=14702871 TSecr=15011609
3 0.000676 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=426 Ack=420 Win=1432 Len=0 TSval=15011610
TSecr=14702871
4 0.000683 10.128.17.110 10.178.0.110 TCP
140 43052 → 5646 [PSH, ACK] Seq=420 Ack=426 Win=1424 Len=74
TSval=14702872 TSecr=15011609
5 0.000688 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=426 Ack=494 Win=1432 Len=0 TSval=15011610
TSecr=14702872
6 0.000912 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=426 Ack=494 Win=1432 Len=74
TSval=15011610 TSecr=14702872
7 0.040612 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=494 Ack=500 Win=1424 Len=0 TSval=14702912
TSecr=15011610
8 1.000939 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=500 Ack=494 Win=1432 Len=425
TSval=15012610 TSecr=14702912
9 1.001197 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=494 Ack=925 Win=1424 Len=0 TSval=14703872
TSecr=15012610
10 1.001549 10.128.17.110 10.178.0.110 TCP
140 43052 → 5646 [PSH, ACK] Seq=494 Ack=925 Win=1424 Len=74
TSval=14703872 TSecr=15012610
11 1.032061 10.128.17.110 10.178.0.110 TCP
103 45857 → 5647 [PSH, ACK] Seq=1 Ack=1 Win=1424 Len=37 TSval=14703903
TSecr=15008637
12 1.032070 10.178.0.110 10.128.17.110 TCP
66 5647 → 45857 [ACK] Seq=1 Ack=38 Win=710 Len=0 TSval=15012641
TSecr=14703903
13 1.040637 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=925 Ack=568 Win=1432 Len=0 TSval=15012650
TSecr=14703872
14 2.001423 10.128.17.110 10.178.0.110 TCP
485 43052 → 5646 [PSH, ACK] Seq=568 Ack=925 Win=1424 Len=419
TSval=14704872 TSecr=15012650
15 2.001444 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=925 Ack=987 Win=1432 Len=0 TSval=15013610
TSecr=14704872
16 2.001552 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=925 Ack=987 Win=1432 Len=425
TSval=15013610 TSecr=14704872
17 2.001742 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=1350 Ack=987 Win=1432 Len=74
TSval=15013611 TSecr=14704872
18 2.002011 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=987 Ack=1424 Win=1424 Len=0 TSval=14704873
TSecr=15013610
19 2.002019 10.128.17.110 10.178.0.110 TCP
140 43052 → 5646 [PSH, ACK] Seq=987 Ack=1424 Win=1424 Len=74
TSval=14704873 TSecr=15013610
20 2.041643 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=1424 Ack=1061 Win=1432 Len=0 TSval=15013651
TSecr=14704873
21 3.002182 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=1424 Ack=1061 Win=1432 Len=425
TSval=15014611 TSecr=14704873
22 3.002605 10.128.17.110 10.178.0.110 TCP
485 43052 → 5646 [PSH, ACK] Seq=1061 Ack=1849 Win=1424 Len=419
TSval=14705873 TSecr=15014611
23 3.002623 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=1849 Ack=1480 Win=1432 Len=0 TSval=15014611
TSecr=14705873
24 3.002828 10.128.17.110 10.178.0.110 TCP
140 43052 → 5646 [PSH, ACK] Seq=1480 Ack=1849 Win=1424 Len=74
TSval=14705874 TSecr=15014611
25 3.002833 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=1849 Ack=1554 Win=1432 Len=0 TSval=15014612
TSecr=14705874
26 3.002865 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=1849 Ack=1554 Win=1432 Len=74
TSval=15014612 TSecr=14705874
27 3.042608 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=1554 Ack=1923 Win=1424 Len=0 TSval=14705914
TSecr=15014612
28 3.479979 10.178.0.110 10.128.17.110 TCP
2962 5647 → 45857 [ACK] Seq=1 Ack=38 Win=710 Len=2896 TSval=15015089
TSecr=14703903
29 3.479991 10.178.0.110 10.128.17.110 TCP
2962 5647 → 45857 [ACK] Seq=2897 Ack=38 Win=710 Len=2896 TSval=15015089
TSecr=14703903
30 3.479994 10.178.0.110 10.128.17.110 TCP
2962 5647 → 45857 [ACK] Seq=5793 Ack=38 Win=710 Len=2896 TSval=15015089
TSecr=14703903
31 3.480091 10.178.0.110 10.128.17.110 TCP
2962 5647 → 45857 [ACK] Seq=8689 Ack=38 Win=710 Len=2896 TSval=15015089
TSecr=14703903
32 3.480101 10.178.0.110 10.128.17.110 TCP
2962 5647 → 45857 [ACK] Seq=11585 Ack=38 Win=710 Len=2896 TSval=15015089
TSecr=14703903
33 3.480584 10.128.17.110 10.178.0.110 TCP
66 45857 → 5647 [ACK] Seq=38 Ack=14481 Win=1424 Len=0 TSval=14706351
TSecr=15015089
34 3.480597 10.178.0.110 10.128.17.110 TCP
2535 5647 → 45857 [PSH, ACK] Seq=14481 Ack=38 Win=710 Len=2469
TSval=15015089 TSecr=14706351
35 3.481230 10.128.17.110 10.178.0.110 TCP
66 45857 → 5647 [ACK] Seq=38 Ack=16950 Win=1424 Len=0 TSval=14706352
TSecr=15015089
36 3.482661 10.128.17.110 10.178.0.110 TCP
220 45857 → 5647 [PSH, ACK] Seq=38 Ack=16950 Win=1424 Len=154
TSval=14706354 TSecr=15015089
37 3.482671 10.178.0.110 10.128.17.110 TCP
66 5647 → 45857 [ACK] Seq=16950 Ack=192 Win=733 Len=0 TSval=15015092
TSecr=14706354
38 3.484424 10.178.0.110 10.128.17.110 TCP
232 5647 → 45857 [PSH, ACK] Seq=16950 Ack=192 Win=733 Len=166
TSval=15015093 TSecr=14706354
39 3.485299 10.128.17.110 10.178.0.110 TCP
468 45857 → 5647 [PSH, ACK] Seq=192 Ack=17116 Win=1424 Len=402
TSval=14706356 TSecr=15015093
40 3.485985 10.178.0.110 10.128.17.110 TCP
131 5647 → 45857 [PSH, ACK] Seq=17116 Ack=594 Win=755 Len=65
TSval=15015095 TSecr=14706356
41 3.525616 10.128.17.110 10.178.0.110 TCP
66 45857 → 5647 [ACK] Seq=594 Ack=17181 Win=1424 Len=0 TSval=14706397
TSecr=15015095
42 4.002777 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=1923 Ack=1554 Win=1432 Len=425
TSval=15015612 TSecr=14705914
43 4.003036 10.128.17.110 10.178.0.110 TCP
485 43052 → 5646 [PSH, ACK] Seq=1554 Ack=1923 Win=1424 Len=419
TSval=14706874 TSecr=15014612
44 4.003043 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=1973 Ack=2348 Win=1424 Len=0 TSval=14706874
TSecr=15015612
45 4.003482 10.128.17.110 10.178.0.110 TCP
140 43052 → 5646 [PSH, ACK] Seq=1973 Ack=2348 Win=1424 Len=74
TSval=14706874 TSecr=15015612
46 4.003552 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=2348 Ack=2047 Win=1432 Len=0 TSval=15015612
TSecr=14706874
47 4.003750 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=2348 Ack=2047 Win=1432 Len=74
TSval=15015613 TSecr=14706874
48 4.043644 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=2047 Ack=2422 Win=1424 Len=0 TSval=14706915
TSecr=15015613
49 4.076622 10.178.0.110 10.128.17.110 TCP
133 5647 → 45857 [PSH, ACK] Seq=17181 Ack=594 Win=755 Len=67
TSval=15015685 TSecr=14706397
50 4.076864 10.128.17.110 10.178.0.110 TCP
66 45857 → 5647 [ACK] Seq=594 Ack=17248 Win=1424 Len=0 TSval=14706948
TSecr=15015685
51 4.078152 10.128.17.110 10.178.0.110 TCP
119 45857 → 5647 [PSH, ACK] Seq=594 Ack=17248 Win=1424 Len=53
TSval=14706949 TSecr=15015685
52 4.078234 10.178.0.110 10.128.17.110 TCP
119 5647 → 45857 [PSH, ACK] Seq=17248 Ack=647 Win=755 Len=53
TSval=15015687 TSecr=14706949
53 4.082247 10.128.17.110 10.178.0.110 TCP
172 45857 → 5647 [PSH, ACK] Seq=647 Ack=17301 Win=1424 Len=106
TSval=14706953 TSecr=15015687
54 4.121634 10.178.0.110 10.128.17.110 TCP
66 5647 → 45857 [ACK] Seq=17301 Ack=753 Win=755 Len=0 TSval=15015731
TSecr=14706953
55 5.003648 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=2422 Ack=2047 Win=1432 Len=425
TSval=15016613 TSecr=14706915
56 5.003926 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=2047 Ack=2847 Win=1424 Len=0 TSval=14707875
TSecr=15016613
57 5.004452 10.128.17.110 10.178.0.110 TCP
530 43052 → 5646 [PSH, ACK] Seq=2047 Ack=2847 Win=1424 Len=464
TSval=14707875 TSecr=15016613
58 5.004702 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=2847 Ack=2511 Win=1432 Len=74
TSval=15016614 TSecr=14707875
59 5.044893 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=2511 Ack=2921 Win=1424 Len=0 TSval=14707916
TSecr=15016614
60 6.005076 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=2921 Ack=2511 Win=1432 Len=425
TSval=15017614 TSecr=14707916
61 6.005370 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=2511 Ack=3346 Win=1424 Len=0 TSval=14708876
TSecr=15017614
62 6.005714 10.128.17.110 10.178.0.110 TCP
530 43052 → 5646 [PSH, ACK] Seq=2511 Ack=3346 Win=1424 Len=464
TSval=14708877 TSecr=15017614
63 6.005929 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=3346 Ack=2975 Win=1432 Len=74
TSval=15017615 TSecr=14708877
64 6.045606 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=2975 Ack=3420 Win=1424 Len=0 TSval=14708917
TSecr=15017615
65 7.005640 10.128.17.110 10.178.0.110 TCP
485 43052 → 5646 [PSH, ACK] Seq=2975 Ack=3420 Win=1424 Len=419
TSval=14709877 TSecr=15017615
66 7.006071 10.178.0.110 10.128.17.110 TCP
536 5646 → 43052 [PSH, ACK] Seq=3420 Ack=3394 Win=1432 Len=470
TSval=15018615 TSecr=14709877
67 7.006273 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=3394 Ack=3890 Win=1424 Len=0 TSval=14709877
TSecr=15018615
68 7.006534 10.128.17.110 10.178.0.110 TCP
140 43052 → 5646 [PSH, ACK] Seq=3394 Ack=3890 Win=1424 Len=74
TSval=14709877 TSecr=15018615
69 7.045642 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=3890 Ack=3468 Win=1432 Len=0 TSval=15018655
TSecr=14709877
70 8.006236 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=3890 Ack=3468 Win=1432 Len=425
TSval=15019615 TSecr=14709877
71 8.007656 10.128.17.110 10.178.0.110 TCP
530 43052 → 5646 [PSH, ACK] Seq=3468 Ack=4315 Win=1424 Len=464
TSval=14710878 TSecr=15019615
72 8.007668 10.178.0.110 10.128.17.110 TCP
66 5646 → 43052 [ACK] Seq=4315 Ack=3932 Win=1432 Len=0 TSval=15019617
TSecr=14710878
73 8.007899 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=4315 Ack=3932 Win=1432 Len=74
TSval=15019617 TSecr=14710878
74 8.047677 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=3932 Ack=4389 Win=1424 Len=0 TSval=14710919
TSecr=15019617
75 8.086902 10.128.17.110 10.178.0.110 TCP
103 45857 → 5647 [PSH, ACK] Seq=753 Ack=17301 Win=1424 Len=37
TSval=14710958 TSecr=15015731
76 8.086919 10.178.0.110 10.128.17.110 TCP
66 5647 → 45857 [ACK] Seq=17301 Ack=790 Win=755 Len=0 TSval=15019696
TSecr=14710958
77 9.007011 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=4389 Ack=3932 Win=1432 Len=425
TSval=15020616 TSecr=14710919
78 9.007473 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=3932 Ack=4814 Win=1424 Len=0 TSval=14711878
TSecr=15020616
79 9.008270 10.128.17.110 10.178.0.110 TCP
530 43052 → 5646 [PSH, ACK] Seq=3932 Ack=4814 Win=1424 Len=464
TSval=14711879 TSecr=15020616
80 9.008459 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=4814 Ack=4396 Win=1432 Len=74
TSval=15020617 TSecr=14711879
81 9.048720 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=4396 Ack=4888 Win=1424 Len=0 TSval=14711920
TSecr=15020617
82 10.007365 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=4888 Ack=4396 Win=1432 Len=425
TSval=15021616 TSecr=14711920
83 10.007704 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=4396 Ack=5313 Win=1424 Len=0 TSval=14712878
TSecr=15021616
84 10.008836 10.128.17.110 10.178.0.110 TCP
530 43052 → 5646 [PSH, ACK] Seq=4396 Ack=5313 Win=1424 Len=464
TSval=14712880 TSecr=15021616
85 10.009095 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH, ACK] Seq=5313 Ack=4860 Win=1432 Len=74
TSval=15021618 TSecr=14712880
86 10.224636 10.178.0.110 10.128.17.110 TCP
140 [TCP Retransmission] 5646 → 43052 [PSH, ACK] Seq=5313 Ack=4860
Win=1432 Len=74 TSval=15021834 TSecr=14712880
87 10.224968 10.128.17.110 10.178.0.110 TCP
78 43052 → 5646 [ACK] Seq=4860 Ack=5387 Win=1424 Len=0 TSval=14713096
TSecr=15021834 SLE=5313 SRE=5387
88 11.008404 10.178.0.110 10.128.17.110 TCP
491 5646 → 43052 [PSH, ACK] Seq=5387 Ack=4860 Win=1432 Len=425
TSval=15022617 TSecr=14713096
89 11.009072 10.128.17.110 10.178.0.110 TCP
66 43052 → 5646 [ACK] Seq=4860 Ack=5812 Win=1424 Len=0 TSval=14713880
TSecr=15022617
90 11.009568 10.128.17.110 10.178.0.110 TCP
530 43052 → 5646 [PSH, ACK] Seq=4860 Ack=5812 Win=1424 Len=464
TSval=14713880 TSecr=15022617
91 11.009777 10.178.0.110 10.128.17.110 TCP
140 5646 → 43052 [PSH,