Redhat Repository 403: [('PEM routines', '', 'no start line') Error

eyupguner · August 22, 2024, 5:10pm

Problem: Redhat Repository 403: [(‘PEM routines’, ‘’, ‘no start line’) Error

Expected outcome: Success yum update

Foreman and Proxy versions: 3.11

Foreman and Proxy plugin versions: 3.11

Distribution and version: 3.11

Other relevant data:

I have downloaded redhat manifet from redhat customer portal and import my foreman sever. I created redhat repository successfuly and provised with activation key. I can see in content host successfuly but yum update command return following error but curl test with debug certficate is succes. I check certguard ca and other certificates but ı cant find any clue what is the problem. Can you help me ?

Curl test with debug cert is success.

Red Hat Enterprise Linux 8 for x86_64 - BaseOS (RPMs) 777 B/s | 73 B 00:00
Errors during downloading metadata for repository ‘rhel-8-for-x86_64-baseos-rpms’:

Status code: 403 for https://hqfrmn.xxx.xxx/pulp/content/HQ/rhel8/rhel8/content/dist/rhel8/8/x86_64/baseos/os/repodata/repomd.xml
Error: Failed to download metadata for repo ‘rhel-8-for-x86_64-baseos-rpms’: Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried

repo_error1570×187 57.5 KB

jeremylenz · August 22, 2024, 5:37pm

What version of Candlepin do you have?

What do you see in /var/log/candlepin/error.log on the server?

eyupguner · August 23, 2024, 5:12am

Hi Jeremylenz,

Here the log.

2024-08-22 05:02:49,461 [thread=main] [=, org=, csid=] WARN org.hibernate.id.UUIDHexGenerator - HHH000409: Using org.hibernate.id.UUIDHexGenerator which does not generate IETF RFC 4122 compliant UUID values; consider using org.hibernate.id.UUIDGenerator instead
2024-08-22 05:02:49,641 [thread=main] [=, org=, csid=] WARN org.hibernate.mapping.RootClass - HHH000038: Composite-id class does not override equals(): org.candlepin.model.PoolAttribute
2024-08-22 05:02:49,641 [thread=main] [=, org=, csid=] WARN org.hibernate.mapping.RootClass - HHH000039: Composite-id class does not override hashCode(): org.candlepin.model.PoolAttribute
2024-08-22 05:02:52,919 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222165: No Dead Letter Address configured for queue event.org.candlepin.audit.LoggingListener in AddressSettings
2024-08-22 05:02:52,920 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222166: No Expiry Address configured for queue event.org.candlepin.audit.LoggingListener in AddressSettings
2024-08-22 05:02:52,950 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222165: No Dead Letter Address configured for queue event.org.candlepin.audit.ActivationListener in AddressSettings
2024-08-22 05:02:52,950 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222166: No Expiry Address configured for queue event.org.candlepin.audit.ActivationListener in AddressSettings
2024-08-22 05:02:52,951 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222165: No Dead Letter Address configured for queue katello_candlepin_event_monitor.candlepin_events in AddressSettings
2024-08-22 05:02:52,951 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222166: No Expiry Address configured for queue katello_candlepin_event_monitor.candlepin_events in AddressSettings
2024-08-22 05:02:52,952 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222165: No Dead Letter Address configured for queue jobs in AddressSettings
2024-08-22 05:02:52,953 [thread=main] [=, org=, csid=] WARN org.apache.activemq.artemis.core.server - AMQ222166: No Expiry Address configured for queue jobs in AddressSettings
2024-08-22 05:12:40,443 [thread=https-jsse-nio-127.0.0.1-23443-exec-5] [req=a488d884-3952-4f39-8cfd-0106f614e951, org=, csid=9813af0e-b3a9-4f12-b658-2e5e688bc44d] WARN org.candlepin.resource.util.ConsumerBindUtil - Owner is using simple content access; skipping auto-attach for consumer with activation key: c034d1ba-bbc4-41b3-b67a-10635ae7e85a, cddfb262-a02f-4805-b993-e0fe11dddf5e
2024-08-22 10:17:28,322 [thread=Thread-8 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector)] [=, org=, csid=] ERROR org.apache.activemq.artemis.core.client - AMQ214013: Failed to decode packet
java.util.concurrent.RejectedExecutionException: Task org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$1127/0x00007fecb0a9f5e8@367924c rejected from org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@c683c58[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 11]
at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)
at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)
at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:199)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:187)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:72)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$SessionFactoryTopologyHandler.nodeDisconnected(ClientSessionFactoryImpl.java:1572)
at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQClientProtocolManager$Channel0Handler.handleDisconnect(ActiveMQClientProtocolManager.java:505)
at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQClientProtocolManager$Channel0Handler.handlePacket(ActiveMQClientProtocolManager.java:484)
at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.handlePacket(ChannelImpl.java:835)
at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.doBufferReceived(RemotingConnectionImpl.java:419)
at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.bufferReceived(RemotingConnectionImpl.java:392)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler.bufferReceived(ClientSessionFactoryImpl.java:1365)
at org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1.run(InVMConnection.java:223)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:57)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:32)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:68)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
2024-08-22 10:17:28,330 [thread=Thread-8 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector)] [=, org=, csid=] ERROR org.apache.activemq.artemis.core.client - AMQ214031: Failed to decode buffer, disconnect immediately.
java.lang.IllegalStateException: java.util.concurrent.RejectedExecutionException: Task org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$1127/0x00007fecb0a9f5e8@367924c rejected from org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@c683c58[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 11]
at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.bufferReceived(RemotingConnectionImpl.java:397)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler.bufferReceived(ClientSessionFactoryImpl.java:1365)
at org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1.run(InVMConnection.java:223)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:57)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:32)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:68)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
Caused by: java.util.concurrent.RejectedExecutionException: Task org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$1127/0x00007fecb0a9f5e8@367924c rejected from org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@c683c58[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 11]
at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)
at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)
at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:199)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:187)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:72)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$SessionFactoryTopologyHandler.nodeDisconnected(ClientSessionFactoryImpl.java:1572)
at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQClientProtocolManager$Channel0Handler.handleDisconnect(ActiveMQClientProtocolManager.java:505)
at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQClientProtocolManager$Channel0Handler.handlePacket(ActiveMQClientProtocolManager.java:484)
at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.handlePacket(ChannelImpl.java:835)
at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.doBufferReceived(RemotingConnectionImpl.java:419)
at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.bufferReceived(RemotingConnectionImpl.java:392)
… 8 common frames omitted
2024-08-22 10:17:28,331 [thread=Thread-8 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector)] [=, org=, csid=] ERROR org.apache.activemq.artemis.core.server - AMQ224027: Failed to write to handler on invm connector org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1@6f603f72
java.util.concurrent.RejectedExecutionException: Task org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler$1@6bbc5fa0 rejected from org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@c683c58[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 11]
at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)
at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)
at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler.bufferReceived(ClientSessionFactoryImpl.java:1368)
at org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1.run(InVMConnection.java:223)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:57)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:32)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:68)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
2024-08-22 10:17:28,331 [thread=Thread-8 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector)] [=, org=, csid=] WARN org.apache.activemq.artemis.utils.actors.OrderedExecutor - Failed to write to handler on connector org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1@6f603f72
java.lang.IllegalStateException: Failed to write to handler on connector org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1@6f603f72
at org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1.run(InVMConnection.java:231)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:57)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:32)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:68)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
Caused by: java.util.concurrent.RejectedExecutionException: Task org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler$1@6bbc5fa0 rejected from org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@c683c58[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 11]
at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)
at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)
at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler.bufferReceived(ClientSessionFactoryImpl.java:1368)
at org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1.run(InVMConnection.java:223)
… 6 common frames omitted
2024-08-22 10:17:28,332 [thread=Thread-8 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector)] [=, org=, csid=] ERROR org.apache.activemq.artemis.core.client - AMQ214013: Failed to decode packet
java.util.concurrent.RejectedExecutionException: Task org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$1127/0x00007fecb0a9f5e8@5abef543 rejected from org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@c683c58[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 11]
at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)
at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)
at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:199)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:187)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:72)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$SessionFactoryTopologyHandler.nodeDisconnected(ClientSessionFactoryImpl.java:1572)
at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQClientProtocolManager$Channel0Handler.handleDisconnect(ActiveMQClientProtocolManager.java:505)
at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQClientProtocolManager$Channel0Handler.handlePacket(ActiveMQClientProtocolManager.java:484)
at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.handlePacket(ChannelImpl.java:835)
at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.doBufferReceived(RemotingConnectionImpl.java:419)
at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.bufferReceived(RemotingConnectionImpl.java:392)
at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler.bufferReceived(ClientSessionFactoryImpl.java:1365)
at org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1.run(InVMConnection.java:223)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:57)
at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:32)
at org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:68)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
2024-08-22 10:17:28,332 [thread=Thread-8 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector)] [=, org=, csid=] ERROR org.apache.activemq.artemis.core.client - AMQ214031: Failed to decode buffer, disconnect immediately.

Dirk · August 23, 2024, 8:24am

One colleague experienced also some strange problems yesterday and later I found an open issue while doing some packaging, so it could be a temporary problem on the rhsm side.