Hello everybody, this is my first post and i’m a new user,
I installed the latest Foreman 1.22.0 with Katello 3.12 to a fresh installed CentOS 7 VM (Minimal Install from ISO).
Problem:
After the installation there is a task with status error: “Create organization ‘Default Organization’” with error message:
Katello::Resources::Candlepin::Owner: Server broke connection (POST /candlepin/owners/Default_Organization/uebercert)
The “Tomcat” service fails the only log entry i can find is:
/var/log/messages:
server: # A fatal error has been detected by the Java Runtime Environment:
server: #
server: # SIGSEGV (0xb) at pc=0x00007f8bdd8d3a4f, pid=30253, tid=0x00007f8c09b6c700
server: #
server: # JRE version: OpenJDK Runtime Environment (8.0_222-b10) (build 1.8.0_222-b10)
server: # Java VM: OpenJDK 64-Bit Server VM (25.222-b10 mixed mode linux-amd64 compressed oops)
server: # Problematic frame:
server: # C [libplds4.so+0x1a4f] PL_HashTableLookupConst+0xf
server: #
server: # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try “ulimit -c unlimited” before starting Java again
server: #
server: # An error report file with more information is saved as:
server: # /usr/share/tomcat/hs_err_pid30253.log
server: #
server: # If you would like to submit a bug report, please visit:
server: # Crash Report
server: # The crash happened outside the Java Virtual Machine in native code.
server: # See problematic frame for where to report the bug.
server: #
systemd: tomcat.service: main process exited, code=killed, status=6/ABRT
systemd: Unit tomcat.service entered failed state.
systemd: tomcat.service failed.
I can see that Candlepin has failed with “hammer ping” and “systemctl status tomcat”.
I can start candlepin with “systemctl start tomcat” or “foreman-maintain service start”.
Expected outcome:
Resume the “Create organization ‘Default Organization’” Task
Foreman and Proxy versions:
foreman-installer-1.22.0-1.el7.noarch
foreman-1.22.0-1.el7.noarch
foreman-proxy-1.22.0-1.el7.noarch
Foreman and Proxy plugin versions:
katello-3.12.1-1.el7.noarch
candlepin-2.6.5-1.el7.noarch
pulp-server-2.19.1-1.el7.noarch
puppetserver-6.5.0-1.el7.noarch
Thanks in Advance for your help i am clueless on this issue !
It seems the links are no longer valid since the content has been moved to vault.centos.org
Obviously just a temporary fix until we can get back to CentOS 7.7 Java.
New versions of Candlepin have been pushed to the Katello 3.10, 3.11, and 3.12 repos. A yum update candlepin followed by foreman-maintain service restart should do the trick.
Sorry for the late reply, just saw your message. The Java downgrade did fix my issue of Candlepin constantly crashing. I am going to try the new Candlepin update today and update Java as well.
Thanks for the reply. I have upgraded my Katello server and all capsules to the latest patches for CentOS 7.7 and to Katello 3.13 RC-2 which still does not allow Candlepin to remain running.
Perhaps…but this was the same issue I was having on 3.11 after patching the OS on Monday which included the later versions of Java. In an attempt to re-mediate, I upgraded to 3.12 and then then to 3.13 RC-2. I thought it was fixed with downgrading Java yesterday, but broke again after upgrading the latest Candlepin. I have since upgraded back to the latest Java release, but the issue remains.
I appreciate all the suggestions and work going into fixing.
@Cassius_Clay it’s possible that in your trial & error with fixing the problem the Candlepin database was not migrated (usually this happens during the installer run). In this case the service doesn’t give feedback about it even though tomcat appears to be running.
Here’s something you can try:
open /etc/candlepin/candlepin.conf and note the value of jpa.config.hibernate.connection.password which you’ll use as the password in a subsequent command: