Foreman-installer crashes b/c httpd cannot find ssl certificate install

Problem:

foreman-installer crashes b/c httpd cannot find ssl certificate install

This was done on a fresh install of the Redhat 8 and following the steps from 3.2.1 in the foreman manual, with additonal plugins when running foreman-install.

SSL Certificate exists, but cannot be seen by httpd service.

Expected outcome:

foreman-installer should execute successfully and foreman-server should start.

Foreman and Proxy versions:

foreman.noarch                                         3.9.1-1.el8                               @foreman
foreman-proxy.noarch                                   3.9.1-1.el8                               @foreman

Foreman and Proxy plugin versions:

foreman-cli.noarch                                     3.9.1-1.el8                               @foreman
foreman-debug.noarch                                   3.9.1-1.el8                               @foreman
foreman-dynflow-sidekiq.noarch                         3.9.1-1.el8                               @foreman
foreman-installer.noarch                               1:3.9.1-1.el8                             @foreman
foreman-postgresql.noarch                              3.9.1-1.el8                               @foreman
foreman-redis.noarch                                   3.9.1-1.el8                               @foreman
foreman-release.noarch                                 3.9.0-0.2.rc3.el8                         @@commandline
foreman-selinux.noarch                                 3.9.1-1.el8                               @foreman
foreman-service.noarch                                 3.9.1-1.el8                               @foreman
foreman-vmware.noarch                                  3.9.1-1.el8                               @foreman

Distribution and version:

Red Hat Enterprise Linux release 8.9 (Ootpa)

Other relevant data:

module_hotfixes enabled

excludepkgs=puppet-agent-7.29.0* added to /etc/yum.repos.d/puppet7-release.repo

Foreman installer output:

2024-03-06 16:07:42 [NOTICE] [root] Loading installer configuration. This will take some time.
2024-03-06 16:07:48 [NOTICE] [root] Running installer with log based terminal output at level NOTICE.
2024-03-06 16:07:48 [NOTICE] [root] Use -l to set the terminal output log level to ERROR, WARN, NOTICE, INFO, or DEBUG. See --full-help for definitions.
2024-03-06 16:07:58 [NOTICE] [configure] Starting system configuration.
2024-03-06 16:08:39 [NOTICE] [configure] 250 configuration steps out of 1250 steps complete.
2024-03-06 16:08:39 [NOTICE] [configure] 500 configuration steps out of 1253 steps complete.
2024-03-06 16:08:40 [NOTICE] [configure] 750 configuration steps out of 1259 steps complete.
2024-03-06 16:09:14 [NOTICE] [configure] 1000 configuration steps out of 1259 steps complete.
2024-03-06 16:10:31 [ERROR ] [configure] Systemd start for httpd failed!
2024-03-06 16:10:31 [ERROR ] [configure] journalctl log for httpd:
2024-03-06 16:10:31 [ERROR ] [configure] -- Logs begin at Wed 2024-03-06 13:33:57 EST, end at Wed 2024-03-06 16:10:31 EST. --
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: Starting The Apache HTTP Server...
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 httpd[308430]: AH00526: Syntax error on line 68 of /etc/httpd/conf.d/05-foreman-ssl.conf:
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 httpd[308430]: SSLCertificateFile: file '/etc/puppetlabs/puppet/ssl/certs/fstng-n-d-02.sys.ds.wolseley.com.pem' does not exist or is empty
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: httpd.service: Main process exited, code=exited, status=1/FAILURE
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: httpd.service: Failed with result 'exit-code'.
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: Failed to start The Apache HTTP Server.
2024-03-06 16:10:31 [ERROR ] [configure] /Stage[main]/Apache::Service/Service[httpd]/ensure: change from 'stopped' to 'running' failed: Systemd start for httpd failed!
2024-03-06 16:10:31 [ERROR ] [configure] journalctl log for httpd:
2024-03-06 16:10:31 [ERROR ] [configure] -- Logs begin at Wed 2024-03-06 13:33:57 EST, end at Wed 2024-03-06 16:10:31 EST. --
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: Starting The Apache HTTP Server...
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 httpd[308430]: AH00526: Syntax error on line 68 of /etc/httpd/conf.d/05-foreman-ssl.conf:
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 httpd[308430]: SSLCertificateFile: file '/etc/puppetlabs/puppet/ssl/certs/fstng-n-d-02.sys.ds.wolseley.com.pem' does not exist or is empty
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: httpd.service: Main process exited, code=exited, status=1/FAILURE
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: httpd.service: Failed with result 'exit-code'.
2024-03-06 16:10:31 [ERROR ] [configure] Mar 06 16:10:31 fstng-n-d-02 systemd[1]: Failed to start The Apache HTTP Server.
2024-03-06 16:10:31 [NOTICE] [configure] 1250 configuration steps out of 1259 steps complete.
2024-03-06 16:10:34 [NOTICE] [configure] System configuration has finished.

Error 1: Puppet Service resource 'httpd' failed. Logs:
/Service[httpd]
Starting to evaluate the resource (1205 of 1259)
Evaluated in 0.63 seconds
/Stage[main]/Apache::Service/Service[httpd]/ensure
change from 'stopped' to 'running' failed: Systemd start for httpd failed!
journalctl log for httpd:
-- Logs begin at Wed 2024-03-06 13:33:57 EST, end at Wed 2024-03-06 16:10:31 EST. --
Mar 06 16:10:31 fstng-n-d-02 systemd[1]: Starting The Apache HTTP Server...
Mar 06 16:10:31 fstng-n-d-02 httpd[308430]: AH00526: Syntax error on line 68 of /etc/httpd/conf.d/05-foreman-ssl.conf:
Mar 06 16:10:31 fstng-n-d-02 httpd[308430]: SSLCertificateFile: file '/etc/puppetlabs/puppet/ssl/certs/fstng-n-d-02.sys.ds.wolseley.com.pem' does not exist or is empty
Mar 06 16:10:31 fstng-n-d-02 systemd[1]: httpd.service: Main process exited, code=exited, status=1/FAILURE
Mar 06 16:10:31 fstng-n-d-02 systemd[1]: httpd.service: Failed with result 'exit-code'.
Mar 06 16:10:31 fstng-n-d-02 systemd[1]: Failed to start The Apache HTTP Server.

Can you check the permissions of the file with the certificate? Also is SELinux enabled? I guess this is the self-signed cert created by the installer process. If not and it’s the custom certificate, make sure that the file is readable for the httpd.