Alright, so maybe it is a certificate issue after all.
How did you set up the let’s encrypt certs for Foreman? Did you change configs by hand or did you use foreman-installer?
Here you can find a “proper” solution on how to set the certificates correctly. I have not tested this myself, but I would assume that also updates the hammer config to use the correct certificate files.