IP address of my Foreman server changed

Problem:
I switched ISPs and my new router has a different IP range than my previous one. IP Address changed now a bunch of Features in my Foreman server are broken and failing.

Foreman and Proxy versions:
2.3.1
Foreman and Proxy plugin versions:

Distribution and version:

Other relevant data:

Is there a setting somewhere I can change on Foreman/Puppet to fix this? I want to specify my new IP address