How to configure SSH remote execution for natted hosts

Problem:
We wanted to use auto-remediation and this custom job uses SSH. However we normally use ansible and use a variable to override the IP to the natted IP of the given host. The internal servers that aren’t natted do work, so we are quite sure it’s be/c of the wrong IP being used by ssh.

Expected outcome:
We would like to override the IP for pure ssh commands somehow. FQDN would be an option as well but even after setting Connect by IP to No and restarting satellite, it doesn’t solve the issue.

Anyone has an idea how to use either FQDN or override/change the IP to the natted one for SSH?
Foreman and Proxy versions: