Running ansible role via Foreman "Play Ansible files on host XXXXXX though not_defined"

I am trying to get foreman to run a simple role that changes the motd, but
I am running into issues. I see the role in Configure -> Ansible -> Roles
and have edited the host and added the role. When I go to the host and
click Ansible Roles, it takes me to a task page. The task is created but
stays in the planned state. I do see Ansible as a service in my default
smart proxy, but the task message is "Play Ansible files on host XXXXXX
though not_defined".

Thanks in advance