Foreman + Redis Sentinel

jplindquist · December 9, 2021, 10:15pm

Question: I am trying to determine if it’s possible to setup foreman cache and dynflow workers to connect to redis sentinel so we can have some kind of redundancy / failover options when running multiple instances of Foreman. The module doesn’t seem to support it as far as I can tell, but I am curious if anyone has tried and if there is a way to implement this, or if there are any other suggestions for a way to setup an HA queue for the workers.

github.com

theforeman/puppet-foreman/blob/6c902a4f1f484137ebccafe4d3390881fd0b3d61/templates/settings.yaml.erb#L86-L110

    
      
          :dynflow:
            :redis_url: <%= scope.lookupvar("foreman::config::dynflow_redis_url") %>
          
          
<% end -%>
          :rails_cache_store:
            :type: <%= scope["foreman::rails_cache_store"]["type"] %>
          <% if scope["foreman::rails_cache_store"]["type"] == "redis" -%>
            :urls:
          <%   if scope["foreman::rails_cache_store"].key?("urls") -%>
          <%     scope["foreman::rails_cache_store"]["urls"].each do |url| -%>
              - redis://<%= url %>
          <%     end -%>
          <%   else -%>
              - redis://localhost:8479/0
          <%   end -%>
            :options:
          <%   if scope["foreman::rails_cache_store"].key?("options") -%>
          <%     scope["foreman::rails_cache_store"]["options"].each do |option,value| -%>
              :<%= option %>: <%= value %>
          <%     end -%>

This file has been truncated. show original

jplindquist · December 9, 2021, 10:45pm

Follow-up question / comment. It doesn’t look like Foreman 3.x uses the redis_url option from the settings anymore, and hard codes a value for DYNFLOW_REDIS_URL in the systemd unit?

The default config lays down

:dynflow:
:redis_url: redis://localhost:6379/6

but the systemd configs have an env set

Environment=DYNFLOW_REDIS_URL=redis://localhost:6379/0
Environment=REDIS_PROVIDER=DYNFLOW_REDIS_URL

And as it starts up, it connects to the db specified in the ENV var vs. what’s configured in the settings…

Booting Sidekiq 5.2.7 with redis options {:id=>“Sidekiq-server-PID-22195”, :url=>“redis://localhost:6379/0”}

I’m not sure how I’m supposed to override or set a custom URL for this (if I want to setup separate instances, or secure them, etc.)