Multiple host creation(platform deployment) plugin for foreman

Nagarjuna_Rachaneni · March 11, 2015, 4:56am

Hi Foreman Dev,

We have developed Cloud Web Portal(CWP) rails application on top of
foreman(using foreman APIs). Our CWP will deploy new platform means which
will create multiple hosts in foreman. Platform will be deployed using
YAML. Now we want to convert this application to foreman plugin. Here the
problem is. our application using many gems in the code
like delayed_job, paperclip, daemons and other gems. When we convert CWP
application to foreman plugin how to get the external gems functionalities
in to the foreman plugin ?

Also please let me know if there are any existing plugins which can be used
like delayed_job(https://github.com/collectiveidea/delayed_job) in foreman.
It will help me lot to fix my problems

Thanks in advance

Nagarjuna

dLobatog · March 15, 2015, 8:53am

Hi Nagarjuna,

That sounds really cool, will you open source it at any point? Multi
hosts creation is a really sought after feature in Foreman.

In any case, to include dependencies in your plugin, adding them to the
gemspec should be enough, see an example here[1].

There is a great plugin, foreman-tasks
(https://github.com/theforeman/foreman-tasks) that will allow you to
perform async jobs in a similar fashion to delayed_job. It uses Dynflow
as the background executor.

Keep in mind Foreman's plan is to update to Rails 4 where ActiveJob
could solve some of your problems without any dependencies.

[1] https://github.com/theforeman/foreman-docker/blob/master/foreman_docker.gemspec

···

On 03/10, Nagarjuna Rachaneni wrote: > Hi Foreman Dev, > > We have developed *Cloud Web Portal(CWP)* rails application on top of > foreman(using foreman APIs). Our CWP will deploy new platform means which > will create multiple hosts in foreman. Platform will be deployed using > YAML. Now we want to convert this application to foreman plugin. Here the > problem is. our application using many gems in the code > like delayed_job, paperclip, daemons and other gems. When we convert CWP > application to foreman plugin how to get the external gems functionalities > in to the foreman plugin ? > > > Also please let me know if there are any existing plugins which can be used > like delayed_job(https://github.com/collectiveidea/delayed_job) in foreman. > It will help me lot to fix my problems > > Thanks in advance > > Nagarjuna > > > -- > You received this message because you are subscribed to the Google Groups "foreman-dev" group. > To unsubscribe from this group and stop receiving emails from it, send an email to foreman-dev+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/d/optout.

Marek_Hulan · March 15, 2015, 8:57am

Hello,

I believe that first part was already answered in another thread. For the
second question regarding some background processing, you can use (and it's
really recommended) one of Foreman plugin called foreman_tasks [1]. Later it
might get even merged into Foreman core. It uses Dynflow [2] which can run
jobs on background. You can watch the status, restart the task if something
goes wrong etc. To understand how Dynflow works, I recommend reading docs [3]
which is being improved constantly.

[1] https://github.com/theforeman/foreman-tasks/
[2] https://github.com/dynflow/dynflow
[3] http://dynflow.github.io/documentation/

Hope this helps

···

-- Marek

On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote:

Hi Foreman Dev,

We have developed Cloud Web Portal(CWP) rails application on top of
foreman(using foreman APIs). Our CWP will deploy new platform means which
will create multiple hosts in foreman. Platform will be deployed using
YAML. Now we want to convert this application to foreman plugin. Here the
problem is. our application using many gems in the code
like delayed_job, paperclip, daemons and other gems. When we convert CWP
application to foreman plugin how to get the external gems functionalities
in to the foreman plugin ?

Also please let me know if there are any existing plugins which can be used
like delayed_job(https://github.com/collectiveidea/delayed_job) in foreman.
It will help me lot to fix my problems

Thanks in advance

Nagarjuna

–
Marek

Iakov_Gan · March 16, 2015, 9:47am

Hi, I am woking with Nagarjuna,

We defenetly will opensource this project we find it very usefull for
multi-host depoloyement in our environment.

Getting back to the subject, we struggle to implement something with foreman-tasks
<https://github.com/theforeman/foreman-tasks/>can we have a hangouts
session on this subject with someone of developer? .

Regards,

Iakov

···

On Sunday, March 15, 2015 at 9:57:15 AM UTC+1, Marek Hulan wrote: > > Hello, > > I believe that first part was already answered in another thread. For the > second question regarding some background processing, you can use (and > it's > really recommended) one of Foreman plugin called foreman_tasks [1]. Later > it > might get even merged into Foreman core. It uses Dynflow [2] which can run > jobs on background. You can watch the status, restart the task if > something > goes wrong etc. To understand how Dynflow works, I recommend reading docs > [3] > which is being improved constantly. > > [1] https://github.com/theforeman/foreman-tasks/ > [2] https://github.com/dynflow/dynflow > [3] http://dynflow.github.io/documentation/ > > Hope this helps > > -- > Marek > > On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote: > > Hi Foreman Dev, > > > > We have developed *Cloud Web Portal(CWP)* rails application on top of > > foreman(using foreman APIs). Our CWP will deploy new platform means > which > > will create multiple hosts in foreman. Platform will be deployed using > > YAML. Now we want to convert this application to foreman plugin. Here > the > > problem is. our application using many gems in the code > > like delayed_job, paperclip, daemons and other gems. When we convert CWP > > application to foreman plugin how to get the external gems > functionalities > > in to the foreman plugin ? > > > > > > Also please let me know if there are any existing plugins which can be > used > > like delayed_job(https://github.com/collectiveidea/delayed_job) in > foreman. > > It will help me lot to fix my problems > > > > Thanks in advance > > > > Nagarjuna > > -- > Marek >

Nagarjuna_Rachaneni · March 25, 2015, 5:20am

Marek,

May i know the implementation of foreman-tasks in my project ? Can i get
the example for below requirement

I have model Platform and there is instance method called "install". I want
to run install method in background after Platform object create. So

platform = Platform.new
platform.save
platform.install ----> this i need to run as background

Regards,
Nagrajuna

···

On Sunday, 15 March 2015 14:27:15 UTC+5:30, Marek Hulan wrote: > > Hello, > > I believe that first part was already answered in another thread. For the > second question regarding some background processing, you can use (and > it's > really recommended) one of Foreman plugin called foreman_tasks [1]. Later > it > might get even merged into Foreman core. It uses Dynflow [2] which can run > jobs on background. You can watch the status, restart the task if > something > goes wrong etc. To understand how Dynflow works, I recommend reading docs > [3] > which is being improved constantly. > > [1] https://github.com/theforeman/foreman-tasks/ > [2] https://github.com/dynflow/dynflow > [3] http://dynflow.github.io/documentation/ > > Hope this helps > > -- > Marek > > On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote: > > Hi Foreman Dev, > > > > We have developed *Cloud Web Portal(CWP)* rails application on top of > > foreman(using foreman APIs). Our CWP will deploy new platform means > which > > will create multiple hosts in foreman. Platform will be deployed using > > YAML. Now we want to convert this application to foreman plugin. Here > the > > problem is. our application using many gems in the code > > like delayed_job, paperclip, daemons and other gems. When we convert CWP > > application to foreman plugin how to get the external gems > functionalities > > in to the foreman plugin ? > > > > > > Also please let me know if there are any existing plugins which can be > used > > like delayed_job(https://github.com/collectiveidea/delayed_job) in > foreman. > > It will help me lot to fix my problems > > > > Thanks in advance > > > > Nagarjuna > > -- > Marek >

dLobatog · March 16, 2015, 10:32am

Iakov, I'd recommend you to join #theforeman-dev IRC channel on
Freenode, and ask your questions about foreman-tasks there if you want
quicker feedback.

···

On 03/16, Iakov Gan wrote: > Hi, I am woking with Nagarjuna, > > We defenetly will opensource this project we find it very usefull for > multi-host depoloyement in our environment. > > Getting back to the subject, we struggle to implement something with foreman-tasks > can we have a hangouts > session on this subject with someone of developer? . > > Regards, > > Iakov > > > > On Sunday, March 15, 2015 at 9:57:15 AM UTC+1, Marek Hulan wrote: > > > > Hello, > > > > I believe that first part was already answered in another thread. For the > > second question regarding some background processing, you can use (and > > it's > > really recommended) one of Foreman plugin called foreman_tasks [1]. Later > > it > > might get even merged into Foreman core. It uses Dynflow [2] which can run > > jobs on background. You can watch the status, restart the task if > > something > > goes wrong etc. To understand how Dynflow works, I recommend reading docs > > [3] > > which is being improved constantly. > > > > [1] https://github.com/theforeman/foreman-tasks/ > > [2] https://github.com/dynflow/dynflow > > [3] http://dynflow.github.io/documentation/ > > > > Hope this helps > > > > -- > > Marek > > > > On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote: > > > Hi Foreman Dev, > > > > > > We have developed *Cloud Web Portal(CWP)* rails application on top of > > > foreman(using foreman APIs). Our CWP will deploy new platform means > > which > > > will create multiple hosts in foreman. Platform will be deployed using > > > YAML. Now we want to convert this application to foreman plugin. Here > > the > > > problem is. our application using many gems in the code > > > like delayed_job, paperclip, daemons and other gems. When we convert CWP > > > application to foreman plugin how to get the external gems > > functionalities > > > in to the foreman plugin ? > > > > > > > > > Also please let me know if there are any existing plugins which can be > > used > > > like delayed_job(https://github.com/collectiveidea/delayed_job) in > > foreman. > > > It will help me lot to fix my problems > > > > > > Thanks in advance > > > > > > Nagarjuna > > > > -- > > Marek > > > > -- > You received this message because you are subscribed to the Google Groups "foreman-dev" group. > To unsubscribe from this group and stop receiving emails from it, send an email to foreman-dev+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/d/optout.

–
Daniel Lobato Garcia

@eLobatoss
blog.daniellobato.me
daniellobato.me

GPG: http://keys.gnupg.net/pks/lookup?op=get&search=0x7A92D6DD38D6DE30
Keybase: https://keybase.io/elobato

iNecas · March 26, 2015, 2:41pm

Hi,

There are numerous of examples for this in existing plugins, one of them even
in the foreman-tasks code itself:

github.com

theforeman/foreman-tasks/blob/master/app/controllers/foreman_tasks/concerns/hosts_controller_extension.rb#L10


module ForemanTasks
module Concerns
  module HostsControllerExtension
    extend ActiveSupport::Concern


    included do
      alias_method_chain :facts, :dynflow
    end


    def facts_with_dynflow
      task = ForemanTasks.async_task(::Actions::Foreman::Host::ImportFacts,
                                     detect_host_type,
                                     params[:name],
                                     params[:facts],
                                     params[:certname],
                                     detected_proxy.try(:id))


      render :json => { :task_id => task.id }, :status => 202
    rescue ::Foreman::Exception => e
      render :json => { 'message' => e.to_s }, :status => :unprocessable_entity

with action definition here https://github.com/theforeman/foreman-tasks/blob/master/app/lib/actions/foreman/host/import_facts.rb

Also, the dynflow documentation is getting better every-day: please try going though the docs
http://dynflow.github.io/documentation/: we are hoping for the feedback on the docs to make that
understandable for other developers

– Ivan

···

----- Original Message ----- > Marek, > > May i know the implementation of foreman-tasks in my project ? Can i get > the example for below requirement > > I have model Platform and there is instance method called "install". I want > to run install method in background after Platform object create. So > > platform = Platform.new > platform.save > platform.install ----> this i need to run as background > > Regards, > Nagrajuna > > > On Sunday, 15 March 2015 14:27:15 UTC+5:30, Marek Hulan wrote: > > > > Hello, > > > > I believe that first part was already answered in another thread. For the > > second question regarding some background processing, you can use (and > > it's > > really recommended) one of Foreman plugin called foreman_tasks [1]. Later > > it > > might get even merged into Foreman core. It uses Dynflow [2] which can run > > jobs on background. You can watch the status, restart the task if > > something > > goes wrong etc. To understand how Dynflow works, I recommend reading docs > > [3] > > which is being improved constantly. > > > > [1] https://github.com/theforeman/foreman-tasks/ > > [2] https://github.com/dynflow/dynflow > > [3] http://dynflow.github.io/documentation/ > > > > Hope this helps > > > > -- > > Marek > > > > On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote: > > > Hi Foreman Dev, > > > > > > We have developed *Cloud Web Portal(CWP)* rails application on top of > > > foreman(using foreman APIs). Our CWP will deploy new platform means > > which > > > will create multiple hosts in foreman. Platform will be deployed using > > > YAML. Now we want to convert this application to foreman plugin. Here > > the > > > problem is. our application using many gems in the code > > > like delayed_job, paperclip, daemons and other gems. When we convert CWP > > > application to foreman plugin how to get the external gems > > functionalities > > > in to the foreman plugin ? > > > > > > > > > Also please let me know if there are any existing plugins which can be > > used > > > like delayed_job(https://github.com/collectiveidea/delayed_job) in > > foreman. > > > It will help me lot to fix my problems > > > > > > Thanks in advance > > > > > > Nagarjuna > > > > -- > > Marek > > > > -- > You received this message because you are subscribed to the Google Groups > "foreman-dev" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to foreman-dev+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. >

Shimon_Shtein · March 29, 2015, 10:33am

Hello Iakov,
We have started working on a multi-host deployment feature, and as a part
of this task I would like to hear more about the use cases and requirements
that you have
for this feature. I want to make sure that when we design that feature, we
can take into account as much use cases as we can and we are not missing
some key
points that will render our design useless.
I would be very happy if you could publish (either publicly here, or as a
private message to me directly) the use cases/requirements that you have.
If you have any
other information that you want to share, that would be great too.

Shimon.

···

On Monday, March 16, 2015 at 11:47:05 AM UTC+2, Iakov Gan wrote: > > Hi, I am woking with Nagarjuna, > > We defenetly will opensource this project we find it very usefull for > multi-host depoloyement in our environment. > > Getting back to the subject, we struggle to implement something with foreman-tasks > can we have a hangouts > session on this subject with someone of developer? . > > Regards, > > Iakov > > > > On Sunday, March 15, 2015 at 9:57:15 AM UTC+1, Marek Hulan wrote: >> >> Hello, >> >> I believe that first part was already answered in another thread. For the >> second question regarding some background processing, you can use (and >> it's >> really recommended) one of Foreman plugin called foreman_tasks [1]. Later >> it >> might get even merged into Foreman core. It uses Dynflow [2] which can >> run >> jobs on background. You can watch the status, restart the task if >> something >> goes wrong etc. To understand how Dynflow works, I recommend reading docs >> [3] >> which is being improved constantly. >> >> [1] https://github.com/theforeman/foreman-tasks/ >> [2] https://github.com/dynflow/dynflow >> [3] http://dynflow.github.io/documentation/ >> >> Hope this helps >> >> -- >> Marek >> >> On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote: >> > Hi Foreman Dev, >> > >> > We have developed *Cloud Web Portal(CWP)* rails application on top of >> > foreman(using foreman APIs). Our CWP will deploy new platform means >> which >> > will create multiple hosts in foreman. Platform will be deployed using >> > YAML. Now we want to convert this application to foreman plugin. Here >> the >> > problem is. our application using many gems in the code >> > like delayed_job, paperclip, daemons and other gems. When we convert >> CWP >> > application to foreman plugin how to get the external gems >> functionalities >> > in to the foreman plugin ? >> > >> > >> > Also please let me know if there are any existing plugins which can be >> used >> > like delayed_job(https://github.com/collectiveidea/delayed_job) in >> foreman. >> > It will help me lot to fix my problems >> > >> > Thanks in advance >> > >> > Nagarjuna >> >> -- >> Marek >> >

iNecas · March 16, 2015, 2:02pm

>
> Iakov, I'd recommend you to join #theforeman-dev IRC channel on
> Freenode, and ask your questions about foreman-tasks there if you want
> quicker feedback.

Or if it's something others could benefit from, just raise the issue here,
or open an issue on Issues - foreman-tasks - Foreman

We're happy to help. Given the timezones, it might be actually faster than
finding a time for common hangout.

– Ivan

···

----- Original Message -----

On 03/16, Iakov Gan wrote:

Hi, I am woking with Nagarjuna,

We defenetly will opensource this project we find it very usefull for
multi-host depoloyement in our environment.

Getting back to the subject, we struggle to implement something with
foreman-tasks
https://github.com/theforeman/foreman-tasks/can we have a hangouts
session on this subject with someone of developer? .

Regards,

Iakov

On Sunday, March 15, 2015 at 9:57:15 AM UTC+1, Marek Hulan wrote:

Hello,

I believe that first part was already answered in another thread. For the
second question regarding some background processing, you can use (and
it’s
really recommended) one of Foreman plugin called foreman_tasks [1]. Later
it
might get even merged into Foreman core. It uses Dynflow [2] which can
run
jobs on background. You can watch the status, restart the task if
something
goes wrong etc. To understand how Dynflow works, I recommend reading docs
[3]
which is being improved constantly.

[1] https://github.com/theforeman/foreman-tasks/
[2] https://github.com/dynflow/dynflow
[3] http://dynflow.github.io/documentation/

Hope this helps

–
Marek

On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote:

Hi Foreman Dev,

We have developed Cloud Web Portal(CWP) rails application on top of
foreman(using foreman APIs). Our CWP will deploy new platform means
which
will create multiple hosts in foreman. Platform will be deployed using
YAML. Now we want to convert this application to foreman plugin. Here
the
problem is. our application using many gems in the code
like delayed_job, paperclip, daemons and other gems. When we convert
CWP
application to foreman plugin how to get the external gems
functionalities
in to the foreman plugin ?

Also please let me know if there are any existing plugins which can be
used
like delayed_job(https://github.com/collectiveidea/delayed_job) in
foreman.
It will help me lot to fix my problems

Thanks in advance

Nagarjuna

–
Marek

–
You received this message because you are subscribed to the Google Groups
"foreman-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-dev+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

–
Daniel Lobato Garcia

@eLobatoss
blog.daniellobato.me
daniellobato.me

GPG: http://keys.gnupg.net/pks/lookup?op=get&search=0x7A92D6DD38D6DE30
Keybase: https://keybase.io/elobato

–
You received this message because you are subscribed to the Google Groups
"foreman-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-dev+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Iakov_Gan · March 30, 2015, 9:35am

Hi Shim,

Glad to hear that.

I'll be happy to discuss this feature in hagnouts. We can also have a demo
of our multi-host deployement if you like.

Regrards,
Iakov

···

On Sunday, March 29, 2015 at 12:33:02 PM UTC+2, Shim Shtein wrote: > > Hello Iakov, > We have started working on a multi-host deployment feature, and as a part > of this task I would like to hear more about the use cases and requirements > that you have > for this feature. I want to make sure that when we design that feature, we > can take into account as much use cases as we can and we are not missing > some key > points that will render our design useless. > I would be very happy if you could publish (either publicly here, or as a > private message to me directly) the use cases/requirements that you have. > If you have any > other information that you want to share, that would be great too. > > Shimon. > > > On Monday, March 16, 2015 at 11:47:05 AM UTC+2, Iakov Gan wrote: >> >> Hi, I am woking with Nagarjuna, >> >> We defenetly will opensource this project we find it very usefull for >> multi-host depoloyement in our environment. >> >> Getting back to the subject, we struggle to implement something with foreman-tasks >> can we have a hangouts >> session on this subject with someone of developer? . >> >> Regards, >> >> Iakov >> >> >> >> On Sunday, March 15, 2015 at 9:57:15 AM UTC+1, Marek Hulan wrote: >>> >>> Hello, >>> >>> I believe that first part was already answered in another thread. For >>> the >>> second question regarding some background processing, you can use (and >>> it's >>> really recommended) one of Foreman plugin called foreman_tasks [1]. >>> Later it >>> might get even merged into Foreman core. It uses Dynflow [2] which can >>> run >>> jobs on background. You can watch the status, restart the task if >>> something >>> goes wrong etc. To understand how Dynflow works, I recommend reading >>> docs [3] >>> which is being improved constantly. >>> >>> [1] https://github.com/theforeman/foreman-tasks/ >>> [2] https://github.com/dynflow/dynflow >>> [3] http://dynflow.github.io/documentation/ >>> >>> Hope this helps >>> >>> -- >>> Marek >>> >>> On Tuesday 10 of March 2015 21:56:55 Nagarjuna Rachaneni wrote: >>> > Hi Foreman Dev, >>> > >>> > We have developed *Cloud Web Portal(CWP)* rails application on top of >>> > foreman(using foreman APIs). Our CWP will deploy new platform means >>> which >>> > will create multiple hosts in foreman. Platform will be deployed using >>> > YAML. Now we want to convert this application to foreman plugin. Here >>> the >>> > problem is. our application using many gems in the code >>> > like delayed_job, paperclip, daemons and other gems. When we convert >>> CWP >>> > application to foreman plugin how to get the external gems >>> functionalities >>> > in to the foreman plugin ? >>> > >>> > >>> > Also please let me know if there are any existing plugins which can be >>> used >>> > like delayed_job(https://github.com/collectiveidea/delayed_job) in >>> foreman. >>> > It will help me lot to fix my problems >>> > >>> > Thanks in advance >>> > >>> > Nagarjuna >>> >>> -- >>> Marek >>> >>