Expanding Slave Capacity

We're reaching a point where slave capacity is slowing development down.
I'd like to get an idea of how much more capacity we need and strategies we
could adopt around this.

  1. If we went with a dedicated Rackspace server, how big of a machine would
    we need and what would be the per month cost?

  2. Could we, if we have the funds, adopt an elastic strategy to handle peak
    development times? For example, using the Jenkins EC2 [1] plugin?

  3. If we beef up efforts to divert systests from Rackspace to ci.centos.org
    would that free up funds to add more Rackspace slaves?

  4. Other?

Eric

[1] https://wiki.jenkins-ci.org/display/JENKINS/Amazon+EC2+Plugin

Due to our usage patterns, the ideal case would seem

··· -- Eric D. Helms Red Hat Engineering Ph.D. Student - North Carolina State University

I would be willing to donate a second slave if necessary.

··· On Tue, Aug 30, 2016 at 2:10 PM, Eric D Helms wrote:

We’re reaching a point where slave capacity is slowing development down.
I’d like to get an idea of how much more capacity we need and strategies we
could adopt around this.

  1. If we went with a dedicated Rackspace server, how big of a machine
    would we need and what would be the per month cost?

  2. Could we, if we have the funds, adopt an elastic strategy to handle
    peak development times? For example, using the Jenkins EC2 [1] plugin?

  3. If we beef up efforts to divert systests from Rackspace to
    ci.centos.org would that free up funds to add more Rackspace slaves?

  4. Other?

Eric

[1] https://wiki.jenkins-ci.org/display/JENKINS/Amazon+EC2+Plugin

Due to our usage patterns, the ideal case would seem


Eric D. Helms
Red Hat Engineering
Ph.D. Student - North Carolina State University


You received this message because you are subscribed to the Google Groups
"foreman-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-dev+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hi,

> We're reaching a point where slave capacity is slowing development down.
> I'd like to get an idea of how much more capacity we need and strategies we
> could adopt around this.

I'd like to state that I would be very happy if we had at least one more
Debian/x86 slave and best a real Debian/aarch64 server (or multiple
smaller ones, like some ODroid C2s) to resume aarch64 builds and maybe
also do the armhf builds on it (should be possible like i386 on x64_64
with multiarch) to get load off the poor RPi2(AFAIK) that's doing all
that now.

Regards

··· On Tue, Aug 30, 2016 at 02:10:43PM -0400, Eric D Helms wrote: -- Michael Moll

Thanks for the offer, I'd gladly take you up on it.

Similar specs to the current one would be great, but more disk space if
possible - the usage is increasing.
http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements
lists current specs.

A regular EL7 installation with my SSH key
(https://m0dlx.com/ssh_redhat.pub) installed for root would be enough
for me to set it up.

··· On 30/08/16 20:54, Josh Baird wrote: > I would be willing to donate a second slave if necessary.


Dominic Cleal
dominic@cleal.org

Would an m3.medium from ec2 be helpful?

– bk

··· On 08/31/2016 04:09 AM, Dominic Cleal wrote: > On 30/08/16 20:54, Josh Baird wrote: >> I would be willing to donate a second slave if necessary. > > Thanks for the offer, I'd gladly take you up on it. > > Similar specs to the current one would be great, but more disk space if > possible - the usage is increasing. > http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements > lists current specs. > > A regular EL7 installation with my SSH key > (https://m0dlx.com/ssh_redhat.pub) installed for root would be enough > for me to set it up. >

You should be good to go. foreman-build02.kywimax.com (4C/4GB/100GB disk).

Cheers!

··· On Wed, Aug 31, 2016 at 4:09 AM, Dominic Cleal wrote:

On 30/08/16 20:54, Josh Baird wrote:

I would be willing to donate a second slave if necessary.

Thanks for the offer, I’d gladly take you up on it.

Similar specs to the current one would be great, but more disk space if
possible - the usage is increasing.
About - Foreman
Jenkins#Slave-requirements
lists current specs.

A regular EL7 installation with my SSH key
(https://m0dlx.com/ssh_redhat.pub) installed for root would be enough
for me to set it up.


Dominic Cleal
dominic@cleal.org


You received this message because you are subscribed to the Google Groups
"foreman-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-dev+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

If additional storage is available, yes, as the requirements (link
above) are for a minimum of 60GB space, not the 4GB it appears that the
m3.medium spec has.

··· On 31/08/16 14:04, Bryan Kearney wrote: > On 08/31/2016 04:09 AM, Dominic Cleal wrote: >> On 30/08/16 20:54, Josh Baird wrote: >>> I would be willing to donate a second slave if necessary. >> >> Thanks for the offer, I'd gladly take you up on it. >> >> Similar specs to the current one would be great, but more disk space if >> possible - the usage is increasing. >> http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements >> lists current specs. >> >> A regular EL7 installation with my SSH key >> (https://m0dlx.com/ssh_redhat.pub) installed for root would be enough >> for me to set it up. >> > Would an m3.medium from ec2 be helpful?


Dominic Cleal
dominic@cleal.org

I've setup another slave. Hope, it helps a little.

tfmslave01.timogoebel.net

You should be able to login with root and your ssh key.

I've already run the steps listed on [1]. The system is currently
waiting for a puppet certificate. Dominic, do you cover the rest?

Timo

[1]
http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements

··· Am 31.08.16 um 10:09 schrieb Dominic Cleal:

Thanks for the offer, I’d gladly take you up on it.

Similar specs to the current one would be great, but more disk space if
possible - the usage is increasing.
Jenkins - Foreman
lists current specs.

A regular EL7 installation with my SSH key
(https://m0dlx.com/ssh_redhat.pub) installed for root would be enough
for me to set it up.

I mis read that. Are any of the slaves ec2 now? If so, do you know the size?

– bk

··· On 08/31/2016 09:07 AM, Dominic Cleal wrote: > On 31/08/16 14:04, Bryan Kearney wrote: >> On 08/31/2016 04:09 AM, Dominic Cleal wrote: >>> On 30/08/16 20:54, Josh Baird wrote: >>>> I would be willing to donate a second slave if necessary. >>> >>> Thanks for the offer, I'd gladly take you up on it. >>> >>> Similar specs to the current one would be great, but more disk space if >>> possible - the usage is increasing. >>> http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements >>> lists current specs. >>> >>> A regular EL7 installation with my SSH key >>> (https://m0dlx.com/ssh_redhat.pub) installed for root would be enough >>> for me to set it up. >>> >> Would an m3.medium from ec2 be helpful? > > If additional storage is available, yes, as the requirements (link > above) are for a minimum of 60GB space, not the 4GB it appears that the > m3.medium spec has. >

No, not to my knowledge.

··· On 31/08/16 14:30, Bryan Kearney wrote: > On 08/31/2016 09:07 AM, Dominic Cleal wrote: >> On 31/08/16 14:04, Bryan Kearney wrote: >>> On 08/31/2016 04:09 AM, Dominic Cleal wrote: >>>> On 30/08/16 20:54, Josh Baird wrote: >>>>> I would be willing to donate a second slave if necessary. >>>> >>>> Thanks for the offer, I'd gladly take you up on it. >>>> >>>> Similar specs to the current one would be great, but more disk space if >>>> possible - the usage is increasing. >>>> http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements >>>> lists current specs. >>>> >>>> A regular EL7 installation with my SSH key >>>> (https://m0dlx.com/ssh_redhat.pub) installed for root would be enough >>>> for me to set it up. >>>> >>> Would an m3.medium from ec2 be helpful? >> >> If additional storage is available, yes, as the requirements (link >> above) are for a minimum of 60GB space, not the 4GB it appears that the >> m3.medium spec has. >> > I mis read that. Are any of the slaves ec2 now? If so, do you know the size?


Dominic Cleal
dominic@cleal.org

Thanks! I'm configuring it now.

··· On 31/08/16 14:33, Josh Baird wrote: > You should be good to go. foreman-build02.kywimax.com > (4C/4GB/100GB disk).


Dominic Cleal
dominic@cleal.org

>
>> Thanks for the offer, I'd gladly take you up on it.
>>
>> Similar specs to the current one would be great, but more disk space if
>> possible - the usage is increasing.
>> Jenkins - Foreman
>> lists current specs.
>>
>> A regular EL7 installation with my SSH key
>> (https://m0dlx.com/ssh_redhat.pub) installed for root would be enough
>> for me to set it up.
>>
> I've setup another slave. Hope, it helps a little.
>
> tfmslave01.timogoebel.net
>
> You should be able to login with root and your ssh key.

Unfortunately not, I'm not able to log in.

> I've already run the steps listed on [1]. The system is currently
> waiting for a puppet certificate. Dominic, do you cover the rest?

Yes, I usually run through the list. I've signed the certificate, so if
you can fix the login or perhaps just enable the Puppet service then I
should gain access (in time).

··· On 05/09/16 20:57, Timo Goebel wrote: > Am 31.08.16 um 10:09 schrieb Dominic Cleal:


Dominic Cleal
dominic@cleal.org

Thanks for the contribution Timo, the slave is now online and running
tests. If you'd like to add yourself to
Foreman, please feel free.

··· On 05/09/16 20:57, Timo Goebel wrote: > Am 31.08.16 um 10:09 schrieb Dominic Cleal: > >> Thanks for the offer, I'd gladly take you up on it. >> >> Similar specs to the current one would be great, but more disk space if >> possible - the usage is increasing. >> http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements >> lists current specs. >> >> A regular EL7 installation with my SSH key >> (https://m0dlx.com/ssh_redhat.pub) installed for root would be enough >> for me to set it up. >> > I've setup another slave. Hope, it helps a little. > > tfmslave01.timogoebel.net


Dominic Cleal
dominic@cleal.org

Lets try one:

ec2-184-72-89-17.compute-1.amazonaws.com

your ssh key should work

– bk

··· On 08/31/2016 09:30 AM, Dominic Cleal wrote: > On 31/08/16 14:30, Bryan Kearney wrote: >> On 08/31/2016 09:07 AM, Dominic Cleal wrote: >>> On 31/08/16 14:04, Bryan Kearney wrote: >>>> On 08/31/2016 04:09 AM, Dominic Cleal wrote: >>>>> On 30/08/16 20:54, Josh Baird wrote: >>>>>> I would be willing to donate a second slave if necessary. >>>>> >>>>> Thanks for the offer, I'd gladly take you up on it. >>>>> >>>>> Similar specs to the current one would be great, but more disk space if >>>>> possible - the usage is increasing. >>>>> http://projects.theforeman.org/projects/foreman/wiki/Jenkins#Slave-requirements >>>>> lists current specs. >>>>> >>>>> A regular EL7 installation with my SSH key >>>>> (https://m0dlx.com/ssh_redhat.pub) installed for root would be enough >>>>> for me to set it up. >>>>> >>>> Would an m3.medium from ec2 be helpful? >>> >>> If additional storage is available, yes, as the requirements (link >>> above) are for a minimum of 60GB space, not the 4GB it appears that the >>> m3.medium spec has. >>> >> I mis read that. Are any of the slaves ec2 now? If so, do you know the size? > > No, not to my knowledge. >

Thanks, the slave is now online with three slots.

··· On 31/08/16 16:55, Bryan Kearney wrote: > On 08/31/2016 09:30 AM, Dominic Cleal wrote: >> On 31/08/16 14:30, Bryan Kearney wrote: >>> On 08/31/2016 09:07 AM, Dominic Cleal wrote: >>>> On 31/08/16 14:04, Bryan Kearney wrote: >>>>> Would an m3.medium from ec2 be helpful? >>>> >>>> If additional storage is available, yes, as the requirements (link >>>> above) are for a minimum of 60GB space, not the 4GB it appears that the >>>> m3.medium spec has. >>>> >>> I mis read that. Are any of the slaves ec2 now? If so, do you know the size? >> >> No, not to my knowledge. >> > Lets try one: > > ec2-184-72-89-17.compute-1.amazonaws.com > > your ssh key should work


Dominic Cleal
dominic@cleal.org