Puppet timeout while reporting to Foreman

Support
1

Hi,

I am receiving the following error on a specific node, at the end of the
Puppet run. I get an email report from the Puppetmaster informing about the
success of the puppet run, so I am sure it isn't a Puppet error. But I
don't get a report in Foreman and also the web server log has a HTTP 500
against that specific request, so I am sure that this a problem with my
Foreman installation.

Also, only this specific node fails to report to Foreman. All others can
very well send reports to Foreman.

Puppet error and traceback: http://pastebin.com/UXSCnQEX

What is happening and how can I fix it ?

Thanks.

2

> Hi,
>
> I am receiving the following error on a specific node, at the end of the
> Puppet run. I get an email report from the Puppetmaster informing about the
> success of the puppet run, so I am sure it isn't a Puppet error. But I
> don't get a report in Foreman and also the web server log has a HTTP 500
> against that specific request, so I am sure that this a problem with my
> Foreman installation.
>
> Also, only this specific node fails to report to Foreman. All others can
> very well send reports to Foreman.
>
> Puppet error and traceback: http://pastebin.com/UXSCnQEX
>
> can you add your foreman logs from the same time?

thanks,
Ohad

··· On Mon, Aug 12, 2013 at 10:25 AM, Knight Samar wrote:

What is happening and how can I fix it ?

Thanks.

–
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-users+unsubscribe@googlegroups.com.
To post to this group, send email to foreman-users@googlegroups.com.
Visit this group at http://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/groups/opt_out.

3

Hi Ohad,

The foreman production log excerpt at :debug level is here.

http://pastebin.com/wfR8XCXQ

··· On Monday, 12 August 2013 13:00:15 UTC+5:30, ohad wrote: > > > > On Mon, Aug 12, 2013 at 10:25 AM, Knight Samar <knigh...@gmail.com > > wrote: > >> Hi, >> >> I am receiving the following error on a specific node, at the end of the >> Puppet run. I get an email report from the Puppetmaster informing about the >> success of the puppet run, so I am sure it isn't a Puppet error. But I >> don't get a report in Foreman and also the web server log has a HTTP 500 >> against that specific request, so I am sure that this a problem with my >> Foreman installation. >> >> Also, only this specific node fails to report to Foreman. All others can >> very well send reports to Foreman. >> >> Puppet error and traceback: http://pastebin.com/UXSCnQEX >> >> can you add your foreman logs from the same time? > > thanks, > Ohad > >> What is happening and how can I fix it ? >> >> Thanks. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Foreman users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to foreman-user...@googlegroups.com . >> To post to this group, send email to forema...@googlegroups.com >> . >> Visit this group at http://groups.google.com/group/foreman-users. >> For more options, visit https://groups.google.com/groups/opt_out. >> > >
4

And this is happening only when processing reports for this specific
particular machine. I have also checked disk-space on the server as hinted
in the logs, and there is ample amount of disk space available.

··· On Wednesday, 14 August 2013 18:08:30 UTC+5:30, Knight Samar wrote: > > Hi Ohad, > > The foreman production log excerpt at :debug level is here. > > http://pastebin.com/wfR8XCXQ > > > On Monday, 12 August 2013 13:00:15 UTC+5:30, ohad wrote: >> >> >> >> On Mon, Aug 12, 2013 at 10:25 AM, Knight Samar wrote: >> >>> Hi, >>> >>> I am receiving the following error on a specific node, at the end of the >>> Puppet run. I get an email report from the Puppetmaster informing about the >>> success of the puppet run, so I am sure it isn't a Puppet error. But I >>> don't get a report in Foreman and also the web server log has a HTTP 500 >>> against that specific request, so I am sure that this a problem with my >>> Foreman installation. >>> >>> Also, only this specific node fails to report to Foreman. All others can >>> very well send reports to Foreman. >>> >>> Puppet error and traceback: http://pastebin.com/UXSCnQEX >>> >>> can you add your foreman logs from the same time? >> >> thanks, >> Ohad >> >>> What is happening and how can I fix it ? >>> >>> Thanks. >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Foreman users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to foreman-user...@googlegroups.com. >>> To post to this group, send email to forema...@googlegroups.com. >>> Visit this group at http://groups.google.com/group/foreman-users. >>> For more options, visit https://groups.google.com/groups/opt_out. >>> >> >>
5

I found the same error about Disk space in the PostgreSQL logs too, but as
I said it doesn't look like I am out of disk space or inodes.

I google around for similar problems and found this -

Would there be a similar error in the Foreman code ? Though it sounds weird
that the missing parentheses might result in a disk space error.

··· On Wednesday, 14 August 2013 18:10:34 UTC+5:30, Knight Samar wrote: > > And this is happening only when processing reports for this specific > particular machine. I have also checked disk-space on the server as hinted > in the logs, and there is ample amount of disk space available. > > On Wednesday, 14 August 2013 18:08:30 UTC+5:30, Knight Samar wrote: >> >> Hi Ohad, >> >> The foreman production log excerpt at :debug level is here. >> >> http://pastebin.com/wfR8XCXQ >> >> >> On Monday, 12 August 2013 13:00:15 UTC+5:30, ohad wrote: >>> >>> >>> >>> On Mon, Aug 12, 2013 at 10:25 AM, Knight Samar wrote: >>> >>>> Hi, >>>> >>>> I am receiving the following error on a specific node, at the end of >>>> the Puppet run. I get an email report from the Puppetmaster informing about >>>> the success of the puppet run, so I am sure it isn't a Puppet error. But I >>>> don't get a report in Foreman and also the web server log has a HTTP 500 >>>> against that specific request, so I am sure that this a problem with my >>>> Foreman installation. >>>> >>>> Also, only this specific node fails to report to Foreman. All others >>>> can very well send reports to Foreman. >>>> >>>> Puppet error and traceback: http://pastebin.com/UXSCnQEX >>>> >>>> can you add your foreman logs from the same time? >>> >>> thanks, >>> Ohad >>> >>>> What is happening and how can I fix it ? >>>> >>>> Thanks. >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Foreman users" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to foreman-user...@googlegroups.com. >>>> To post to this group, send email to forema...@googlegroups.com. >>>> Visit this group at http://groups.google.com/group/foreman-users. >>>> For more options, visit https://groups.google.com/groups/opt_out. >>>> >>> >>>
6

This problem is now occurring arbitrarily.

··· On Wednesday, 14 August 2013 18:26:44 UTC+5:30, Knight Samar wrote: > > I found the same error about Disk space in the PostgreSQL logs too, but as > I said it doesn't look like I am out of disk space or inodes. > > I google around for similar problems and found this - > http://serverfault.com/questions/249183/postgresql-no-space-left-on-device > > Would there be a similar error in the Foreman code ? Though it sounds > weird that the missing parentheses might result in a disk space error. > > On Wednesday, 14 August 2013 18:10:34 UTC+5:30, Knight Samar wrote: >> >> And this is happening only when processing reports for this specific >> particular machine. I have also checked disk-space on the server as hinted >> in the logs, and there is ample amount of disk space available. >> >> On Wednesday, 14 August 2013 18:08:30 UTC+5:30, Knight Samar wrote: >>> >>> Hi Ohad, >>> >>> The foreman production log excerpt at :debug level is here. >>> >>> http://pastebin.com/wfR8XCXQ >>> >>> >>> On Monday, 12 August 2013 13:00:15 UTC+5:30, ohad wrote: >>>> >>>> >>>> >>>> On Mon, Aug 12, 2013 at 10:25 AM, Knight Samar wrote: >>>> >>>>> Hi, >>>>> >>>>> I am receiving the following error on a specific node, at the end of >>>>> the Puppet run. I get an email report from the Puppetmaster informing about >>>>> the success of the puppet run, so I am sure it isn't a Puppet error. But I >>>>> don't get a report in Foreman and also the web server log has a HTTP 500 >>>>> against that specific request, so I am sure that this a problem with my >>>>> Foreman installation. >>>>> >>>>> Also, only this specific node fails to report to Foreman. All others >>>>> can very well send reports to Foreman. >>>>> >>>>> Puppet error and traceback: http://pastebin.com/UXSCnQEX >>>>> >>>>> can you add your foreman logs from the same time? >>>> >>>> thanks, >>>> Ohad >>>> >>>>> What is happening and how can I fix it ? >>>>> >>>>> Thanks. >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Foreman users" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to foreman-user...@googlegroups.com. >>>>> To post to this group, send email to forema...@googlegroups.com. >>>>> Visit this group at http://groups.google.com/group/foreman-users. >>>>> For more options, visit https://groups.google.com/groups/opt_out. >>>>> >>>> >>>>