[Openstack-operators] Compute nodes reboot periodically by their own

Tim Bell Tim.Bell at cern.ch
Thu Jul 24 15:42:05 UTC 2014


If it is the hypervisors rebooting, a possible scenario would be if you have a BMC and enabled watchdog. This will reboot the server if it does not call home to the BMC every 'n' seconds.

If you have a very busy hypervisor, you may need to tune the watchdog timeout.

I suspect something would be logged in the BMC ipmi sel logs but not sure.

Tim

> -----Original Message-----
> From: Arne Wiebalck [mailto:Arne.Wiebalck at cern.ch]
> Sent: 24 July 2014 17:10
> To: Juan José Pavlik Salles
> Cc: openstack-operators at lists.openstack.org
> Subject: Re: [Openstack-operators] Compute nodes reboot periodically by their
> own
> 
> Hi,
> 
> Your compute nodes reboot or are shut off?
> 
> I am currently looking at some cases where VMs seem to spontaneously shut
> themselves off. At least from the nova logs' perspective there is no difference to
> a normal shutdown, VM owners however confirm that they did not touch their
> VMs. So far I was unable to explain this.
> 
> This is with Havana on a RHEL6 derivative, though.
> 
> Cheers,
>  Arne
> 
> --
> Arne Wiebalck
> CERN IT
> 
> On 24 Jul 2014, at 16:46, Juan José Pavlik Salles <jjpavlik at gmail.com> wrote:
> 
> > Hello guys, We have got a small Grizzly cloud running since the begging of
> 2013 with Ubuntu 12.04. 2 compute nodes, a storage node and a controller,
> nothing too fancy. Everything works just fine, but... the compute nodes reboot
> themselves periodically, sometimes every 2 weeks, some times once a month.
> I've done almost everything I can think of: memory checks, analysed the logs,
> moved all the VMs to one node, and I just can't find the problem.
> >
> > Have you ever heard this kind of behaviour on compute nodes? Any ideas
> where I should look for the problem?
> >
> > Thanks in advance.
> >
> > --
> > Pavlik Salles Juan José
> > Blog - http://viviendolared.blogspot.com
> > _______________________________________________
> > OpenStack-operators mailing list
> > OpenStack-operators at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operator
> > s
> 
> 
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators



More information about the OpenStack-operators mailing list