Open Stack

On 10/11/15 00:41, Eren Türkay wrote:
> On 09-11-2015 12:39, Heiko Krämer wrote:
>> You're right only a hard reboot can solve the problem because SSH
>> login or other commands can't be executed because the whole system was
>> frozen.
>
> Hello Heiko,
>
> I just want to give some tips about debugging those kind of issues. I had
> completely different problem which hanged the machine and I needed to debug it.
> Since I couldn't access the logs, I setup kernel debugging to remote server. It
> is called netconsole. You may want to setup netconsole listener on one of the
> working servers outside of your swift, and setup netconsole on the servers that
> hang. Here is the information about how to setup:
>
> https://www.kernel.org/doc/Documentation/networking/netconsole.txt
>
> At least you may be able to see the kernel log just before the machines hang. I
> hope you find it useful.
>
>

Also might be worth looking at using the remote logging capability of 
rsyslog to collect your swift logs on another server, so you can see 
what is/was happening on the swift side of things immediately before any 
hang.

regards

Mark