Open Stack

I have created three instances using ubuntu's official image on my OpenStack
controller node.

Two of them have run for more than three weeks.

The third have run for two weeks.

In the past weeks I used were normal.

 

Suddenly, all of them can't be accessed by ssh with key.

And when I ping them, reply "Request time out".

On the dashboard, the status is active, and the power state is running. 

 

The instance console log is:

cloudinit startlocal running: Fri, 27 Sep 2013 05:30:33 +0000. up 5.54
seconds

no instance data found in startlocal

ciinfo: lo    : 1 127.0.0.1       255.0.0.0       .

ciinfo: eth0  : 1 10.167.35.142   255.255.255.0   fa:16:3e:31:83:9c

ciinfo: route0: 0.0.0.0         10.167.35.1     0.0.0.0         eth0   UG

ciinfo: route1: 10.167.35.0     0.0.0.0         255.255.255.0   eth0   U

ciinfo: route2: 169.254.169.254 10.167.35.141   255.255.255.255 eth0   UGH

cloudinit start running: Fri, 27 Sep 2013 05:30:34 +0000. up 6.09 seconds

found data source: DataSourceEc2

20130927 05:30:47,626  __init__.py[WARNING]: Unhandled nonmultipart userdata
''

Skipping profile in /etc/apparmor.d/disable: usr.sbin.rsyslogd

 * Starting AppArmor profiles       [80G [74G[ OK ]

landscapeclient is not configured, please run landscapeconfig.

 * Stopping System V initialisation compatibility[74G[ OK ]

 * Starting System V runlevel compatibility[74G[ OK ]

 * Starting save kernel messages[74G[ OK ]

acpid: starting up with proc fs

 * Starting ACPI daemon[74G[ OK ]

 * Starting automatic crash report generation[74G[ OK ]

 * Starting regular background program processing daemon[74G[ OK ]

 * Starting deferred execution scheduler[74G[ OK ]

 * Stopping save kernel messages[74G[ OK ]

 * Starting CPU interrupts balancing daemon[74G[ OK ]

acpid: 1 rule loaded

acpid: waiting for events: event logging is off

 * Starting MySQL Server[74G[[31mfail[39;49m]

 * Starting crash report submission daemon[74G[ OK ]

 * Starting system logging daemon[74G[ OK ]

 * Starting Handle applying cloudconfig[74G[ OK ]

 * Stopping Handle applying cloudconfig[74G[ OK ]

apache2: apr_sockaddr_info_get() failed for webserver

apache2: Could not reliably determine the server's fully qualified domain
name, using 127.0.0.1 for ServerName

 * Starting web server apache2       [80G [74G[ OK ]

 * Stopping System V runlevel compatibility[74G[ OK ]

 * Starting execute cloud user/final scripts[74G[ OK ]

cloudinit boot finished at Fri, 27 Sep 2013 05:30:50 +0000. Up 22.48 seconds

[ 3601.676137] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 3602.155585] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 3722.759789] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 3722.760682] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 3842.760065] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 3842.760815] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 3962.760093] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 3962.760839] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 4082.760060] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 4082.760932] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 4202.760097] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 4202.760985] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 4322.760058] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 4322.760936] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 4442.760085] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 4442.761002] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 4682.760064] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 4682.761029] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

[ 5762.760082] INFO: task jbd2/vdc18:1980 blocked for more than 120 seconds.

[ 5762.761044] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.

 

Thanks.

 

malei

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130929/1976a68d/attachment.html>