[Openstack-operators] Help: Instances don't start
Christian Wittwer
wittwerch at gmail.com
Sat Aug 13 10:21:38 UTC 2011
I had the same problems recently. The solution was, to copy over the
/var/lib/nova/instances/_base folder to the compute node.
Somehow the images were not transfered from the controller to the compute nodes.
Chris
2011/7/11 Edier Zapata <edalzap at gmail.com>:
> Hi again, I just checked the BIOS and Vt is enabled, btw I reboot the
> node and sent the instance again, and same error:
>
> root at cluster1:/home/cluster/OpenStack-org# euca-run-instances $emi -k
> mykey -t m1.tiny
> RESERVATION r-n3iuhqxp Univalle default
> INSTANCE i-0000001a ami-1f75034f
> scheduling mykey (Univalle, None) 0 m1.tiny
> 2011-07-11T21:16:48Z unknown zone
>
> root at cluster1:/home/cluster/OpenStack-org# euca-describe-instances
> RESERVATION r-n3iuhqxp Univalle default
> INSTANCE i-0000001a ami-1f75034f 192.168.29.4
> 192.168.29.4 launching mykey (Univalle, cluster10) 0
> m1.tiny 2011-07-11T21:16:48Z nova
>
> root at cluster1:/home/cluster/OpenStack-org# euca-describe-instances
> RESERVATION r-n3iuhqxp Univalle default
> INSTANCE i-0000001a ami-1f75034f 192.168.29.4
> 192.168.29.4 shutdown mykey (Univalle, cluster10) 0
> m1.tiny 2011-07-11T21:16:48Z nova
>
> I didn't install anything but Nova, is Glance required to run
> Instances in multiple nodes? Do you any idea what's wrong?
>
> This is the Node's nova-compute.log:
>
> root at cluster10:/home/cluster# tail -f /var/log/nova/nova-compute.log
> 2011-07-11 16:16:48,874 DEBUG nova.rpc [-] received
> {u'_context_request_id': u'VPFPV7A78LIOTSM6PD98',
> u'_context_read_deleted': False, u'args': {u'instance_id': 26,
> u'injected_files': None, u'availability_zone': None},
> u'_context_is_admin': True, u'_context_timestamp':
> u'2011-07-11T21:16:48Z', u'_context_user': u'osadmin', u'method':
> u'run_instance', u'_context_project': u'Univalle',
> u'_context_remote_address': u'192.168.28.50'} from (pid=1629) _receive
> /usr/lib/pymodules/python2.6/nova/rpc.py:167
> 2011-07-11 16:16:48,875 DEBUG nova.rpc [-] unpacked context:
> {'timestamp': u'2011-07-11T21:16:48Z', 'remote_address':
> u'192.168.28.50', 'project': u'Univalle', 'is_admin': True, 'user':
> u'osadmin', 'request_id': u'VPFPV7A78LIOTSM6PD98', 'read_deleted':
> False} from (pid=1629) _unpack_context
> /usr/lib/pymodules/python2.6/nova/rpc.py:331
> 2011-07-11 16:16:49,030 AUDIT nova.compute.manager
> [VPFPV7A78LIOTSM6PD98 osadmin Univalle] instance 26: starting...
> 2011-07-11 16:16:49,255 DEBUG nova.rpc [-] Making asynchronous call on
> network.cluster1 ... from (pid=1629) call
> /usr/lib/pymodules/python2.6/nova/rpc.py:350
> 2011-07-11 16:16:49,255 DEBUG nova.rpc [-] MSG_ID is
> d5605654cd9c4002b35ee1593f66465f from (pid=1629) call
> /usr/lib/pymodules/python2.6/nova/rpc.py:353
> 2011-07-11 16:16:49,962 DEBUG nova.utils [-] Attempting to grab
> semaphore "ensure_bridge" for method "ensure_bridge"... from
> (pid=1629) inner /usr/lib/pymodules/python2.6/nova/utils.py:594
> 2011-07-11 16:16:49,963 DEBUG nova.utils [-] Attempting to grab file
> lock "ensure_bridge" for method "ensure_bridge"... from (pid=1629)
> inner /usr/lib/pymodules/python2.6/nova/utils.py:599
> 2011-07-11 16:16:49,964 DEBUG nova.utils [-] Running cmd (subprocess):
> ip link show dev br100 from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,161 DEBUG nova.virt.libvirt_conn [-] instance
> instance-0000001a: starting toXML method from (pid=1629) to_xml
> /usr/lib/pymodules/python2.6/nova/virt/libvirt_conn.py:996
> 2011-07-11 16:16:50,234 DEBUG nova.virt.libvirt_conn [-] instance
> instance-0000001a: finished toXML method from (pid=1629) to_xml
> /usr/lib/pymodules/python2.6/nova/virt/libvirt_conn.py:1041
> 2011-07-11 16:16:50,302 INFO nova [-] called setup_basic_filtering in nwfilter
> 2011-07-11 16:16:50,302 INFO nova [-] ensuring static filters
> 2011-07-11 16:16:50,376 INFO nova [-]
> <nova.db.sqlalchemy.models.SecurityGroupIngressRule object at
> 0x336c8d0>
> 2011-07-11 16:16:50,376 INFO nova [-]
> <nova.db.sqlalchemy.models.SecurityGroupIngressRule object at
> 0x336c850>
> 2011-07-11 16:16:50,382 DEBUG nova.utils [-] Attempting to grab
> semaphore "iptables" for method "apply"... from (pid=1629) inner
> /usr/lib/pymodules/python2.6/nova/utils.py:594
> 2011-07-11 16:16:50,383 DEBUG nova.utils [-] Attempting to grab file
> lock "iptables" for method "apply"... from (pid=1629) inner
> /usr/lib/pymodules/python2.6/nova/utils.py:599
> 2011-07-11 16:16:50,388 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-save -t filter from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,412 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-restore from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,436 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-save -t nat from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,459 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-restore from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,507 DEBUG nova.utils [-] Running cmd (subprocess):
> mkdir -p /var/lib/nova/instances/instance-0000001a/ from (pid=1629)
> execute /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,522 INFO nova.virt.libvirt_conn [-] instance
> instance-0000001a: Creating image
> 2011-07-11 16:16:50,591 DEBUG nova.utils [-] Attempting to grab
> semaphore "6332e1f2" for method "call_if_not_exists"... from
> (pid=1629) inner /usr/lib/pymodules/python2.6/nova/utils.py:594
> 2011-07-11 16:16:50,591 DEBUG nova.utils [-] Running cmd (subprocess):
> cp /var/lib/nova/instances/_base/6332e1f2
> /var/lib/nova/instances/instance-0000001a/kernel from (pid=1629)
> execute /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,620 DEBUG nova.utils [-] Attempting to grab
> semaphore "11412fa5" for method "call_if_not_exists"... from
> (pid=1629) inner /usr/lib/pymodules/python2.6/nova/utils.py:594
> 2011-07-11 16:16:50,620 DEBUG nova.utils [-] Running cmd (subprocess):
> cp /var/lib/nova/instances/_base/11412fa5
> /var/lib/nova/instances/instance-0000001a/ramdisk from (pid=1629)
> execute /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,666 DEBUG nova.utils [-] Attempting to grab
> semaphore "1f75034f_sm" for method "call_if_not_exists"... from
> (pid=1629) inner /usr/lib/pymodules/python2.6/nova/utils.py:594
> 2011-07-11 16:16:50,666 DEBUG nova.utils [-] Running cmd (subprocess):
> qemu-img create -f qcow2 -o
> cluster_size=2M,backing_file=/var/lib/nova/instances/_base/1f75034f_sm
> /var/lib/nova/instances/instance-0000001a/disk from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:50,776 INFO nova.virt.libvirt_conn [-] instance
> instance-0000001a: injecting key into image 527762255
> 2011-07-11 16:16:50,776 INFO nova.virt.libvirt_conn [-] instance
> instance-0000001a: injecting net into image 527762255
> 2011-07-11 16:16:50,791 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo qemu-nbd -c /dev/nbd15
> /var/lib/nova/instances/instance-0000001a/disk from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:51,852 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo tune2fs -c 0 -i 0 /dev/nbd15 from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:51,887 DEBUG nova.utils [-] Result was 1 from
> (pid=1629) execute /usr/lib/pymodules/python2.6/nova/utils.py:166
> 2011-07-11 16:16:51,890 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo qemu-nbd -d /dev/nbd15 from (pid=1629) execute
> /usr/lib/pymodules/python2.6/nova/utils.py:150
> 2011-07-11 16:16:51,922 WARNING nova.virt.libvirt_conn [-] instance
> instance-0000001a: ignoring error injecting data into image 527762255
> (Unexpected error while running command.
> Command: sudo tune2fs -c 0 -i 0 /dev/nbd15
> Exit code: 1
> Stdout: 'tune2fs 1.41.11 (14-Mar-2010)\n'
> Stderr: "tune2fs: Invalid argument while trying to open
> /dev/nbd15\r\nCouldn't find valid filesystem superblock.\n")
> 2011-07-11 16:17:23,572 ERROR nova.exception [-] Uncaught exception
> (nova.exception): TRACE: Traceback (most recent call last):
> (nova.exception): TRACE: File
> "/usr/lib/pymodules/python2.6/nova/exception.py", line 120, in _wrap
> (nova.exception): TRACE: return f(*args, **kw)
> (nova.exception): TRACE: File
> "/usr/lib/pymodules/python2.6/nova/virt/libvirt_conn.py", line 617, in
> spawn
> (nova.exception): TRACE: domain = self._create_new_domain(xml)
> (nova.exception): TRACE: File
> "/usr/lib/pymodules/python2.6/nova/virt/libvirt_conn.py", line 1079,
> in _create_new_domain
> (nova.exception): TRACE: domain.createWithFlags(launch_flags)
> (nova.exception): TRACE: File
> "/usr/lib/python2.6/dist-packages/libvirt.py", line 337, in
> createWithFlags
> (nova.exception): TRACE: if ret == -1: raise libvirtError
> ('virDomainCreateWithFlags() failed', dom=self)
> (nova.exception): TRACE: libvirtError: internal error process exited
> while connecting to monitor: char device redirected to /dev/pts/1
> (nova.exception): TRACE: qemu: could not load kernel
> '/var/lib/nova/instances/instance-0000001a/kernel': Permission denied
> (nova.exception): TRACE:
> (nova.exception): TRACE:
> 2011-07-11 16:17:23,600 ERROR nova.compute.manager
> [VPFPV7A78LIOTSM6PD98 osadmin Univalle] Instance '26' failed to spawn.
> Is virtualization enabled in the BIOS?
> (nova.compute.manager): TRACE: Traceback (most recent call last):
> (nova.compute.manager): TRACE: File
> "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 234, in
> run_instance
> (nova.compute.manager): TRACE: self.driver.spawn(instance_ref)
> (nova.compute.manager): TRACE: File
> "/usr/lib/pymodules/python2.6/nova/exception.py", line 126, in _wrap
> (nova.compute.manager): TRACE: raise Error(str(e))
> (nova.compute.manager): TRACE: Error: internal error process exited
> while connecting to monitor: char device redirected to /dev/pts/1
> (nova.compute.manager): TRACE: qemu: could not load kernel
> '/var/lib/nova/instances/instance-0000001a/kernel': Permission denied
> (nova.compute.manager): TRACE:
> (nova.compute.manager): TRACE:
> 2011-07-11 16:17:23,866 INFO nova.compute.manager [-] Found instance
> 'instance-0000001a' in DB but no VM. State=5, so setting state to
> shutoff.
>
> Thank you.
>
> --
> Edier Alberto Zapata Hernández
> Ingeniero de Sistemas
> Universidad de Valle
> _______________________________________________
> Openstack-operators mailing list
> Openstack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
More information about the Openstack-operators
mailing list