[Openstack] Can't launch VM with XCP plus OpenStack Essex release version
John Garbutt
John.Garbutt at citrix.com
Mon Jun 11 10:59:56 UTC 2012
Happy to help :-)
You shouldn't need to use kpartx yourself.
We may need to use it in the nova code where we try to mount VDIs in Dom0 (in XenAPI plugins)
Long term, I should probably look at ways around doing that.
Cheers,
John
> -----Original Message-----
> From: suzuki at midokura.jp [mailto:suzuki at midokura.jp] On Behalf Of
> Takaaki Suzuki
> Sent: 11 June 2012 11:37
> To: John Garbutt
> Cc: openstack at lists.launchpad.net; dev; Ryu Ishimoto; Mike McClurg
> Subject: Re: [Openstack] Can't launch VM with XCP plus OpenStack Essex
> release version
>
> Hi John.
>
> Thank you for your support again :)
>
> > Also, what sort of VM are you trying to launch? Is it a three part image with
> external kernel?
> Yes, I use this VM images.
> ttylinux-uec-amd64-12.1_2.6.35-22_1
> - ttylinux-uec-amd64-12.1_2.6.35-22_1.img
> - ttylinux-uec-amd64-12.1_2.6.35-22_1-initrd
> - ttylinux-uec-amd64-12.1_2.6.35-22_1-loader
>
> cirros-0.3.0-x86_64-uec
> - cirros-0.3.0-x86_64-blank.img
> - cirros-0.3.0-x86_64-initrd
> - cirros-0.3.0-x86_64-vmlinuz
>
> I'll check use EXT3 local SR and "kpartx" command.
>
> Thanks!
> Suzuki
>
> On Mon, Jun 11, 2012 at 7:03 PM, John Garbutt <John.Garbutt at citrix.com>
> wrote:
> > It is not well documented (I promise to work on that soon), but you should
> use an EXT3 local SR, not LVM. It is certainly worth moving to EXT3, just to
> rule a few things out.
> >
> > I see you are using the Ubuntu XCP packages. This is a version of XenAPI I
> have not yet started doing much QA on, but I did get a VM started OK when
> using EXT3. However, I used to get LVM working for the basics with earlier
> versions of xenapi, so I am shocked that is totally broken on the latest.
> >
> > Also, what sort of VM are you trying to launch? Is it a three part image with
> external kernel?
> >
> > If you want to get going with XenAPI and OpenStack quickly, I would
> recommend DevStack and XenServer 6.0.2 (free download) or XCP 1.5 Beta.
> That is the combination I am testing today. Hoping to test Ubuntu XCP and
> OpenStack in the next few weeks.
> >
> > Thanks,
> > John
> >
> > PS:
> > I think the problem you are hitting is because there was a recent change in
> XCP/XenAPI where mounting the VDI into dom0 no longer automatically
> exposes the partitions of that disk to the Dom0 Kernel, so you need to use
> kpartx (or similar) to mount to appropriate partition. I can see you are hit this
> because the device returned is "/dev/sm/<guid>/<guid>" rather than
> "/dev/sda1" or something like that. I got normal VMs working OK despite this,
> but have not yet gone through all the XenAPI plugins to ensure all the issues
> are fixed.
> >
> >> -----Original Message-----
> >> From:
> >> openstack-bounces+john.garbutt=eu.citrix.com at lists.launchpad.net
> >> [mailto:openstack-bounces+john.garbutt=eu.citrix.com at lists.launchpad.
> >> net]
> >> On Behalf Of Takaaki Suzuki
> >> Sent: 11 June 2012 04:07
> >> To: openstack at lists.launchpad.net
> >> Cc: dev; Ryu Ishimoto
> >> Subject: [Openstack] Can't launch VM with XCP plus OpenStack Essex
> >> release version
> >>
> >> Hi all.
> >>
> >> I need your support again.
> >> We had this parted error with XCP plus OpenStack Essex release version.
> >> Nova can't launch VM with XCP with OpenStack. I use SR with Local LVM.
> >> Did you get parted command error? If you have any idea.
> >> Please let me know.
> >>
> >> --------------------------
> >> nova-compute log:
> >> --------------------------
> >> 2012-06-11 11:42:49 DEBUG nova.compute.manager
> >> [req-85e34ab4-885c-4006-ac22-47b0323b9e21
> >> 4a7c390b523d40c49aab4ca4dfd92ced 6f9b5c555cc94910bf5b7b4a0b3af4b6]
> >> [instance: ae09a885-ab5c-4b10-9582-73423932e40c] Deallocati ng
> >> network for instance from (pid=3057) _deallocate_network
> >> /usr/lib/python2.7/dist-packages/nova/compute/manager.py:616
> >> 2012-06-11 11:42:49 DEBUG nova.rpc.amqp
> >> [req-85e34ab4-885c-4006-ac22-47b0323b9e21
> >> 4a7c390b523d40c49aab4ca4dfd92ced 6f9b5c555cc94910bf5b7b4a0b3af4b6]
> >> Making asynchronous cast on network... from (pid=3057) cast /usr/l
> >> ib/python2.7/dist-packages/nova/rpc/amqp.py:346
> >> 2012-06-11 11:42:49 ERROR nova.rpc.amqp
> >> [req-85e34ab4-885c-4006-ac22-47b0323b9e21
> >> 4a7c390b523d40c49aab4ca4dfd92ced 6f9b5c555cc94910bf5b7b4a0b3af4b6]
> >> Exception during message handling
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp Traceback (most recent call
> last):
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 252, in
> >> _process_data
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp rval =
> >> node_func(context=ctxt, **node_args)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in
> >> wrapped
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp return f(*args, **kw)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 177,
> >> in decorated_function
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp sys.exc_info())
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp self.gen.next()
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 171,
> >> in decorated_function
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp return function(self,
> >> context, instance_uuid, *args, **kwargs)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 651,
> >> in run_instance
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp do_run_instance()
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/utils.py", line 945, in inner
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp retval = f(*args,
> >> **kwargs)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 650,
> >> in do_run_instance
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp self._run_instance(context,
> >> instance_uuid, **kwargs)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 451,
> >> in _run_instance
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp
> >> self._set_instance_error_state(context, instance_uuid)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp self.gen.next()
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 432,
> >> in _run_instance
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp
> >> self._deallocate_network(context, instance)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp self.gen.next()
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 429,
> >> in _run_instance
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp injected_files,
> >> admin_password)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 592,
> >> in _spawn
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp
> >> self._legacy_nw_info(network_info), block_device_info)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi_conn.py", line
> >> 184, in spawn
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp
> >> self._vmops.spawn(context, instance, image_meta, network_info)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line
> >> 359, in spawn
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp
> >> undo_mgr.rollback_and_reraise(msg=msg)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/utils.py", line 1714, in
> >> rollback_and_reraise
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp self._rollback()
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp self.gen.next()
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line
> >> 346, in spawn
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp vdis =
> >> create_disks_step(undo_mgr)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line
> >> 138, in inner
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp rv = f(*args, **kwargs)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line
> >> 265, in create_disks_step
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp vdis =
> >> self._create_disks(context, instance, image_meta)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line
> >> 242, in _create_disks
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp disk_image_type)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vm_utils.py", line
> >> 626, in create_image
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp project_id, image_type)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vm_utils.py", line
> >> 687, in fetch_image
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp session, instance, image,
> >> image_type)
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp File
> >> "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vm_utils.py", line
> >> 887, in _fetch_image_glance_disk
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp raise e
> >> 2012-06-11 11:42:49 TRACE nova.rpc.amqp ProcessExecutionError:
> >> (u'Unexpected error while running command.\nCommand: sudo
> >> /usr/bin/nova-rootwrap parted --script
> >> /dev/sm/backend/ef2d3c8e-2b8a-f51f-29b8-53736fa69c04/f01b7442-
> 47fc-
> >> 4cda-bc6c-8e56b9d3ad70
> >> mkpart primary 63s 49214s\nExit code: 1\nStdout: "Warning: The
> >> resulting partition is not properly aligned for best
> >> performance.\\nError: Error informing the kernel about modifications
> >> to partition /dev/sm/backend/ef2d3c8e-2b8a-f51f-29b8-
> >> 53736fa69c04/f01b7442-47
> >> -- Invalid argument. This means Linux won\'t know about any changes
> >> you made to /dev/sm/backend/ef2d3c8e-2b8a-f51f-29b8-
> >> 53736fa69c04/f01b7442-47
> >> until you reboot -- so you shouldn\'t mount it or use it in any way
> >> before
> >> rebooting.\\nError: Failed to add partition 1 (Invalid
> >> argument)\\n"\nStderr: \'\'', [{'file': None, 'vdi_type': 'os',
> >> 'vdi_uuid': 'f01b7442-47fc-4cda-bc6c-8e56b9d3ad70'}])
> >>
> >> -----------------------------
> >> Storage Repository:
> >> -----------------------------
> >> uuid ( RO) : ef2d3c8e-2b8a-f51f-29b8-53736fa69c04
> >> name-label ( RW): Local storage
> >> name-description ( RW):
> >> host ( RO): xcp
> >> allowed-operations (SRO): forget; VDI.create; VDI.snapshot;
> >> plug; update; destroy; VDI.destroy; scan; VDI.clone; VDI.resize;
> >> unplug
> >> current-operations (SRO):
> >> VDIs (SRO): f01b7442-47fc-4cda-bc6c-8e56b9d3ad70;
> >> 73b8fc96-8293-4095-9ebb-c5169128f938;
> >> cf9cc9ac-455a-450d-a3c4-65fce459564a;
> >> ce0c1a80-af38-4bcf-8952-9497bf3d5369;
> >> ddcc5a29-f086-48cf-ab67-9daf48e7869a;
> >> 72627def-e0d4-4ef2-a1d2-503717a5b9b1;
> >> fb5768f7-a7e5-47dc-bf15-558a240a89c3;
> >> f1815b48-cb47-4c77-833e-6defe3fcb8b4;
> >> 3b6a9c02-18e9-4ebe-bd4c-c8fdac3ab439;
> >> 429b673c-ebc4-43c0-9c80-b3a3cfd0ef3e;
> >> 1f3161cc-1390-4eec-be97-7de1a89d2c14;
> >> f21707dd-e47a-4921-adee-c201d6ecaf22;
> >> d7d6a689-bc23-4906-b191-edcd0484c0eb;
> >> 202fe917-8f79-4c49-bb82-9a5a20a97a1d;
> >> 8ef53a62-c1ac-462a-9c0b-8f02bfce00d6;
> >> 8403e6a2-9c96-4e5d-a9e5-11590ec6cda1;
> >> 52277317-e909-4c5c-8aaf-36421b9480fe;
> >> 1a4c0c5f-cd48-43a2-bfbb-61066f5e899b;
> >> 520b53f8-b823-4249-9200-33aa01fe4244;
> >> c0ec57e4-7f2f-4bd0-a5bd-0644569c3232;
> >> 624ea328-bd99-4fc8-a8f8-a86fc490ad90;
> >> 1e8adf15-19ba-4157-aa03-6f8fc656e909
> >> PBDs (SRO): 13bcec09-f4fd-3f7e-1d5d-5bb6f6bcbb57
> >> virtual-allocation ( RO): 17725128704
> >> physical-utilisation ( RO): 255504384
> >> physical-size ( RO): 211366371328
> >> type ( RO): ext
> >> content-type ( RO): user
> >> shared ( RW): true
> >> introduced-by ( RO): <not in database>
> >> other-config (MRW): i18n-key: local-storage
> >> sm-config (MRO): devserial:
> >> blobs ( RO):
> >> local-cache-enabled ( RO): false
> >> tags (SRW):
> >>
> >> -------------------------
> >> Install packages:
> >> -------------------------
> >> ii nova-ajax-console-proxy 2012.1-0ubuntu2.1 OpenStack
> >> Compute - AJAX console proxy - transitional package ii nova-
> api
> >> 2012.1-0ubuntu2.2
> >> OpenStack Compute - API frontend ii nova-cert
> >> 2012.1-0ubuntu2.2
> >> OpenStack Compute - certificate management ii nova-
> common
> >> 2012.1-0ubuntu2.2 OpenStack Compute - common files ii nova-
> compute
> >> 2012.1-0ubuntu2.2
> >> OpenStack Compute - compute node
> >> ii nova-compute-xen 2012.1-0ubuntu2.2 OpenStack
> >> Compute - compute node (Xen) ii nova-consoleauth
> >> 2012.1-0ubuntu2.2 OpenStack Compute - Console Authenticator ii
> >> nova-doc 2012.1-0ubuntu2.1
> >> OpenStack Compute - documentation ii nova-network
> >> 2012.1-0ubuntu2.2
> >> OpenStack Compute - Network manager ii nova-scheduler
> >> 2012.1-0ubuntu2.2
> >> OpenStack Compute - virtual machine scheduler ii
> >> nova-vncproxy 2012.1-0ubuntu2.2
> >> OpenStack Compute - VNC proxy
> >> ii nova-volume 2012.1-0ubuntu2.2
> >> OpenStack Compute - storage
> >> ii nova-xcp-network 2012.1-0ubuntu2.2
> >> OpenStack Compute network plugin for the Xen Cloud Platform ii
> >> nova-xcp-plugins 2012.1-0ubuntu2.2
> >> OpenStack Compute plugin for the Xen Cloud Platform ii
> >> python-nova 2012.1-0ubuntu2.2
> >> OpenStack Compute Python libraries ii python-novaclient
> >> 2012.1-0ubuntu1
> >> client library for OpenStack Compute API ii nova-xcp-network
> >> 2012.1-0ubuntu2.2
> >> OpenStack Compute network plugin for the Xen Cloud Platform ii
> >> nova-xcp-plugins 2012.1-0ubuntu2.2
> >> OpenStack Compute plugin for the Xen Cloud Platform ii
> >> xcp-eliloader 0.1-4
> >> XenAPI's bootloader for EL-based guests ii xcp-fe
> >> 0.5.2-3
> >> Fork-and-exec daemon for xapi
> >> ii xcp-guest-templates 0.1-3
> >> Guest template generator for XCP ii xcp-networkd
> >> 1.3.2-5
> >> Xen Cloud Platform - network configuration daemon ii
> >> xcp-squeezed 1.3.2-5
> >> Xen Cloud Platform - memory ballooning daemon ii
> >> xcp-storage-managers 0.1.1-2ubuntu1
> >> storage backends for XCP
> >> ii xcp-v6d 1.3.2-5
> >> Xen Cloud Platform - feature daemon ii xcp-vncterm
> >> 0.1-2
> >> Provides VNC service for XCP guest VMs ii xcp-xapi
> >> 1.3.2-5
> >> Xen Cloud Platform - XenAPI server ii xcp-xe
> >> 1.3.2-5
> >> Xen Cloud Platform - command-line utilities
> >>
> >> Thanks!
> >> Suzuki
> >>
> >> _______________________________________________
> >> Mailing list: https://launchpad.net/~openstack Post to :
> >> openstack at lists.launchpad.net Unsubscribe :
> >> https://launchpad.net/~openstack More help :
> >> https://help.launchpad.net/ListHelp
More information about the Openstack
mailing list