<html><body><div style="font-family: times new roman, new york, times, serif; font-size: 10pt; color: #000000"><div>Hello Everyone<br></div><div><br></div><div>Thanks for your quick response , i am glad to be a part of such a responsive community <img src="cid:33200bc8c333e7789f7a6a39ea091b3ea178815d@zimbra" alt="Sealed" title="Sealed" border="0"></div><div><br></div><div><br></div><div>I am using qemu-kvm provided by ceph repository that have RBD support . Using this i am able to create RBD volumes and its working good.</div><div><br></div><div><br></div><div><p style="margin: 0px;" data-mce-style="margin: 0px;">[root@rdo qemu(keystone_admin)]# rbd list ceph-volumes<br>volume-0e2bfced-be6a-44ec-a3ca-22c771c66cdc<br>volume-10cc0855-652a-4a9b-baa1-80bc86dc12ac<br>volume-5e09ce7b-b874-4c24-97ae-341a305841d5<br>volume-9671edaa-62c8-4f98-a36c-d6e59612141b<br>volume-a75d435b-ebce-4013-9c68-8df5d2c917e1<br>volume-dd315dda-b22a-4cf8-8b77-7c2b2f163155<br>[root@rdo qemu(keystone_admin)]#</p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><strong>I tried below steps needed for booting from volume</strong></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><a href="http://docs.openstack.org/user-guide/content/boot_from_volume.html">http://docs.openstack.org/user-guide/content/boot_from_volume.html</a></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;">[root@rdo nova(keystone_admin)]# nova image-list<br>+--------------------------------------+-----------------------------+--------+--------+<br>| ID | Name | Status | Server |<br>+--------------------------------------+-----------------------------+--------+--------+<br>| f61edc8d-c9a1-4ff4-b4fc-c8128bd1a10b | Ubuntu 12.04 cloudimg amd64 | ACTIVE | |<br>| fcc07414-bbb3-4473-a8df-523664c8c9df | ceph-glance-image | ACTIVE | |<br>| be62a5bf-879f-4d1f-846c-fdef960224ff | precise-cloudimg.raw | ACTIVE | |<br>| 3c2db0ad-8d1e-400d-ba13-a506448f2a8e | precise-server-cloudimg | ACTIVE | |<br>+--------------------------------------+-----------------------------+--------+--------+<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]# cinder list<br>+--------------------------------------+-----------+---------------------------+------+--------------+----------+--------------------------------------+<br>| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |<br>+--------------------------------------+-----------+---------------------------+------+--------------+----------+--------------------------------------+<br>| 0e2bfced-be6a-44ec-a3ca-22c771c66cdc | in-use | nova-vol_1 | 2 | None | false | 9d3c327f-1893-40ff-8a82-16fad9ce6d91 |<br>| 10cc0855-652a-4a9b-baa1-80bc86dc12ac | available | ceph-vol1 | 5 | ceph-storage | false | |<br>| 5e09ce7b-b874-4c24-97ae-341a305841d5 | available | precise-cloudimg_vol_boot | 5 | None | true | |<br>| 9671edaa-62c8-4f98-a36c-d6e59612141b | available | boot_from_volume | 20 | None | false | |<br>| a75d435b-ebce-4013-9c68-8df5d2c917e1 | available | dashboard-volume | 1 | ceph-storage | false | |<br>+--------------------------------------+-----------+---------------------------+------+--------------+----------+--------------------------------------+<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]# cinder create --image-id be62a5bf-879f-4d1f-846c-fdef960224ff --display-name new_boot_from_vol 10<br>+---------------------+--------------------------------------+<br>| Property | Value |<br>+---------------------+--------------------------------------+<br>| attachments | [] |<br>| availability_zone | nova |<br>| bootable | false |<br>| created_at | 2013-12-05T12:34:45.241324 |<br>| display_description | None |<br>| display_name | new_boot_from_vol |<br>| id | dd315dda-b22a-4cf8-8b77-7c2b2f163155 |<br>| image_id | be62a5bf-879f-4d1f-846c-fdef960224ff |<br>| metadata | {} |<br>| size | 10 |<br>| snapshot_id | None |<br>| source_volid | None |<br>| status | creating |<br>| volume_type | None |<br>+---------------------+--------------------------------------+<br>[root@rdo nova(keystone_admin)]#</p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;">[root@rdo nova(keystone_admin)]# cinder list</p><p style="margin: 0px;" data-mce-style="margin: 0px;">+--------------------------------------+-----------+---------------------------+------+--------------+----------+--------------------------------------+<br>| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |<br>+--------------------------------------+-----------+---------------------------+------+--------------+----------+--------------------------------------+<br>| 0e2bfced-be6a-44ec-a3ca-22c771c66cdc | in-use | nova-vol_1 | 2 | None | false | 9d3c327f-1893-40ff-8a82-16fad9ce6d91 |<br>| 10cc0855-652a-4a9b-baa1-80bc86dc12ac | available | ceph-vol1 | 5 | ceph-storage | false | |<br>| 5e09ce7b-b874-4c24-97ae-341a305841d5 | available | precise-cloudimg_vol_boot | 5 | None | true | |<br>| 9671edaa-62c8-4f98-a36c-d6e59612141b | available | boot_from_volume | 20 | None | false | |<br>| a75d435b-ebce-4013-9c68-8df5d2c917e1 | available | dashboard-volume | 1 | ceph-storage | false | |<br>| dd315dda-b22a-4cf8-8b77-7c2b2f163155 | available | new_boot_from_vol | 10 | None | true | |<br>+--------------------------------------+-----------+---------------------------+------+--------------+----------+--------------------------------------+<br>[root@rdo nova(keystone_admin)]#</p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;">[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]# nova boot --flavor 2 --image be62a5bf-879f-4d1f-846c-fdef960224ff --block_device_mapping vda=dd315dda-b22a-4cf8-8b77-7c2b2f163155:::0 --security_groups=default --nic net-id=4fe5909e-02db-4517-89f2-1278248fa26c myInstanceFromVolume<br>+--------------------------------------+----------------------------------------------------+<br>| Property | Value |<br>+--------------------------------------+----------------------------------------------------+<br>| OS-EXT-STS:task_state | scheduling |<br>| image | precise-cloudimg.raw |<br>| OS-EXT-STS:vm_state | building |<br>| OS-EXT-SRV-ATTR:instance_name | instance-0000001d |<br>| OS-SRV-USG:launched_at | None |<br>| flavor | m1.small |<br>| id | f324e9b8-ec3a-4174-8b97-bf78dba62932 |<br>| security_groups | [{u'name': u'default'}] |<br>| user_id | 99f8019ba2694d78a680a5de46aa1afd |<br>| OS-DCF:diskConfig | MANUAL |<br>| accessIPv4 | |<br>| accessIPv6 | |<br>| progress | 0 |<br>| OS-EXT-STS:power_state | 0 |<br>| OS-EXT-AZ:availability_zone | nova |<br>| config_drive | |<br>| status | BUILD |<br>| updated | 2013-12-05T12:42:22Z |<br>| hostId | |<br>| OS-EXT-SRV-ATTR:host | None |<br>| OS-SRV-USG:terminated_at | None |<br>| key_name | None |<br>| OS-EXT-SRV-ATTR:hypervisor_hostname | None |<br>| name | myInstanceFromVolume |<br>| adminPass | eish5pu56CiE |<br>| tenant_id | 0dafe42cfde242ddbb67b681f59bdb00 |<br>| created | 2013-12-05T12:42:21Z |<br>| os-extended-volumes:volumes_attached | [{u'id': u'dd315dda-b22a-4cf8-8b77-7c2b2f163155'}] |<br>| metadata | {} |<br>+--------------------------------------+----------------------------------------------------+<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]#<br>[root@rdo nova(keystone_admin)]# nova list<br>+--------------------------------------+----------------------+---------+------------+-------------+---------------------+<br>| ID | Name | Status | Task State | Power State | Networks |<br>+--------------------------------------+----------------------+---------+------------+-------------+---------------------+<br>| 0043a8be-60d1-43ed-ba43-1ccd0bba7559 | instance2 | SHUTOFF | None | Shutdown | public=172.24.4.228 |<br>| f324e9b8-ec3a-4174-8b97-bf78dba62932 | myInstanceFromVolume | ERROR | None | NOSTATE | private=10.0.0.3 |<br>| 9d3c327f-1893-40ff-8a82-16fad9ce6d91 | small-ubuntu | ACTIVE | None | Running | public=172.24.4.230 |<br>+--------------------------------------+----------------------+---------+------------+-------------+---------------------+<br>[root@rdo nova(keystone_admin)]#</p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;">=====================================</p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><strong>Logs from /var/log/libvirt/qemu ::</strong></p><p style="margin: 0px;" data-mce-style="margin: 0px;"><strong><br></strong></p></div><div>=====================================</div><div><br></div><div><p style="margin: 0px;" data-mce-style="margin: 0px;">qemu-kvm: -drive file=rbd:ceph-volumes/volume-dd315dda-b22a-4cf8-8b77-7c2b2f163155:id=volumes:key=AQC804xS8HzFJxAAD/zzQ8LMzq9wDLq/5a472g==:auth_supported=cephx\;none:mon_host=192.168.1.31\:6789\;192.168.1.33\:6789\;192.168.1.38\:6789,if=none,id=drive-virtio-disk0,format=raw,serial=dd315dda-b22a-4cf8-8b77-7c2b2f163155,cache=none: <strong>could not open disk image</strong> rbd:ceph-volumes/volume-dd315dda-b22a-4cf8-8b77-7c2b2f163155:id=volumes:key=AQC804xS8HzFJxAAD/zzQ8LMzq9wDLq/5a472g==:auth_supported=cephx\;none:mon_host=192.168.1.31\:6789\;192.168.1.33\:6789\;192.168.1.38\:6789: No such file or directory<br>2013-12-05 12:42:29.544+0000: shutting down</p></div><div><br></div><div><br></div><div>Any idea why its throwing this error.</div><div><br></div><div><span name="x"></span>Many Thanks<br>Karan Singh<br><span name="x"></span><br></div><div><br></div><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Darren Birkett" <darren.birkett@gmail.com><br><b>To: </b>"Karan Singh" <ksingh@csc.fi><br><b>Sent: </b>Thursday, 5 December, 2013 2:37:27 PM<br><b>Subject: </b>Re: [Openstack] Openstack--instance-boot-from-ceph-volume<br><div><br></div><div dir="ltr">Hi Karan,<div class="gmail_extra"><br><div><br></div><div class="gmail_quote">On 5 December 2013 12:24, Karan Singh <span dir="ltr"><<a href="mailto:ksingh@csc.fi" target="_blank">ksingh@csc.fi</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div><div style="font-size:10pt;font-family:'times new roman','new york',times,serif">
<div><span style="background-color:rgb(253,253,253);font-size:10pt">Hello Stackers</span></div><div style="font-size:12pt;font-style:normal;font-family:Helvetica,Arial,sans-serif;text-decoration:none;font-weight:normal"><div style="font-size:10pt;font-family:'times new roman','new york',times,serif">
<div style="font-size:12pt;font-style:normal;font-family:Helvetica,Arial,sans-serif;text-decoration:none;font-weight:normal"><div style="font-size:10pt;font-family:'times new roman','new york',times,serif">
<div><div style="background-color:rgb(253,253,253)"><br></div><div style="background-color:rgb(253,253,253)">Wondering if someone got Openstack Instance booted from ceph volume successfully , can help me to do it.</div><div style="background-color:rgb(253,253,253)">
<br></div><div style="background-color:rgb(253,253,253)">As of now , i have running ceph cluster which is integrated with Openstack ciner and glance , i can create volumes and put images from OS to ceph , this is working good.</div>
<div style="background-color:rgb(253,253,253)"><br></div><div style="background-color:rgb(253,253,253)">My next target is to boot instance from volume. Can you share steps or instructions how you get it done. It would be great if you can help me setting this up.</div>
<div style="background-color:rgb(253,253,253)"><br></div><div style="background-color:rgb(253,253,253)">Thanks a ton in advance </div><div style="background-color:rgb(253,253,253)"><br></div><div style="background-color:rgb(253,253,253)">
<br></div><div style="background-color:rgb(253,253,253)">My setup --> ceph Dumpling , OS havana , Centos 6.5</div><span class=""><span color="#888888" data-mce-style="color: #888888;" style="color: #888888;"><div style="background-color:rgb(253,253,253)"><br></div><div style="background-color:rgb(253,253,253)">
<br></div></span></span></div></div></div></div></div></div></div></blockquote></div><br></div><div class="gmail_extra"><div>If you're using Centos, you'll need a qemu-kvm that is built with rbd support. You can grab this src rpm for qemu-kvm-rhev from Redhat and build it yourself:</div>
<div><br></div><div><a href="http://ftp.redhat.com/redhat/linux/enterprise/6Server/en/RHEV/SRPMS/qemu-kvm-rhev-0.12.1.2-2.415.el6.src.rpm" target="_blank">http://ftp.redhat.com/redhat/linux/enterprise/6Server/en/RHEV/SRPMS/qemu-kvm-rhev-0.12.1.2-2.415.el6.src.rpm</a><br>
</div><div><br></div><div>Using:</div><div><br></div><div><span style="font-family:arial,sans-serif;font-size:12.800000190734863px">rpmbuild -ba --with rhev_features --without guest_agent qemu-kvm.spec</span></div><div>
<span style="font-family:arial,sans-serif;font-size:12.800000190734863px"><br></span></div><div><span face="arial, sans-serif" data-mce-style="font-family: arial, sans-serif;" style="font-family: arial, sans-serif;">Then install the qemu-kvm-rhev and qemu-kvm-img that it builds - they will obsolete the qemu-kvm and qemu-img that come as part of the base CentOS.</span></div>
<div><span face="arial, sans-serif" data-mce-style="font-family: arial, sans-serif;" style="font-family: arial, sans-serif;"><br></span></div><div><span face="arial, sans-serif" data-mce-style="font-family: arial, sans-serif;" style="font-family: arial, sans-serif;">Then it's just a matter of creating your cinder volume from an image in glance (you need to use a raw image in glance):</span></div>
<div><span face="arial, sans-serif" data-mce-style="font-family: arial, sans-serif;" style="font-family: arial, sans-serif;"><br></span></div><div><div>[root@cent-comp1 ~]# glance image-list</div><div>+--------------------------------------+--------------+-------------+------------------+----------+--------+</div>
<div>| ID | Name | Disk Format | Container Format | Size | Status |</div><div>+--------------------------------------+--------------+-------------+------------------+----------+--------+</div>
<div>| eada58eb-14ac-4a36-940f-794e9c3ef633 | cirros-image | qcow2 | bare | 13147648 | active |</div><div>| 1c31a2ca-7f50-44d7-84d5-a16fbbafbfa7 | cirros-raw | raw | bare | 41126400 | active |</div>
<div>+--------------------------------------+--------------+-------------+------------------+----------+--------+</div><div>[root@cent-comp1 ~]# cinder create --image-id 1c31a2ca-7f50-44d7-84d5-a16fbbafbfa7 --display-name my-bootable-volume 5</div>
<div>+---------------------+--------------------------------------+</div><div>| Property | Value |</div><div>+---------------------+--------------------------------------+</div><div>
| attachments | [] |</div><div>| availability_zone | nova |</div><div>| bootable | false |</div><div>| created_at | 2013-12-05T12:36:19.502399 |</div>
<div>| display_description | None |</div><div>| display_name | my-bootable-volume |</div><div>| id | 3d0199e0-4762-4e71-8eea-216b69c6e36c |</div><div>
| image_id | 1c31a2ca-7f50-44d7-84d5-a16fbbafbfa7 |</div><div>| metadata | {} |</div><div>| size | 5 |</div><div>| snapshot_id | None |</div>
<div>| source_volid | None |</div><div>| status | creating |</div><div>| volume_type | None |</div><div>
+---------------------+--------------------------------------+</div><div>[root@cent-comp1 ~]# nova boot --boot-volume 3d0199e0-4762-4e71-8eea-216b69c6e36c --flavor 1 myserver</div><div>+--------------------------------------+----------------------------------------------------+</div>
<div>| Property | Value |</div><div>+--------------------------------------+----------------------------------------------------+</div><div>| OS-EXT-STS:task_state | scheduling |</div>
<div>| image | Attempt to boot from volume - no image supplied |</div><div>| OS-EXT-STS:vm_state | building |</div><div>| OS-EXT-SRV-ATTR:instance_name | instance-00000017 |</div>
<div>| OS-SRV-USG:launched_at | None |</div><div>| flavor | m1.tiny |</div><div>| id | 7b28b8b7-75d0-4d57-8313-a4c78c021e54 |</div>
<div>| security_groups | [{u'name': u'default'}] |</div><div>| user_id | 772c04a676dc40288d8e77aece774103 |</div>
<div>| OS-DCF:diskConfig | MANUAL |</div><div>| accessIPv4 | |</div><div>| accessIPv6 | |</div>
<div>| progress | 0 |</div><div>| OS-EXT-STS:power_state | 0 |</div><div>| OS-EXT-AZ:availability_zone | nova |</div>
<div>| config_drive | |</div><div>| status | BUILD |</div><div>| updated | 2013-12-05T12:36:49Z |</div>
<div>| hostId | |</div><div>| OS-EXT-SRV-ATTR:host | None |</div><div>| OS-SRV-USG:terminated_at | None |</div>
<div>| key_name | None |</div><div>| OS-EXT-SRV-ATTR:hypervisor_hostname | None |</div><div>| name | myserver |</div>
<div>| adminPass | QCZAS6cPNGkP |</div><div>| tenant_id | f1b863076b36422091d13d85bb127c4d |</div><div>| created | 2013-12-05T12:36:49Z |</div>
<div>| os-extended-volumes:volumes_attached | [{u'id': u'3d0199e0-4762-4e71-8eea-216b69c6e36c'}] |</div><div>| metadata | {} |</div>
<div>+--------------------------------------+----------------------------------------------------+</div></div><div><br></div><div>Thanks</div><div>Darren</div></div></div>
</div><div><br></div></div></body></html>