Open Stack

Hi Josh,

Enabling show_image_direct_url = True has done the trick.
Now when I crate a volume from an image where the image is on a ceph pool called 'sata' and the volumes themselves live in a ceph pool called 'volumes', the volume is created with no conversion and takes only a couple of seconds.

For reference, all of my images are stored in RAW format, as are my volumes.

Thanks everyone for your help
Cory

-----Original Message-----
From: Josh Durgin [mailto:jdurgin at redhat.com] 
Sent: Tuesday, 13 October 2015 5:38 PM
To: Cory Hawkless <Cory at Hawkless.id.au>; Avishay Traeger <avishay at stratoscale.com>
Cc: openstack at lists.openstack.org
Subject: Re: [Openstack] Volume from image question

On 10/12/2015 06:46 PM, Cory Hawkless wrote:
> In my setup I have one Ceph cluster but 2 different pools, one for 
> images which is on SATA disks and one for volumes which is on faster 
> SAS disks.
>
> Given this setup I don't imagine there is any way to thin provision an 
> image to a volume? It would need to be a complete copy from one pool 
> to another, yes?

In ceph cloning between pools is possible, and is a common configuration. Your setup sounds like it should be doing this, since you have the images in raw format. Compare your cinder and glance config files and your ceph auth settings with this:

http://docs.ceph.com/docs/master/rbd/rbd-openstack/#setup-ceph-client-authentication

Josh

> I'm certainly not in a position to be able to contribute to a code 
> change, I'm surprised this hasn't been done already, it seems terribly 
> inefficient to have to copy the images twice?
>
> Regards,
>
> Cory
>
> *From:*Avishay Traeger [mailto:avishay at stratoscale.com]
> *Sent:* Monday, 12 October 2015 9:55 PM
> *To:* Cory Hawkless <Cory at Hawkless.id.au>
> *Cc:* openstack at lists.openstack.org
> *Subject:* Re: [Openstack] Volume from image question
>
> The flow for all images for this process is to download from Glance to 
> a temporary file, and then write to volume.  This is not necessary for 
> raw images, but that optimization has not been done.  I did leave a 
> comment about that in the code though 2.5 years ago, but never 
> implemented it - you can give it a go if you'd like :-)
>
> Are you using two different Ceph clusters, one for images and one for 
> volumes?  Otherwise it should just be doing a thin provisioned clone 
> of the image (no download, no temp space, no upload).
>
> On Mon, Oct 12, 2015 at 12:27 PM, Cory Hawkless <Cory at hawkless.id.au 
> <mailto:Cory at hawkless.id.au>> wrote:
>
>     Hi all,
>
>     When creating a volume from an image(Using Horizon), why does the
>     Cinder server need to do what appears to be a conversion of the
>     image before it can create the volume?
>
>     All of my images in Glance are uploaded in RAW format, images and
>     volumes are stored in Ceph.
>
>     The reason I know the images are being processed on my glance server
>     is because it runs out of disk space when trying to make volumes
>     from large images and the process fails. I can see the temporary
>     file in /var/lib/cinder/conversion
>
>     Is it not possible to have glance simply copy the image form the
>     images store into the volumes store? I am going to regularly be
>     creating new Windows Server instances, so it would take quite some
>     time for a 20gb image to be processed by Cinder before it can be
>     uploaded into Ceph.
>
>     Regards,
>
>     Cory
>
>
>     _______________________________________________
>     Mailing list:
>     http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>     Post to     : openstack at lists.openstack.org
>     <mailto:openstack at lists.openstack.org>
>     Unsubscribe :
>     http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>
>
>
> --
>
> *Avishay Traeger, PhD*
>
> /System Architect/
>
> Mobile: +972 54 447 1475
>
> E-mail: avishay at stratoscale.com <mailto:avishay at stratoscale.com>
>
> Web <http://www.stratoscale.com/> | Blog 
> <http://www.stratoscale.com/blog/> | Twitter 
> <https://twitter.com/Stratoscale> | Google+ 
> <https://plus.google.com/u/1/b/108421603458396133912/10842160345839613
> 3912/posts> | Linkedin <https://www.linkedin.com/company/stratoscale>
>
>
>
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : 
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>