<div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Oct 12, 2015 at 7:46 PM, Cory Hawkless <span dir="ltr"><<a href="mailto:Cory@hawkless.id.au" target="_blank">Cory@hawkless.id.au</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div lang="EN-AU" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">In my setup I have one Ceph cluster but 2 different pools, one for images which is on SATA disks and one for volumes which is on faster
SAS disks.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Given this setup I don’t imagine there is any way to thin provision an image to a volume? It would need to be a complete copy from
one pool to another, yes?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">I’m certainly not in a position to be able to contribute to a code change, I’m surprised this hasn’t been done already, it seems terribly
inefficient to have to copy the images twice?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Cory<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11pt;font-family:Calibri,sans-serif">From:</span></b><span lang="EN-US" style="font-size:11pt;font-family:Calibri,sans-serif"> Avishay Traeger [mailto:<a href="mailto:avishay@stratoscale.com" target="_blank">avishay@stratoscale.com</a>]
<br>
<b>Sent:</b> Monday, 12 October 2015 9:55 PM<br>
<b>To:</b> Cory Hawkless <<a href="mailto:Cory@Hawkless.id.au" target="_blank">Cory@Hawkless.id.au</a>><br>
<b>Cc:</b> <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
<b>Subject:</b> Re: [Openstack] Volume from image question<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">The flow for all images for this process is to download from Glance to a temporary file, and then write to volume. This is not necessary for raw images, but that optimization has not been done. I did leave a comment about that in the
code though 2.5 years ago, but never implemented it - you can give it a go if you'd like :-)<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Are you using two different Ceph clusters, one for images and one for volumes? Otherwise it should just be doing a thin provisioned clone of the image (no download, no temp space, no upload).<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div><div><div class="h5">
<p class="MsoNormal">On Mon, Oct 12, 2015 at 12:27 PM, Cory Hawkless <<a href="mailto:Cory@hawkless.id.au" target="_blank">Cory@hawkless.id.au</a>> wrote:<u></u><u></u></p>
</div></div><blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm"><div><div class="h5">
<div>
<div>
<p class="MsoNormal">Hi all,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">When creating a volume from an image(Using Horizon), why does the Cinder server need to do what appears to be a conversion of the image before it can create the volume?<u></u><u></u></p>
<p class="MsoNormal">All of my images in Glance are uploaded in RAW format, images and volumes are stored in Ceph.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">The reason I know the images are being processed on my glance server is because it runs out of disk space when trying to make volumes from large images and the process fails. I
can see the temporary file in /var/lib/cinder/conversion<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Is it not possible to have glance simply copy the image form the images store into the volumes store? I am going to regularly be creating new Windows Server instances, so it would
take quite some time for a 20gb image to be processed by Cinder before it can be uploaded into Ceph.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Regards,<u></u><u></u></p>
<p class="MsoNormal">Cory<u></u><u></u></p>
</div>
</div>
</div></div><p class="MsoNormal" style="margin-bottom:12pt"><br><span class="">
_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><u></u><u></u></span></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">-- <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><b><span style="font-size:9.5pt;color:rgb(102,102,102)">Avishay Traeger, PhD</span></b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><i><span style="color:rgb(102,102,102)">System Architect</span></i><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="color:rgb(102,102,102)">Mobile: </span><a href="tel:%2B972%2054%20447%201475" value="+972544471475" target="_blank">+972 54 447 1475</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="color:rgb(102,102,102)">E-mail: <a href="mailto:avishay@stratoscale.com" target="_blank"><span style="color:rgb(17,85,204)">avishay@stratoscale.com</span></a></span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><img border="0" src="http://www.stratoscale.com/wp-content/uploads/Logo-Signature-Stratoscale-230.jpg"><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p style="margin:0cm 0cm 0.0001pt"><a href="http://www.stratoscale.com/" target="_blank"><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(17,85,204)">Web</span></a><span style="font-size:10pt;font-family:Arial,sans-serif"> | </span><a href="http://www.stratoscale.com/blog/" target="_blank"><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(17,85,204)">Blog</span></a><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(108,163,214)"> | </span><a href="https://twitter.com/Stratoscale" target="_blank"><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(17,85,204)">Twitter</span></a><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(108,163,214)"> | <a href="https://plus.google.com/u/1/b/108421603458396133912/108421603458396133912/posts" target="_blank"><span style="color:rgb(17,85,204)">Google+</span></a> | </span><span style="font-size:10pt;font-family:Arial,sans-serif"><a href="https://www.linkedin.com/company/stratoscale" target="_blank"><span style="color:rgb(17,85,204)">Linkedin</span></a></span><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div><div class="gmail_default" style="font-family:monospace,monospace">So trying to jog my memory a bit on this. The initial work was done here: [1]</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">A concern was raised but perhaps it was an IRC conversation as opposed to a formal bug or review, but I reworked this after patch set 2 and added the piece that does the conversion regardless of format.</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">Anyway, it is quite possible that Ceph can be configured so that this is not an issue. I seem to recall that you could in fact use it's internal clones (that was actually what prompted me to work on this feature in the first place).</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">Also, FWIW; in Liberty we fixed this up considerably by adding a cache layer. You'll still have this expense on initial creation so I guess it won't really help you.</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">Sorry, I don't have better documentation for you on the reasoning behind the change. Perhaps some folks with more Ceph experience can chime in and offer up a possible solution?</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace">John</div><div class="gmail_default" style="font-family:monospace,monospace">[1]: <a href="https://review.openstack.org/#/c/17437/2/cinder/volume/driver.py">https://review.openstack.org/#/c/17437/2/cinder/volume/driver.py</a></div><br></div></div>