<div dir="ltr">yep. It's at the CEPH level (not the XFS level.) </div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 28, 2015 at 8:40 AM, Stephen Cousins <span dir="ltr"><<a href="mailto:steve.cousins@maine.edu" target="_blank">steve.cousins@maine.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:courier new,monospace">Hi David,</div><div class="gmail_default" style="font-family:courier new,monospace"><br></div><div class="gmail_default" style="font-family:courier new,monospace">So Ceph will use Copy-on-write even with XFS? </div><div class="gmail_default" style="font-family:courier new,monospace"><br></div><div class="gmail_default" style="font-family:courier new,monospace">Thanks,</div><div class="gmail_default" style="font-family:courier new,monospace"><br></div><div class="gmail_default" style="font-family:courier new,monospace">Steve</div></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Thu, May 28, 2015 at 10:36 AM, David Medberry <span dir="ltr"><<a href="mailto:openstack@medberry.net" target="_blank">openstack@medberry.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">This isn't remotely related to btrfs. It works fine with XFS. Not sure how that works in Fuel, never used it.</div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 28, 2015 at 8:01 AM, Forrest Flagg <span dir="ltr"><<a href="mailto:fostro.flagg@gmail.com" target="_blank">fostro.flagg@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div style="font-size:12.8000001907349px">I'm also curious about this. Here are some other pieces of information relevant to the discussion. Maybe someone here can clear this up for me as well. The documentation for Fuel 6.0, not sure what they changed for 6.1, [1] states that when using Ceph one should disable qcow2 so that images are stored in raw format. This is due to the fact that Ceph includes its own mechanisms for copy-on-write and snapshots. According to the Ceph documentation [2], this is true only when using a BTRFS file system, but in Fuel 6.0 Ceph uses XFS which doesn't provide this functionality. Also, [2] recommends not using BTRFS for production as it isn't considered fully mature. In addition, Fuel 6.0 [3] states that OpenStack with raw images doesn't support snapshotting.</div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Given this, why does Fuel suggest not using qcow2 with Ceph? How can Ceph be useful if snapshotting isn't an option with raw images and qcow2 isn't recommended? Are there other factors to take into consideration that I'm missing?</div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">[1] <a href="https://docs.mirantis.com/openstack/fuel/fuel-6.0/terminology.html#qcow2" target="_blank">https://docs.mirantis.com/openstack/fuel/fuel-6.0/terminology.html#qcow2</a></div><div style="font-size:12.8000001907349px">[2] <a href="http://ceph.com/docs/master/rados/configuration/filesystem-recommendations/" target="_blank">http://ceph.com/docs/master/rados/configuration/filesystem-recommendations/</a></div><div style="font-size:12.8000001907349px">[3] <a href="https://docs.mirantis.com/openstack/fuel/fuel-6.0/user-guide.html#qcow-format-ug" target="_blank">https://docs.mirantis.com/openstack/fuel/fuel-6.0/user-guide.html#qcow-format-ug</a></div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Thanks,</div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Forrest</div></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 28, 2015 at 8:02 AM, David Medberry <span dir="ltr"><<a href="mailto:openstack@medberry.net" target="_blank">openstack@medberry.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">and better explained here:<div><a href="http://ceph.com/docs/master/rbd/qemu-rbd/" target="_blank">http://ceph.com/docs/master/rbd/qemu-rbd/</a><br></div></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 28, 2015 at 6:02 AM, David Medberry <span dir="ltr"><<a href="mailto:openstack@medberry.net" target="_blank">openstack@medberry.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">The primary difference is the ability for CEPH to make zero byte copies. When you use qcow2, ceph must actually create a complete copy instead of a zero byte copy as it cannot do its own copy-on-write tricks with a qcow2 image.<div><br></div><div>So, yes, it will work fine with qcow2 images but it won't be as performant as it is with RAW. Also, it will actually use more of the native underlying storage.</div><div><br></div><div>This is also shown as an Important Note in the CEPH docs:</div><div><a href="http://ceph.com/docs/master/rbd/rbd-openstack/" target="_blank">http://ceph.com/docs/master/rbd/rbd-openstack/</a><br></div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Thu, May 28, 2015 at 4:12 AM, Shake Chen <span dir="ltr"><<a href="mailto:shake.chen@gmail.com" target="_blank">shake.chen@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi<div><br></div><div>Now I try to use Fuel 6.1 deploy openstack Juno, use Ceph as cinder, nova and glance backend.</div><div><br></div><div>In Fuel document suggest if use ceph, suggest use RAW format image. </div><div><br></div><div>but if I upload qcow2 image, seem working well. </div><div><br></div><div>what is the different use qcow2 and RAW in Ceph?</div><span><font color="#888888"><div><br clear="all"><div><br></div>-- <br><div>Shake Chen<br><br></div>
</div></font></span></div>
<br></div></div>_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div><span style="font-family:courier new,monospace">________________________________________________________________</span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace"> Steve Cousins Supercomputer Engineer/Administrator</span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace"> Advanced Computing Group University of Maine System</span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace"> 244 Neville Hall (UMS Data Center) <a href="tel:%28207%29%20561-3574" value="+12075613574" target="_blank">(207) 561-3574</a></span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace"> Orono ME 04469 steve.cousins at <a href="http://maine.edu" target="_blank">maine.edu</a></span><br><br></div>
</font></span></div>
</blockquote></div><br></div>