<p style="margin: 0.0px 0.0px 0.0px 0.0px; font: 13.0px Arial">generally mounting with -o nobarrier is a bad idea (ext4 or xfs), unless you have disks that do not have write caches. don't follow that</p>
<p style="margin: 0.0px 0.0px 0.0px 0.0px; font: 13.0px Arial">recommendation, or for example - fsync won't work which is something swift relies upon.</p><div><br></div><br><div class="gmail_quote">On Thu, Oct 13, 2011 at 9:18 AM, Marcelo Martins <span dir="ltr"><<a href="mailto:btorch-os@zeroaccess.org">btorch-os@zeroaccess.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div style="word-wrap:break-word"><div>Hi Jonathan,</div><div><br></div><div><br></div><div>I guess that will depend on how your storage nodes are configured (hardware wise). The reason why it's recommended is because the storage drives are actually attached to a controller that has RiW cache enabled. </div>
<div><br></div><div><br></div><div><br></div><h2 style="color:black;background-color:initial;font-weight:normal;margin-top:0px;margin-right:0px;margin-bottom:0.6em;margin-left:0px;padding-top:0.5em;padding-bottom:0.17em;border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(170, 170, 170);font-size:19px;font-family:sans-serif;line-height:19px">
<span>Q. Should barriers be enabled with storage which has a persistent write cache?</span></h2><div style="margin-top:0.4em;margin-right:0px;margin-bottom:0.5em;margin-left:0px;line-height:1.5em;font-family:sans-serif;font-size:13px;background-color:rgb(255, 255, 255)">
Many hardware RAID have a persistent write cache which preserves it across power failure, interface resets, system crashes, etc. Using write barriers in this instance is not recommended and will in fact lower performance. Therefore, it is recommended to turn off the barrier support and mount the filesystem with "nobarrier". But take care about the hard disk write cache, which should be off.</div>
<div><br></div><div><br></div><div>
<span style="border-collapse:separate;color:rgb(0, 0, 0);font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium"><span style="border-collapse:separate;color:rgb(0, 0, 0);font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium"><div style="word-wrap:break-word">
<div>Marcelo Martins</div><div>Openstack-swift</div><div><a href="mailto:btorch-os@zeroaccess.org" target="_blank">btorch-os@zeroaccess.org</a></div><div><br></div><div><div>“Knowledge is the wings on which our aspirations take flight and soar. When it comes to surfing and life if you know what to do you can do it. If you desire anything become educated about it and succeed. “</div>
</div><div><br></div></div></span><br></span><br>
</div><div><div></div><div class="h5">
<br><div><div>On Oct 12, 2011, at 10:08 AM, Jonathan Simms wrote:</div><br><blockquote type="cite"><div>Hello all,<br><br>I'm in the middle of a 120T Swift deployment, and I've had some<br>concerns about the backing filesystem. I formatted everything with<br>
ext4 with 1024b inodes (for storing xattrs), but the process took so<br>long that I'm now looking at XFS again. In particular, this concerns<br>me <a href="http://xfs.org/index.php/XFS_FAQ#Write_barrier_support" target="_blank">http://xfs.org/index.php/XFS_FAQ#Write_barrier_support</a>.<br>
<br>In the swift documentation, it's recommended to mount the filesystems<br>w/ 'nobarrier', but it would seem to me that this would leave the data<br>open to corruption in the case of a crash. AFAIK, swift doesn't do<br>
checksumming (and checksum checking) of stored data (after it is<br>written), which would mean that any data corruption would silently get<br>passed back to the users.<br><br>Now, I haven't had operational experience running XFS in production,<br>
I've mainly used ZFS, JFS, and ext{3,4}. Are there any recommendations<br>for using XFS safely in production?<br>_______________________________________________<br>Openstack-operators mailing list<br><a href="mailto:Openstack-operators@lists.openstack.org" target="_blank">Openstack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br></div></blockquote></div><br></div></div></div>
<br>_______________________________________________<br>
Openstack-operators mailing list<br>
<a href="mailto:Openstack-operators@lists.openstack.org">Openstack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br></blockquote></div><br>