Hi all,<div><br></div><div>we use Razique's script on shared storage frequently. We recommend to take a snapshot first, just in case.</div><div><br></div><div>A few comments about what I have read in this thread:</div>
<div>- The script works (for us) and does not break anything (we modified it to perform a delete instead of writing to a file) on a shared storage</div><div>- I was really scared when I read about the migration problems from Essex to Folsom and the new automatic clean up code. <span style="font-family:Verdana,Geneva,sans-serif;font-size:12px">remove_unused_base_images=false</span></div>
<div>- 650GB in _base directory in a shared storage is not so big... specially if your users are taking snapshots. </div><div>- If you are using Netapp, Nexenta or other filers, this is the right folder to enable deduplication. You will see massive savings.</div>
<div>- Snapshots can make your _base directory HUGE. We have sent a blueprint about snapshotting and quotas to discuss next summit. <a href="https://blueprints.launchpad.net/nova/+spec/snapshot-tenant-quotas">https://blueprints.launchpad.net/nova/+spec/snapshot-tenant-quotas</a></div>
<div>- With a rather paranoid customer, we use the use_cow_images to false. </div><div><br></div><div>There is a great article of <span style="color:rgb(34,34,34);font-family:Verdana,Arial,sans-serif;text-align:justify;white-space:nowrap">Pádraig Brady </span>about the different options: <a href="http://www.pixelbeat.org/docs/openstack_libvirt_images/">http://www.pixelbeat.org/docs/openstack_libvirt_images/</a></div>
<div><br></div><div>Enjoy!</div><div>Diego</div><div><br></div><div> <br clear="all"><div> -- <br><span style="border-collapse:separate;font-family:Times"><span style="border-collapse:collapse;font-family:arial,sans-serif"><div align="left" style="font-size:13px">
<div><font><span lang="ES" style="font-family:Arial">Diego Parrilla<br><a href="http://www.stackops.com/" title="file:///C:/Documents%20and%20Settings/carolina.capsir.per1/Application%20Data/Microsoft/Signatures/www.garrigues.com
www.garrigues.com" style="color:rgb(7,77,143)" target="_blank"><span title="file:///C:/Documents%20and%20Settings/carolina.capsir.per1/Application%20Data/Microsoft/Signatures/www.garrigues.com"></span></a></span></font><font face="Arial" style="font-family:arial,helvetica,sans-serif"><b>CEO</b><font size="1"><br>
</font></font><span style="border-collapse:separate;font-family:Times;font-size:medium"><span style="border-collapse:collapse;font-family:arial,sans-serif;font-size:13px"></span></span><b><font face="Arial" style="font-family:arial,helvetica,sans-serif"><a href="http://www.stackops.com/" target="_blank"><b>www.stackops.com</b></a> | </font></b><font face="Arial" style="font-family:arial,helvetica,sans-serif"><font size="1"> <a href="mailto:diego.parrilla@stackops.com" target="_blank">diego.parrilla@stackops.com</a></font></font><span style="border-collapse:separate;font-family:Times;font-size:medium"><span style="border-collapse:collapse;font-family:arial,sans-serif;font-size:13px"><font color="#004438" face="Arial"><b><b><span lang="EN-GB" style="font-size:10pt"></span></b></b></font></span></span><font face="Arial" style="font-family:arial,helvetica,sans-serif"><font size="1"> | </font></font><span style="border-collapse:separate;font-family:Times;font-size:medium"><span style="border-collapse:collapse;font-family:arial,sans-serif;font-size:13px"><font face="Arial" style="font-family:arial,helvetica,sans-serif"><font size="1">+34 649 94 43 29 | <a>skype:diegoparrilla</a></font></font></span></span><font face="Arial" style="font-family:arial,helvetica,sans-serif"><a href="http://www.stackops.com/" target="_blank"><b><br>
</b></a></font></div></div><div style="font-size:13px"><font color="#004438" face="Arial"><b><p><span style="border-collapse:separate;color:rgb(0,0,0);font-family:Times;font-size:medium"><span style="border-collapse:collapse;font-family:arial,sans-serif;font-size:13px"><span style="border-collapse:separate;font-family:Times;font-size:medium"><span style="border-collapse:collapse;font-family:arial,sans-serif;font-size:13px"><font color="#004438" face="Arial"><b><b><span lang="EN-GB" style="font-size:10pt"><img src="http://stackops.s3-external-3.amazonaws.com/STACKOPSLOGO-ICON.png"></span></b></b></font></span></span></span></span></p>
</b></font></div></span></span><div><br></div></div>
<br><br><div class="gmail_quote">On Thu, Mar 14, 2013 at 9:35 AM, Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Hi, <div>I wrote a script a couple of times ago</div><div><a href="https://github.com/Razique/BashStuff/blob/master/SYSTEMS/OpenStack/SCR_5008_V00_NUAC-OPENSTACK-Nova-compute-images-prunning.sh" target="_blank">https://github.com/Razique/BashStuff/blob/master/SYSTEMS/OpenStack/SCR_5008_V00_NUAC-OPENSTACK-Nova-compute-images-prunning.sh</a></div>
<div>It looks for images that have a backing file, for the backing files that are not used, you can remove it :) </div><div>the script doesn't remove anyhthing, it just indicates you what base files can safely be removed - given as well the very fact that the base files are not the ones that are used, you can maybe put the dir - in a shared directory, instances may spawn slower, but after that you shouldn't have any problem</div>
<div><br></div><div>regards,</div><div><br></div><div><br><div>
<span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:'Lucida Grande';word-spacing:0px"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Razique Mahroua</b></span><span style="font-weight:normal;font-family:Helvetica;color:rgb(19,112,138)"><b> - </b></span><span style="font-family:Helvetica"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Nuage & Co</b></span><span style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px;font-size:medium"><span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px"><span style="border-collapse:separate;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px"><div style="font-style:normal;font-size:medium;font-family:Helvetica;font-weight:normal">
<font color="#13708a"><a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a></font></div><div style="font-style:normal;font-size:medium;font-family:Helvetica"><font color="#13708a">Tel : <a href="tel:%2B33%209%2072%2037%2094%2015" value="+33972379415" target="_blank">+33 9 72 37 94 15</a></font></div>
</span></span></span></span></span><br style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;text-transform:none;font-size:medium;white-space:normal;font-family:Arial;word-spacing:0px">
<span><img height="125" width="125" src="cid:0A2450C8-6A0D-42D0-8035-743CAD564432@fabrique.lan"></span>
</div>
<br><div><div>Le 13 mars 2013 ŕ 23:29, Michael Still <<a href="mailto:mikal@stillhq.com" target="_blank">mikal@stillhq.com</a>> a écrit :</div><div><div class="h5"><br><blockquote type="cite">On Wed, Mar 13, 2013 at 5:23 PM, Joe Topjian <<a href="mailto:joe.topjian@cybera.ca" target="_blank">joe.topjian@cybera.ca</a>> wrote:<br>
<blockquote type="cite">On Wed, Mar 13, 2013 at 5:12 PM, Michael Still <<a href="mailto:mikal@stillhq.com" target="_blank">mikal@stillhq.com</a>> wrote:<br><blockquote type="cite">On Wed, Mar 13, 2013 at 4:42 PM, Joe Topjian <<a href="mailto:joe.topjian@cybera.ca" target="_blank">joe.topjian@cybera.ca</a>><br>
wrote:<br><blockquote type="cite">It would, yes, but I think your caveat trumps that idea. Having x nodes<br>be<br>able to work with a shared _base directory is great for saving space and<br>centrally using images. As an example, one of my OpenStack's _base<br>
directory<br>is 650gb in size. It's currently shared via NFS. If it was not shared or<br>used a _base_$host scheme, that would be 650gb per compute node. 10<br>nodes<br>and you're already at 6.5TB.<br></blockquote>
<br>Is that _base directory so large because its never been cleaned up<br>though? What sort of maintenance are you performing on it?<br></blockquote><br>It's true that I haven't done any maintenance to _base. From my estimations,<br>
a cleanup wouldn't reclaim a substantial amount of space to warrant me doing<br>an actual cleanup (basically "benefits of disk space reclaimed" is not<br>greater than "risk of accidentally corrupting x users instances" yet).<br>
</blockquote><br>What release of openstack are you running? I think you might get<br>significant benefits from turning cleanup on, so long as you're using<br>grizzly [1]. I'd be very very interested in the results of a lab test.<br>
<br>Michael<br><br>1: yes I know its not released yet, but if you found a bug now we<br>could fix it before it hurts everyone else...<br><br>_______________________________________________<br>OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
</blockquote></div></div></div><br></div></div><br>_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br></blockquote></div><br></div>