<HTML><html><head></head><body>by the way, yes both compute nodes were using that shared NFS storage... <BR>
________________________________________<BR>
From: Conor Glynn<BR>
Sent: 13 March 2013 15:07<BR>
To: Michael Still<BR>
Cc: <a href="mailto:openstack-operators@lists.openstack.org">openstack-operators@lists.openstack.org</a><BR>
Subject: RE: [Openstack-operators] /var/lib/nova/instances fs filled up corrupting my Linux instances<BR>
<BR>
thanks Michael,<BR>
conor<BR>
________________________________________<BR>
From: <a href="mailto:mikalstill@gmail.com">mikalstill@gmail.com</a> [mikalstill@gmail.com] On Behalf Of Michael Still [mikal@stillhq.com]<BR>
Sent: 13 March 2013 14:53<BR>
To: Conor Glynn<BR>
Cc: <a href="mailto:openstack-operators@lists.openstack.org">openstack-operators@lists.openstack.org</a><BR>
Subject: Re: [Openstack-operators] /var/lib/nova/instances fs filled up corrupting my Linux instances<BR>
<BR>
On Wed, Mar 13, 2013 at 9:42 AM, Conor Glynn <cglynn@sportingindex.com> wrote:<BR>
> I ran:<BR>
> cd /var/lib/nova/instances; find -name "disk*" | xargs -n1 qemu-img info |<BR>
> grep backing | sed -e's/.*file: //' -e 's/ .*//' | sort | uniq > /tmp/inuse<BR>
> then I removed some of the old _base files that did not exist in /tmp/inuse<BR>
<BR>
That should be ok, although you should probably note that you can also<BR>
just turn on the image cache manager in folsom and it will magically<BR>
keep the base directory clean for you. That manual cleanup command<BR>
line is only really needed for essex these days.<BR>
<BR>
Note, if you have multiple compute nodes all storing instances to a<BR>
shared NFS directory this is not true, and the image cache manager is<BR>
dangerous in folsom. This is true for your cleanup script as well.<BR>
Were both compute nodes using the same NFS directory?<BR>
<BR>
I went and had a look at my blog about this stuff and realised its not<BR>
as clear as I thought it was. I'll work on fixing that ASAP.<BR>
<BR>
Michael<BR>
<BR>
<BR>
Please consider the environment before printing this email<BR>
<BR>
Inbound Email has been scanned for viruses and SPAM<BR>
<br /><br />
<p><font style="BACKGROUND-COLOR: #ffffff">
<br />*****************************************************************************<br />
<font color="#009900" face="Webdings" size="4">P</font><font color="#009900" face="verdana,arial,helvetica" size="2"> <strong>Please
consider the environment before printing this email or attachments</strong></font>
</font></p><p><font style="BACKGROUND-COLOR: #ffffff">
<br />This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.<br />
</font></p><font style="BACKGROUND-COLOR: #ffffff">
<br />Outbound email has been scanned for viruses and SPAM<br />
</font><p></p>
</body></html></HTML>