[Openstack] /var/lib/nova/instances over nfs/glusterfs issues

Rich Wohlstadter rwohlsta at genome.wustl.edu
Sat Sep 8 10:29:28 UTC 2012


Hi everyone,

I'm running into an issue where I'm using nfs on my multi-node setup for
/var/lib/nova/instances so that I can use live migration. Things work
great unless I try to spawn multiple vm instances simultaneously and the
image does not yet exist in the _base directory. I will get multiple
spawning errors on a few of the instances that are trying to spawn,
usually with the following error: OSError: [Errno 2] No such file or
directory:
'/var/lib/nova/instances/_base/1cab2bf14012771017e66501a98bf594877c9d2d.part'.
It looks like multiple nodes are trying to do things on the same file and
1 node is deleting the file while the others are trying to access it thus
producing this error. Once the image and the resized image based on flavor
is out there and present in the _base directory then I no longer get
errors when spawning multiple instances at the same time. So basically it
seems to be an issue only the first time an image has to be copied over
from glance and resized. Anyone seen this or is this a known issue when
running multi-node instance directory over nfs and/or glusterfs?

Thanks,
Rich





More information about the Openstack mailing list