[Openstack-operators] cinder gluster volume driver
Joe Topjian
joe.topjian at cybera.ca
Tue May 14 15:03:08 UTC 2013
Hello,
I thought I would post this due to the frequent Gluster talk on the list:
Just an FYI for anyone thinking of using this volume driver: make sure you
are using a kernel greater than 3.3. For Ubuntu 12.04, the 3.4 kernel found
here works:
http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.4-precise/
The reason for this is that Nova tries to attach the volume using
cache="none". This requires the filesystem to support O_DIRECT, which is
only available for FUSE-based filesystems in kernels above 3.3.
When trying to attach a gluster-based volume to an instance on a compute
node that runs a kernel below 3.3 (eg the stock Ubuntu 12.04 kernel), you
will get a very helpful error message of "DeviceIsBusy: The supplied device
(vdx) is busy)"...
Hopefully this saves someone the 2 hours of troubleshooting that I went
through to figure out the real answer :)
This morning I went to file a bug and saw one has already filed:
https://bugs.launchpad.net/nova/+bug/1177103
I love when that happens when you already know the answer you're looking
for :)
I will also be amending the Gluster volume driver docs to note this.
Finally, this issue seems to be resolved for using Gluster as an instance
store. If I remember right, I ran into this same issue several months ago
and it was resolved by updating the kernel. Seems like Grizzly correctly
detects if O_DIRECT is available or not.
Thanks,
Joe
--
Joe Topjian
Systems Administrator
Cybera Inc.
www.cybera.ca
Cybera is a not-for-profit organization that works to spur and support
innovation, for the economic benefit of Alberta, through the use
of cyberinfrastructure.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20130514/5bfef536/attachment.html>
More information about the OpenStack-operators
mailing list