[Openstack] GlusterFS and Openstack Newton

James Fleet jrfleet at istech-corp.com
Tue Jan 24 15:51:15 UTC 2017


We have a new build going up in our DC of Openstack Newton. We wanted to
build in a shared storage solution and really liked the simplicity as well
as functions of glusterFS. This would allow us to perform live migrations
along with Geo replication. The issue we have been having is getting
nova-libvirt instances to run on the compute nodes with the glusterfs mount
point of /var/lib/nova/instances.

We have added all the required permissions on the volume share :

Volume Name: gfsimgstore

Type: Replicate

Volume ID: 768d161f-78ca-40dd-befc-ddf9de2ccb38

Status: Started

Snapshot Count: 0

Number of Bricks: 1 x 2 = 2

Transport-type: tcp


Brick1: cloud304-node1:/bricks/imgstore1

Brick2: cloud304-node2:/bricks/imgstore1

Options Reconfigured:

cluster.data-self-heal-algorithm: full

features.shard: on

cluster.server-quorum-type: server

cluster.quorum-type: auto

network.remote-dio: enable

cluster.eager-lock: enable

performance.stat-prefetch: off

performance.io-cache: off

performance.read-ahead: off

performance.quick-read: off

server.allow-insecure: on

storage.owner-gid: 162

storage.owner-uid: 162

transport.address-family: inet

performance.readdir-ahead: on

nfs.disable: on

We have modified permissions following what documentation we were able to
locate, but we still get errors when we try to create a VM. The errors are
a lot but this is the final error that stands out:

 2017-01-23 18:29:25.798 12184 ERROR nova.compute.manager [instance:
c6634e67-b293-4424-96ec-f0c58b2bf081] libvirtError: Unable to open file:
Permission denied 2017-01-23 18:29:25.798 12184 ERROR

I am hoping I can find someone running glusterfs and can offer some insight
to our issue.

James Fleet

James R. Fleet
Innovative Solutions Technology
 888.809.0223 ext.702
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20170124/df60a5cf/attachment.html>

More information about the Openstack mailing list