<div dir="ltr"><div>Hello,</div><div><br></div><div>We have a new build going up in our DC of Openstack Newton. We wanted to build in a shared storage solution and really liked the simplicity as well as functions of glusterFS. This would allow us to perform live migrations along with Geo replication. The issue we have been having is getting nova-libvirt instances to run on the compute nodes with the glusterfs mount point of /var/lib/nova/instances. </div><div><br></div><div>We have added all the required permissions on the volume share :</div><div>







<p class="gmail-p1"><span class="gmail-s1">Volume Name: gfsimgstore</span></p>
<p class="gmail-p1"><span class="gmail-s1">Type: Replicate</span></p>
<p class="gmail-p1"><span class="gmail-s1">Volume ID: 768d161f-78ca-40dd-befc-ddf9de2ccb38</span></p>
<p class="gmail-p1"><span class="gmail-s1">Status: Started</span></p>
<p class="gmail-p1"><span class="gmail-s1">Snapshot Count: 0</span></p>
<p class="gmail-p1"><span class="gmail-s1">Number of Bricks: 1 x 2 = 2</span></p>
<p class="gmail-p1"><span class="gmail-s1">Transport-type: tcp</span></p>
<p class="gmail-p1"><span class="gmail-s1">Bricks:</span></p>
<p class="gmail-p1"><span class="gmail-s1">Brick1: cloud304-node1:/bricks/imgstore1</span></p>
<p class="gmail-p1"><span class="gmail-s1">Brick2: cloud304-node2:/bricks/imgstore1</span></p>
<p class="gmail-p1"><span class="gmail-s1">Options Reconfigured:</span></p>
<p class="gmail-p1"><span class="gmail-s1">cluster.data-self-heal-algorithm: full</span></p>
<p class="gmail-p1"><span class="gmail-s1">features.shard: on</span></p>
<p class="gmail-p1"><span class="gmail-s1">cluster.server-quorum-type: server</span></p>
<p class="gmail-p1"><span class="gmail-s1">cluster.quorum-type: auto</span></p>
<p class="gmail-p1"><span class="gmail-s1">network.remote-dio: enable</span></p>
<p class="gmail-p1"><span class="gmail-s1">cluster.eager-lock: enable</span></p>
<p class="gmail-p1"><span class="gmail-s1">performance.stat-prefetch: off</span></p>
<p class="gmail-p1"><span class="gmail-s1">performance.io-cache: off</span></p>
<p class="gmail-p1"><span class="gmail-s1">performance.read-ahead: off</span></p>
<p class="gmail-p1"><span class="gmail-s1">performance.quick-read: off</span></p>
<p class="gmail-p1"><span class="gmail-s1">server.allow-insecure: on</span></p>
<p class="gmail-p1"><span class="gmail-s1">storage.owner-gid: 162</span></p>
<p class="gmail-p1"><span class="gmail-s1">storage.owner-uid: 162</span></p>
<p class="gmail-p1"><span class="gmail-s1">transport.address-family: inet</span></p>
<p class="gmail-p1"><span class="gmail-s1">performance.readdir-ahead: on</span></p>
<p class="gmail-p1"><span class="gmail-s1">nfs.disable: on</span></p><p class="gmail-p1"><span class="gmail-s1"><br></span></p><p class="gmail-p1"><span class="gmail-s1">We have modified permissions following what documentation we were able to locate, but we still get errors when we try to create a VM. The errors are a lot but this is the final error that stands out:</span></p><p class="gmail-p1"><span class="gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"> 2017-01-23 18:29:25.798 12184 ERROR nova.compute.manager [instance: c6634e67-b293-4424-96ec-f0c58b2bf081] libvirtError: Unable to open file: /var/lib/nova/instances/c6634e67-b293-4424-96ec-f0c58b2bf081/console.log: Permission denied 2017-01-23 18:29:25.798 12184 ERROR </span><br></span></p><p class="gmail-p1"><span class="gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"><br></span></span></p><p class="gmail-p1"><span class="gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px">I am hoping I can find someone running glusterfs and can offer some insight to our issue.</span></span></p><p class="gmail-p1"><span class="gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"><br></span></span></p><p class="gmail-p1"><span class="gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"><br></span></span></p><p class="gmail-p1"><span class="gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px">James Fleet</span></span></p><p class="gmail-p1"><span class="gmail-s1"><br></span></p><p class="gmail-p1"><span class="gmail-s1"> </span></p></div><div>







<p class="gmail-p1"><br></p></div><div><br></div><div><br></div><div><br></div><br clear="all"><div><div class="gmail_signature">James R. Fleet  <br>Innovative Solutions Technology <br> 888.809.0223 ext.702</div></div>
</div>