<div dir="ltr">That is a good idea Peter to troubleshoot the disk access its not making sense I am able to mount the volume and write files to it but it seems a permission thing with libvirt and Nova.<div><br></div><div><br></div><div>James Fleet </div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature">James R. Fleet  <br>Innovative Solutions Technology <br>484 Williamsport Pike  #135 <br>Martinsburg, WV 25404 <br> 888.809.0223 ext.702</div></div>
<br><div class="gmail_quote">On Tue, Jan 24, 2017 at 2:44 PM, Peter Kirby <span dir="ltr"><<a href="mailto:peter.kirby@objectstream.com" target="_blank">peter.kirby@objectstream.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">If you use audit2why on your audit log, is there anything in there suggesting SELinux is blocking the disk access?<div><div class="h5"><br><div class="gmail_extra"><br>On Tue, Jan 24, 2017 at 12:12 PM, James Fleet <span dir="ltr"><<a href="mailto:jrfleet@istech-corp.com" target="_blank">jrfleet@istech-corp.com</a>></span> wrote:<br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello Peter,<div><br></div><div><br></div><div>Yes, the command to add it to SElinux is setsebool -P virt_use_fusefs on which allows the client to connect using SElInux.</div></div><div class="gmail_extra"><br clear="all"><div><div class="m_3241482151224360845m_7699211788905249361gmail_signature" data-smartmail="gmail_signature"><span>James R. Fleet  <br>Innovative Solutions Technology <br></span>484 Williamsport Pike  #135 <br>Martinsburg, WV 25404 <br> <a href="tel:(888)%20809-0223" value="+18888090223" target="_blank">888.809.0223 ext.702</a></div></div><div><div class="m_3241482151224360845h5">
<br><div class="gmail_quote">On Tue, Jan 24, 2017 at 11:17 AM, Peter Kirby <span dir="ltr"><<a href="mailto:peter.kirby@objectstream.com" target="_blank">peter.kirby@objectstream.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi James,<br><br><br></div><div>I'm pretty new to OpenStack, but I'm working on setting up exactly the same thing right now.  I'm having some other issues a little before where you are with my stonith device so I don't really have any insight on your exact problem.  If I get mine to work I'll share what I did.<br><br></div><div>However, my first thought is SELinux.  If you've checked file permissions and they look ok, is SELinux Enforcing?  If so, you might try to temporarily set it to permissive.  If that fixes the problem then check audit logs for what you're missing.  It could be a missing context.<br><br></div><div>Just my two cents.<br><br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_3241482151224360845m_7699211788905249361h5">On Tue, Jan 24, 2017 at 9:51 AM, James Fleet <span dir="ltr"><<a href="mailto:jrfleet@istech-corp.com" target="_blank">jrfleet@istech-corp.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_3241482151224360845m_7699211788905249361h5"><div dir="ltr"><div>Hello,</div><div><br></div><div>We have a new build going up in our DC of Openstack Newton. We wanted to build in a shared storage solution and really liked the simplicity as well as functions of glusterFS. This would allow us to perform live migrations along with Geo replication. The issue we have been having is getting nova-libvirt instances to run on the compute nodes with the glusterfs mount point of /var/lib/nova/instances. </div><div><br></div><div>We have added all the required permissions on the volume share :</div><div>







<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Volume Name: gfsimgstore</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Type: Replicate</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Volume ID: 768d161f-78ca-40dd-befc-ddf9de<wbr>2ccb38</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Status: Started</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Snapshot Count: 0</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Number of Bricks: 1 x 2 = 2</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Transport-type: tcp</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Bricks:</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Brick1: cloud304-node1:/bricks/imgstor<wbr>e1</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Brick2: cloud304-node2:/bricks/imgstor<wbr>e1</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">Options Reconfigured:</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">cluster.data-self-heal-algorit<wbr>hm: full</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">features.shard: on</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">cluster.server-quorum-type: server</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">cluster.quorum-type: auto</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">network.remote-dio: enable</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">cluster.eager-lock: enable</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">performance.stat-prefetch: off</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">performance.io-cache: off</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">performance.read-ahead: off</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">performance.quick-read: off</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">server.allow-insecure: on</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">storage.owner-gid: 162</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">storage.owner-uid: 162</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">transport.address-family: inet</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">performance.readdir-ahead: on</span></p>
<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">nfs.disable: on</span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><br></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1">We have modified permissions following what documentation we were able to locate, but we still get errors when we try to create a VM. The errors are a lot but this is the final error that stands out:</span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"> 2017-01-23 18:29:25.798 12184 ERROR nova.compute.manager [instance: c6634e67-b293-4424-96ec-f0c58b<wbr>2bf081] libvirtError: Unable to open file: /var/lib/nova/instances/c6634e<wbr>67-b293-4424-96ec-f0c58b2bf081<wbr>/console.log: Permission denied 2017-01-23 18:29:25.798 12184 ERROR </span><br></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"><br></span></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px">I am hoping I can find someone running glusterfs and can offer some insight to our issue.</span></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"><br></span></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px"><br></span></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><span style="color:rgb(75,75,75);font-family:"helvetica neue",arial,helvetica,sans-serif;font-size:14px">James Fleet</span></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"><br></span></p><p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><span class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-s1"> </span></p></div><div>







<p class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail-p1"><br></p></div><div><br></div><div><br></div><div><br></div><br clear="all"><div><div class="m_3241482151224360845m_7699211788905249361m_2502315530029417589m_-4088928228542867108gmail_signature">James R. Fleet  <br>Innovative Solutions Technology <br> <a href="tel:(888)%20809-0223" value="+18888090223" target="_blank">888.809.0223 ext.702</a></div></div>
</div>
<br></div></div>______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k</a><br>
Post to     : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k</a><br>
<br></blockquote></div><br></div></div>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div></div></div></div>
</blockquote></div><br></div>