<html><head><meta http-equiv="Content-Type" content="text/html charset=iso-8859-1"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Hi Razique,</div><div><br></div><div>Thanks for chiming in. Yes, nova owns the instances directory that it's writing to. In fact, between the multi-node volume and the single node volume, I gave the same permissions: created a directory "instances" on the gluster volume, and chown nova.nova instances. The individual instance directories get created whenever I try to launch an instance, and the permissions all seem okay to me:</div><div><br></div><div>Here are the permissions on the gluster volume:</div><div>[root@openstack-13 instances]# ls -al</div><div>total 29</div><div>drwxr-xr-x. 4 nova nova 234 Apr 11 14:20 .</div><div>drwxr-xr-x. 3 root root 4096 Apr 10 15:52 ..</div><div>drwxr-x---. 11 nova nova 24576 Apr 11 14:31 instances </div><div><br></div><div>Inside of instances:</div><div><div>[root@openstack-13 instances]# ls -al</div><div>total 33</div><div>drwxr-x---. 11 nova nova 24576 Apr 11 14:31 .</div><div>drwxr-xr-x. 4 nova nova 234 Apr 11 14:20 ..</div><div>drwxr-xr-x. 2 nova nova 8302 Apr 11 14:21 _base</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:21 instance-0000023b</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:22 instance-0000023c</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:22 instance-0000023d</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:22 instance-0000023e</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:22 instance-0000023f</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:22 instance-00000240</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:25 instance-00000241</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:31 instance-00000242</div></div><div><br></div><div>instance-00000241 is an example of one that's failed, inside of there:</div><div><div>[root@openstack-13 instance-00000241]# ls -al</div><div>total 4678</div><div>drwxr-xr-x. 2 nova nova 110 Apr 11 14:25 .</div><div>drwxr-x---. 11 nova nova 24576 Apr 11 14:31 ..</div><div>-rw-rw----. 1 root root 0 Apr 11 14:25 console.log</div><div>-rw-r--r--. 1 root root 262144 Apr 11 14:25 disk</div><div>-rw-r--r--. 1 root root 4404752 Apr 11 14:25 kernel</div><div>-rw-r--r--. 1 nova nova 1277 Apr 11 14:25 libvirt.xml</div><div>-rw-r--r--. 1 root root 96629 Apr 11 14:25 ramdisk</div></div><div><br></div><div>To me, it seems reasonable. I'm happy to be wrong though.</div><div>thanks,</div><div>JP</div><div><br></div><div><div>On Apr 11, 2013, at 10:49 AM, Razique Mahroua <<a href="mailto:razique.mahroua@gmail.com">razique.mahroua@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><meta http-equiv="Content-Type" content="text/html charset=iso-8859-1"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hi JP,<div>my bet is that this is a writing permissions issue. Does nova has the right to write within the mounted directory?</div><div><br><div apple-content-edited="true">
<span class="Apple-style-span" style="border-collapse: separate; font-family: 'Lucida Grande'; border-spacing: 0px; "><span class="Apple-style-span" style="font-weight: normal; font-family: Helvetica; "><b style="color: rgb(19, 112, 138); ">Razique Mahroua</b></span><span class="Apple-style-span" style="font-weight: normal; font-family: Helvetica; color: rgb(19, 112, 138); "><b> - </b></span><span class="Apple-style-span" style="font-family: Helvetica; "><span class="Apple-style-span" style="font-weight: normal; font-family: Helvetica; "><b style="color: rgb(19, 112, 138); ">Nuage & Co</b></span><span class="Apple-style-span" style="border-collapse: separate; font-family: Helvetica; font-style: normal; font-variant: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span class="Apple-style-span" style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; border-collapse: separate; border-spacing: 0px; -webkit-text-decorations-in-effect: none; "><span class="Apple-style-span" style="border-collapse: separate; font-variant: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="font-weight: normal; font-family: Helvetica; font-size: medium; font-style: normal; "><font class="Apple-style-span" color="#13708a"><a href="mailto:razique.mahroua@gmail.com">razique.mahroua@gmail.com</a></font></div><div style="font-family: Helvetica; font-size: medium; font-style: normal; "><font class="Apple-style-span" color="#13708a">Tel : +33 9 72 37 94 15</font></div></span></span></span></span></span><br class="Apple-interchange-newline" style="font-family: Arial; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><span><NUAGECO-LOGO-Fblan_petit.jpg></span>
</div>
<br><div><div>Le 11 avr. 2013 à 16:36, John Paul Walters <<a href="mailto:jwalters@isi.edu">jwalters@isi.edu</a>> a écrit :</div><br class="Apple-interchange-newline"><blockquote type="cite">Hi,<br><br>We've started implementing a Glusterfs-based solution for instance storage in order to provide live migration. I've run into a strange problem when using a multi-node Gluster setup that I hope someone has a suggestion to resolve.<br><br>I have a 12 node distributed/replicated Gluster cluster. I can mount it to my client machines, and it seems to be working alright. When I launch instances, the nova-compute log on the client machines are giving me two error messages:<br><br>First is a qemu-kvm error: could not open disk image /exports/instances/instances/instance-00000242/disk: Invalid argument<br>(full output at <a href="http://pastebin.com/i8vzWegJ">http://pastebin.com/i8vzWegJ</a>)<br><br>The second error message comes a short time later ending with nova.openstack.common.rpc.amqp Invalid: Instance has already been created<br>(full output at <a href="http://pastebin.com/6Ta4kkBN">http://pastebin.com/6Ta4kkBN</a>)<br><br>This happens reliably with the multi-Gluster-node setup. Oddly, after creating a test Gluster volume composed of a single brick and single node, everything works fine.<br><br>Does anyone have any suggestions?<br><br>thanks,<br>JP<br><br><br>_______________________________________________<br>Mailing list: <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>Unsubscribe : <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>More help : <a href="https://help.launchpad.net/ListHelp">https://help.launchpad.net/ListHelp</a><br></blockquote></div><br></div></div></blockquote></div><br></body></html>