[Openstack] using Glusterfs for instance storage
Razique Mahroua
razique.mahroua at gmail.com
Thu Apr 11 19:27:11 UTC 2013
Also,
you can import manually one instance and see if it boots.
$ cd /exports/instances/instances/instance-00000242
$ virsh define libvirt.xml
$ virsh start instance-00000242
and see if it boots, if so, we should start looking somewhere else
Razique Mahroua - Nuage & Co
razique.mahroua at gmail.com
Tel : +33 9 72 37 94 15
Le 11 avr. 2013 à 20:14, Vishvananda Ishaya <vishvananda at gmail.com> a écrit :
> You should check your syslog for app armor denied messages. It is possible
> app armor is getting in the way here.
>
> Vish
>
> On Apr 11, 2013, at 8:35 AM, John Paul Walters <jwalters at isi.edu> wrote:
>
>> Hi Sylvain,
>>
>> I agree, though I've confirmed that the UID and GID are consistent across both the compute nodes and my Glusterfs nodes.
>>
>> JP
>>
>>
>> On Apr 11, 2013, at 11:22 AM, Sylvain Bauza <sylvain.bauza at digimind.com> wrote:
>>
>>> Agree.
>>> As for other shared FS, this is *highly* important to make sure Nova UID and GID are consistent in between all compute nodes.
>>> If this is not the case, then you have to usermod all instances...
>>>
>>> -Sylvain
>>>
>>> Le 11/04/2013 16:49, Razique Mahroua a écrit :
>>>> Hi JP,
>>>> my bet is that this is a writing permissions issue. Does nova has the right to write within the mounted directory?
>>>>
>>>> Razique Mahroua - Nuage & Co
>>>> razique.mahroua at gmail.com
>>>> Tel : +33 9 72 37 94 15
>>>>
>>>>
>>>>
>>>> Le 11 avr. 2013 à 16:36, John Paul Walters <jwalters at isi.edu> a écrit :
>>>>
>>>>> Hi,
>>>>>
>>>>> We've started implementing a Glusterfs-based solution for instance storage in order to provide live migration. I've run into a strange problem when using a multi-node Gluster setup that I hope someone has a suggestion to resolve.
>>>>>
>>>>> I have a 12 node distributed/replicated Gluster cluster. I can mount it to my client machines, and it seems to be working alright. When I launch instances, the nova-compute log on the client machines are giving me two error messages:
>>>>>
>>>>> First is a qemu-kvm error: could not open disk image /exports/instances/instances/instance-00000242/disk: Invalid argument
>>>>> (full output at http://pastebin.com/i8vzWegJ)
>>>>>
>>>>> The second error message comes a short time later ending with nova.openstack.common.rpc.amqp Invalid: Instance has already been created
>>>>> (full output at http://pastebin.com/6Ta4kkBN)
>>>>>
>>>>> This happens reliably with the multi-Gluster-node setup. Oddly, after creating a test Gluster volume composed of a single brick and single node, everything works fine.
>>>>>
>>>>> Does anyone have any suggestions?
>>>>>
>>>>> thanks,
>>>>> JP
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list: https://launchpad.net/~openstack
>>>>> Post to : openstack at lists.launchpad.net
>>>>> Unsubscribe : https://launchpad.net/~openstack
>>>>> More help : https://help.launchpad.net/ListHelp
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~openstack
>>>> Post to : openstack at lists.launchpad.net
>>>> Unsubscribe : https://launchpad.net/~openstack
>>>> More help : https://help.launchpad.net/ListHelp
>>>
>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~openstack
>> Post to : openstack at lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~openstack
>> More help : https://help.launchpad.net/ListHelp
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack at lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help : https://help.launchpad.net/ListHelp
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130411/31286715/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: NUAGECO-LOGO-Fblan_petit.jpg
Type: image/jpeg
Size: 10122 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130411/31286715/attachment.jpg>
More information about the Openstack
mailing list