[Openstack] DRBD storage for Openstack installations

Oleg Gelbukh ogelbukh at mirantis.com
Fri Jun 10 06:22:31 UTC 2011


Hello everyone,

A bit of follow-up<http://mirantis.blogspot.com/2011/06/clustered-lvm-on-drbd-resource-in.html>on
the subject, concerning clustered locking for the LVM on DRBD
resource.

On Mon, May 30, 2011 at 11:04 AM, Oleg Gelbukh <ogelbukh at mirantis.com>wrote:

> The current OpenStack paradigm seems to be built around external storage,
> which contains user data on attached volumes. However, we wanted to create
> distributed storage on the same nodes we are running nova-compute on.
>
> 2011/5/26 Peter J. Pouliot <ppouliot at novell.com>
>
> Greetings Programs,
>>
>> We to have been toying with a similar idea in our lab.   We are using the
>> same model as Oleg, for existing clouds.   The current OpenStack paradigm is
>> a bit different.   Having not read all his info yet, I hope they include
>> service resources for the openstacks bits configured into his CIB.
>>
>> We have been toying with the idea, of doing linux-ha clusters under the
>> openstack services for service availability across the cloud.
>>
>> p
>>
>>
>>
>>
>> On Thu, May 26, 2011 at 03:11:34PM +0200, Diego Parrilla Santamaría wrote:
>> >    Hi Oleg,
>> >    thank you very much for your post, it's really didactic. We are
>> taking a
>> >    different approach for HA at storage level, but I have worked
>> formerly
>> >    with DRBD and I think it's a very good choice.
>> >    I'm curious about how you have deployed nova-volume nodes in your
>> >    architecture. You don't specify if the two nodes of the DRBD cluster
>> run
>> >    one or two instances of nova-volume. If you run one instance probably
>> you
>> >    have implemented some kind of fault-tolerant active-passive service
>> if the
>> >    nova-volume process fails in the active node, but I would like to
>> know if
>> >    you can run an active-active two nova-volume instances on two
>> different
>> >    physical nodes on top of the DRBD shared resource.
>> >    Regards
>> >    Diego�
>> >    --
>> >    Diego Parrilla
>> >    CEO
>> >    [1]www.stackops.com |� [2]diego.parrilla at stackops.com | +34 649 94
>> 43 29 |
>> >    skype:diegoparrilla
>> >
>> >    On Thu, May 26, 2011 at 1:29 PM, Oleg Gelbukh <[3]
>> ogelbukh at mirantis.com>
>> >    wrote:
>> >
>> >      Hi,
>> >      We were researching Openstack for our private cloud, and want to
>> share
>> >      experience and get tips from community as we go on.�
>> >      We have settled on DRBD as shared storage platform for our
>> installation.
>> >      LVM is used over the drbd device to mange logical volumes. OCFS2
>> file
>> >      system is created on one of volumes, mounted and set up as
>> >      image_path�and�instance_path in the nova.conf, other space is
>> reserved
>> >      for storage volumes (managed by nova-volume).�
>> >      As a result, we have shared storage suitable for features such as
>> live
>> >      migration and snapshots. We also have some level of
>> fault-tolerance,
>> >      with DRBD I/O error handling, which automatically redirects I/O
>> requests
>> >      to peer node over network in case of primary node failure. We
>> created
>> >      [4]script for bootstrapping lost VMs in two crash scenarios:
>> >      * dom0 host restart/domU failure: restore VMs on the same host
>> >      * dom0 host failure: restore VMs on peer node
>> >      We are considering such pair of servers with shared storage as a
>> basic
>> >      block for the cloud structure.
>> >      For whom it may interest, the details of DRBD installation are
>> [5]here.
>> >      I'll be glad to answer any questions and highly appreciate feedback
>> on
>> >      this.
>> >      Oleg S. Gelbukh,
>> >      Mirantis Inc.
>> >      [6]www.mirantis.com
>> >      _______________________________________________
>> >      Mailing list: [7]https://launchpad.net/~openstack
>> >      Post to � � : [8]openstack at lists.launchpad.net
>> >      Unsubscribe : [9]https://launchpad.net/~openstack
>> >      More help � : [10]https://help.launchpad.net/ListHelp
>> >
>> > References
>> >
>> >    Visible links
>> >    1. http://www.stackops.com/
>> >    2. mailto:diego.parrilla at stackops.com
>> >    3. mailto:ogelbukh at mirantis.com
>> >    4.
>> https://github.com/Mirantis/openstack-utils/blob/master/recovery_instance_by_id.py
>> >    5.
>> http://mirantis.blogspot.com/2011/05/shared-storage-for-openstack-based-on.html
>> >    6. http://www.mirantis.com/
>> >    7. https://launchpad.net/~openstack
>> >    8. mailto:openstack at lists.launchpad.net
>> >    9. https://launchpad.net/~openstack
>> >   10. https://help.launchpad.net/ListHelp
>>
>> > _______________________________________________
>> > Mailing list: https://launchpad.net/~openstack
>> > Post to     : openstack at lists.launchpad.net
>> > Unsubscribe : https://launchpad.net/~openstack
>> > More help   : https://help.launchpad.net/ListHelp
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20110610/f7f15287/attachment.html>


More information about the Openstack mailing list