[openstack-dev] [devstack] Enable LVM ephemeral storage for Nova
Dan Genin
daniel.genin at jhuapl.edu
Wed Oct 29 13:16:16 UTC 2014
On 10/28/2014 02:50 PM, John Griffith wrote:
>
>
> On Tue, Oct 28, 2014 at 12:37 PM, Dan Genin <daniel.genin at jhuapl.edu
> <mailto:daniel.genin at jhuapl.edu>> wrote:
>
> Great, thank you, Duncan. I will then proceed with the shared
> volume group.
>
> Dan
>
>
> On 10/28/2014 02:06 PM, Duncan Thomas wrote:
>
> Cinder volumes are always (unless you go change the default)
> in the
> form: volume-<uuid>, and since the string 'volume-' is never a
> valid
> uuid, then I think we can work around nova volumes fine when
> we come
> to write our tests.
>
> Sorry for the repeated circling on this, but I think I'm now
> happy.
>
> Thanks
>
>
>
> On 28 October 2014 17:53, Dan Genin <daniel.genin at jhuapl.edu
> <mailto:daniel.genin at jhuapl.edu>> wrote:
>
> On 10/28/2014 11:56 AM, Dean Troyer wrote:
>
> On Tue, Oct 28, 2014 at 9:27 AM, Dan Genin
> <daniel.genin at jhuapl.edu <mailto:daniel.genin at jhuapl.edu>>
> wrote:
>
> So this brings us back to the original proposal of
> having separate backing
> files for Cinder and Nova which Dean thought might
> take too much space.
>
>
> Between Cinder, Nova and Swift (and Ceph, etc) everybody
> wants some loopback
> disk images. DevStack's Swift and Ceph configurations
> assume loopback
> devices and do no sharing.
>
> Duncan, could you please elaborate on the pain a
> single volume group is
> likely to cause for Cinder? Is it a show stopper?
>
>
> Back in the day, DevStack was built to configure Cinder
> (and Nova Volume
> before that) to use a specific existing volume group
> (VOLUME_GROUP_NAME) or
> create a loopback file if necessary. With the help of
> VOLUME_NAME_PREFIX
> and volume_name_template DevStack knew which logical
> volumes belong to
> Cinder and could Do The Right Thing.
>
> With three loopback files being created, all wanting
> larger and larger
> defaults, adding a fourth becomes Just One More Thing. If
> Nova's use of LVM
> is similar enough to Cinder's (uses deterministic naming
> for the LVs) I'm
> betting we could make it work.
>
> dt
>
> Nova's disk names are of the form
> <instance-uuid>_<disk_type>. So
> deterministic but, unfortunately, not necessarily
> predictable. It sounds
> like Duncan is saying that Cinder needs a fixed prefix for
> testing its
> functionality. I will be honest, I am not optimistic about
> convincing Nova
> to change their disk naming scheme for the sake of LVM
> testing. Far more
> important changes have lingered for months and sometimes
> longer.
>
> It sounds like you are concerned about two issues with
> regard to the
> separate volume groups approach: 1) potential loop device
> shortage and 2)
> growing space demand. The second issue, it seems to me,
> will arise no matter
> which of the two solutions we choose. More space will be
> required for
> testing Nova's LVM functionality one way or another,
> although, using a
> shared volume group would permit a more efficient use of
> the available
> space. The first issue is, indeed, a direct consequence of
> the choice to use
> distinct volume groups. However, the number of available
> loop devices can be
> increased by passing the appropriate boot parameter to the
> kernel, which can
> be easy or hard depending on how the test VMs are spun up.
>
> I am not saying that we should necessarily go the way of
> separate volume
> groups but, assuming for the moment that changing Nova's
> disk naming scheme
> is not an option, we need to figure out what will bring
> the least amount of
> pain forcing Cinder tests to work around Nova volumes or
> create separate
> volume groups.
>
> Let me know what you think.
> Dan
>
>
> --
>
> Dean Troyer
> dtroyer at gmail.com <mailto:dtroyer at gmail.com>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> <mailto:OpenStack-dev at lists.openstack.org>
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> <mailto:OpenStack-dev at lists.openstack.org>
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> <mailto:OpenStack-dev at lists.openstack.org>
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
> Noticed my response never posted.... think there's something up with
> my mail client, so if you get this a few more times forgive me :)
>
> But....
> The idea of sharing a VG
> between Nova and Cinder is only relevant in an all in one deployment
> anyway, it's a specific edge case for testing. It certainly (IMHO) does
> not warrant any changes in Nova and Cinder. Also keep in mind that at
> some point (I think we're already there) we need to consider whether our
> default gating and setup can continue to be done on a single node
> anyway.
Agree.
> The answer to this seems relatively simple to me, Dean pointed out just
> add a loopback device specifically for Nova LVM testing and move on.
Dean is actually for using a shared VG to conserve space and loop devices.
Dan
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141029/638672a4/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3449 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141029/638672a4/attachment.bin>
More information about the OpenStack-dev
mailing list