Open Stack

I would like to think of the compute as 'failure expectant' but the
instance store is a huge hold back.  I have a limited budget and would like
to get the best environment as possible on it.  With that, consolidating
storage is a huge priority.  Running the glance from the Ceph cluster would
definately be a plus.  However, needing shared storage for
/var/lib/nova/instances as well as the ceph cluster means I need an HA NFS
setup as well as the Ceph storage nodes.  I think the only thing I will be
able to get passed off would be one or the other.  Which I assume means I
need this:
https://blueprints.launchpad.net/nova/+spec/bring-rbd-support-libvirt-images-type
to
get approved and implemented for havana... what shared ephemeral instance
stores is everyone using?


On Sat, Aug 17, 2013 at 10:33 AM, Abel Lopez <alopgeek at gmail.com> wrote:

> I believe the general consensus for production systems is to not run ceph
> on compute nodes. Compute nodes should be solely used as instance
> resources. Plus, compute nodes should be 'failure expectant', you should be
> able to just pull one out and replace it with a blank box. Adding storage
> cluster to the mix just complicates maintenance planning, etc. Plus,
> rule-of-thumb for ceph is 1GHz per OSD, which can be significant depending
> on the number of disks you're planning on.
>
> Since you're starting from scratch, I would recommend having your glance
> utilize the ceph cluster you're planning. You get added benefits by using
> qcow2 disk images in ceph, as new instances are launched as COW clones.
>
> As for 'minimal storage' on your compute nodes, I assume that you're
> intending to have a shared '/var/lib/nova/instances/' directory, as each vm
> will need a disk file. This has the added benefit of being a prerequisite
> for vm migration.
>
> Hope that helps.
>
> On Aug 16, 2013, at 11:05 PM, Mitch Anderson <mitch at metauser.net> wrote:
>
> > aHi all,
> >
> > I've been looking around for example architectures for types of sytems
> and numbers for an HA setup of Openstack Grizzly (Probably won't go live
> until after havana is released).
> >
> > I've done a Simple Non-HA setup with Mirantis' Fuel.  Which has worked
> out well.  And they're documented Production HA setup is with 3 Controllers
> and N compute nodes...
> >
> > If I were to use Ceph for storage I would need a minimum of atleast 3
> nodes.  I was looking to make my compute nodes have minimal disk space so
> only my Controllers would have storage (for Glance, DB's, etc..) and the
> Ceph storage nodes would have the rest.  Is this solution preferred?  Or,
> do I run Ceph on the compute nodes?  If so, what size nodes should they be
> then?  I'd like to run 40-60 VM's per compute node of varying sizes and
> needs.
> >
> > Any pointers would be much appreciated!
> >
> > -Mitch Anderson
> > _______________________________________________
> > OpenStack-operators mailing list
> > OpenStack-operators at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20130817/9a406027/attachment.html>