[Openstack-operators] Reference architecture for medium sized environment

Lorin Hochstein lorin at nimbisservices.com
Mon Aug 19 13:04:49 UTC 2013


Abel:

I vaguely recall from one of the summits that DreamHost deploys ceph on
their compute nodes. Are there any DreamHost folks on this list who could
comment?

Lorin


On Sat, Aug 17, 2013 at 12:33 PM, Abel Lopez <alopgeek at gmail.com> wrote:

> I believe the general consensus for production systems is to not run ceph
> on compute nodes. Compute nodes should be solely used as instance
> resources. Plus, compute nodes should be 'failure expectant', you should be
> able to just pull one out and replace it with a blank box. Adding storage
> cluster to the mix just complicates maintenance planning, etc. Plus,
> rule-of-thumb for ceph is 1GHz per OSD, which can be significant depending
> on the number of disks you're planning on.
>
> Since you're starting from scratch, I would recommend having your glance
> utilize the ceph cluster you're planning. You get added benefits by using
> qcow2 disk images in ceph, as new instances are launched as COW clones.
>
> As for 'minimal storage' on your compute nodes, I assume that you're
> intending to have a shared '/var/lib/nova/instances/' directory, as each vm
> will need a disk file. This has the added benefit of being a prerequisite
> for vm migration.
>
> Hope that helps.
>
> On Aug 16, 2013, at 11:05 PM, Mitch Anderson <mitch at metauser.net> wrote:
>
> > aHi all,
> >
> > I've been looking around for example architectures for types of sytems
> and numbers for an HA setup of Openstack Grizzly (Probably won't go live
> until after havana is released).
> >
> > I've done a Simple Non-HA setup with Mirantis' Fuel.  Which has worked
> out well.  And they're documented Production HA setup is with 3 Controllers
> and N compute nodes...
> >
> > If I were to use Ceph for storage I would need a minimum of atleast 3
> nodes.  I was looking to make my compute nodes have minimal disk space so
> only my Controllers would have storage (for Glance, DB's, etc..) and the
> Ceph storage nodes would have the rest.  Is this solution preferred?  Or,
> do I run Ceph on the compute nodes?  If so, what size nodes should they be
> then?  I'd like to run 40-60 VM's per compute node of varying sizes and
> needs.
> >
> > Any pointers would be much appreciated!
> >
> > -Mitch Anderson
> > _______________________________________________
> > OpenStack-operators mailing list
> > OpenStack-operators at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>



-- 
Lorin Hochstein
Lead Architect - Cloud Services
Nimbis Services, Inc.
www.nimbisservices.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20130819/ba781207/attachment.html>


More information about the OpenStack-operators mailing list