[openstack-dev] [OpenStack-Dev][Nova][VMWare] Enable live migration with one nova compute
Jay Lau
jay.lau.513 at gmail.com
Wed Apr 9 15:28:05 UTC 2014
@Divakar, yes, the "Proxy Compute" model is not new, but I'm not sure if
this model can be accepted by community to manage both VM and PM. Anyway, I
will try to file a bp and get more comments then. Thanks.
2014-04-09 22:52 GMT+08:00 Nandavar, Divakar Padiyar <
divakar.padiyar-nandavar at hp.com>:
> Hi Jay,
> Managing multiple clusters using the "Compute Proxy" is not new right?
> Prior to this "nova baremetal" driver has used this model already. Also
> this "Proxy Compute" model gives flexibility to deploy as many computes
> required based on the requirement. For example, one can setup one proxy
> compute node to manage a set of clusters and another proxy compute to
> manage a separate set of clusters or launch compute node for each of the
> clusters.
>
> Thanks,
> Divakar
>
> -----Original Message-----
> From: Jay Pipes [mailto:jaypipes at gmail.com]
> Sent: Wednesday, April 09, 2014 6:23 PM
> To: openstack-dev at lists.openstack.org
> Subject: Re: [openstack-dev] [OpenStack-Dev][Nova][VMWare] Enable live
> migration with one nova compute
> Importance: High
>
> Hi Juan, thanks for your response. Comments inline.
>
> On Mon, 2014-04-07 at 10:22 +0200, Juan Manuel Rey wrote:
> > Hi,
> >
> > I'm fairly new to this list, actually this is my first email sent, and
> > to OpenStack in general, but I'm not new at all to VMware so I'll try
> > to give you my point of view about possible use case here.
> >
> > Jay you are saying that by using Nova to manage ESXi hosts we don't
> > need vCenter because they basically overlap in their capabilities.
>
> Actually, no, this is not my main point. My main point is that Nova should
> not change its architecture to fit the needs of one particular host
> management platform (vCenter).
>
> Nova should, as much as possible, communicate with vCenter to perform some
> operations -- in the same way that Nova communicates with KVM or XenServer
> to perform some operations. But Nova should not be re-architected (and I
> believe that is what has gone on here with the code change to have one
> nova-compute worker talking to multiple vCenter
> clusters) just so that one particular host management scheduler/platform
> (vCenter) can have all of its features exposed to Nova.
>
> > I agree with you to some extent, Nova may have similar capabilities
> > as vCenter Server but as you know OpenStack as a full cloud solution
> > adds a lot more features that vCenter lacks, like multitenancy just to
> > name one.
>
> Sure, however, my point is that Nova shouldn't need to be re-architected
> just to adhere to one particular host management platform's concepts of an
> atomic provider of compute resources.
>
> > Also in any vSphere environment managing ESXi hosts individually, this
> > is without vCenter, is completely out of the question. vCenter is the
> > enabler of many vSphere features. And precisely that's is, IMHO, the
> > use case of using Nova to manage vCenter to manage vSphere. Without
> > vCenter we only have a bunch of hypervisors and none of the HA or DRS
> > (dynamic resource balancing) capabilities that a vSphere cluster
> > provides, this in my experience with vSphere users/customers is a no
> > go scenario.
>
> Understood. Still doesn't change my opinion though :)
>
> Best,
> -jay
>
> > I don't know why the decision to manage vCenter with Nova was made but
> > based on the above I understand the reasoning.
> >
> >
> > Best,
> > ---
> > Juan Manuel Rey
> >
> > @jreypo
> >
> >
> > On Mon, Apr 7, 2014 at 7:20 AM, Jay Pipes <jaypipes at gmail.com> wrote:
> > On Sun, 2014-04-06 at 06:59 +0000, Nandavar, Divakar Padiyar
> > wrote:
> > > >> Well, it seems to me that the problem is the above
> > blueprint and the code it introduced. This is an anti-feature
> > IMO, and probably the best solution would be to remove the
> > above code and go back to having a single >> nova-compute
> > managing a single vCenter cluster, not multiple ones.
> > >
> > > Problem is not introduced by managing multiple clusters from
> > single nova-compute proxy node.
> >
> >
> > I strongly disagree.
> >
> > > Internally this proxy driver is still presenting the
> > "compute-node" for each of the cluster its managing.
> >
> >
> > In what way?
> >
> > > What we need to think about is applicability of the live
> > migration use case when a "cluster" is modelled as a compute.
> > Since the "cluster" is modelled as a compute, it is assumed
> > that a typical use case of live-move is taken care by the
> > underlying "cluster" itself. With this there are other
> > use cases which are no-op today like host maintenance mode,
> > live move, setting instance affinity etc., In order to
> > resolve this I was thinking of
> > > "A way to expose operations on individual ESX Hosts like
> > Putting host in maintenance mode, live move, instance
> > affinity etc., by introducing Parent - Child compute node
> > concept. Scheduling can be restricted to Parent compute node
> > and Child compute node can be used for providing more drill
> > down on compute and also enable additional compute
> > operations". Any thoughts on this?
> >
> >
> > The fundamental problem is that hacks were put in place in
> > order to make
> > Nova defer control to vCenter, when the design of Nova and
> > vCenter are
> > not compatible, and we're paying the price for that right now.
> >
> > All of the operations you describe above -- putting a host in
> > maintenance mode, live-migration of an instance, ensuring a
> > new instance
> > is launched near or not-near another instance -- depend on a
> > fundamental
> > design feature in Nova: that a nova-compute worker fully
> > controls and
> > manages a host that provides a place to put server instances.
> > We have
> > internal driver interfaces for the *hypervisor*, not for the
> > *manager of
> > hypervisors*, because, you know, that's what Nova does.
> >
> > The problem with all of the vCenter stuff is that it is trying
> > to say to
> > Nova "don't worry, I got this" but unfortunately, Nova wants
> > and needs
> > to manage these things, not surrender control to a different
> > system that
> > handles orchestration and scheduling in its own unique way.
> >
> > If a shop really wants to use vCenter for scheduling and
> > orchestration
> > of server instances, what exactly is the point of using
> > OpenStack Nova
> > to begin with? What exactly is the point of trying to use
> > OpenStack Nova
> > for scheduling and host operations when you've already shelled
> > out US
> > $6,000 for vCenter Server and a boatload more money for ESX
> > licensing?
> >
> > Sorry, I'm just at a loss why Nova was changed to accomodate
> > vCenter
> > cluster and management concepts to begin with. I just don't
> > understand
> > the use case here.
> >
> > Best,
> > -jay
> >
> >
> >
> >
> >
> >
> > _______________________________________________
> > OpenStack-dev mailing list
> > OpenStack-dev at lists.openstack.org
> >
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> >
> >
> >
> > _______________________________________________
> > OpenStack-dev mailing list
> > OpenStack-dev at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
--
Thanks,
Jay
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140409/ab1e9d2e/attachment.html>
More information about the OpenStack-dev
mailing list