[openstack-dev] [Heat] Locking and ZooKeeper - a space oddysey

Steven Dake sdake at redhat.com
Wed Oct 30 23:08:01 UTC 2013


On 10/30/2013 12:20 PM, Sandy Walsh wrote:
>
> On 10/30/2013 03:10 PM, Steven Dake wrote:
>> I will -2 any patch that adds zookeeper as a dependency to Heat.
> Certainly any distributed locking solution should be plugin based and
> optional. Just as a database-oriented solution could be the default plugin.
Sandy,

Even if it is optional, some percentage of the userbase will enable it 
and expect the Heat community to debug and support it.
> Re: the Java issue, we already have optional components in other
> languages. I know Java is a different league of pain, but if it's an
> optional component and left as a choice of the deployer, should we care?
>
> -S
>
> PS> As an aside, what are your issues with ZK?
>


I realize zookeeper exists for a reason.  But unfortunately Zookeeper is 
a server, rather then an in-process library.  This means someone needs 
to figure out how to document, scale, secure, and provide high 
availability for this component.  This is extremely challenging for the 
two server infrastructure components OpenStack server processes depend 
on today (AMQP, SQL).  If the entire OpenStack community saw value in 
biting the bullet and accepting zookeeper as a dependency and taking on 
this work, I might be more ameniable.  What we are talking about in the 
review, however, is that the Heat team bite that bullet, which is a big 
addition to the scope of work we already execute for the ability to gain 
a distributed lock.  I would expect there are simpler approaches to 
solve the problem without dragging the baggage of a new server component 
into the OpenStack deployment.

Using zookeeper as is suggested in the review is far different then the 
way Nova uses Zookeeper.  With the Nova use case, Nova still operates 
just dandy without zookeeper.  With zookeeper in the Heat usecase, it 
essentially becomes the default way people are expected to deploy Heat.

What I would prefer is taskflow over AMQP, to leverage existing server 
infrastructure (that has already been documented, scaled, secured, and 
HA-ified).

Regards
-steve

> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




More information about the OpenStack-dev mailing list