Open Stack

This thread got a bit sidetracked with potential use-cases for etcd3 
(which seems to happen a lot with this topic...), but we still need to 
decide how we're going to actually communicate with etcd from OpenStack 
services. Does anyone have input on that?

Thanks.

-Ben

On 12/3/18 4:48 PM, Ben Nemec wrote:
> Hi,
> 
> I wanted to revisit this topic because it has come up in some downstream 
> discussions around Cinder A/A HA and the last time we talked about it 
> upstream was a year and a half ago[1]. There have certainly been changes 
> since then so I think it's worth another look. For context, the 
> conclusion of that session was:
> 
> "Let's use etcd 3.x in the devstack CI, projects that are eventlet based 
> an use the etcd v3 http experimental API and those that don't can use 
> the etcd v3 gRPC API. Dims will submit a patch to tooz for the new 
> driver with v3 http experimental API. Projects should feel free to use 
> the DLM based on tooz+etcd3 from now on. Others projects can figure out 
> other use cases for etcd3."
> 
> The main question that has come up is whether this is still the best 
> practice or if we should revisit the preferred drivers for etcd. Gorka 
> has gotten the grpc-based driver working in a Cinder driver that needs 
> etcd[2], so there's a question as to whether we still need the HTTP 
> etcd-gateway or if everything should use grpc. I will admit I'm nervous 
> about trying to juggle eventlet and grpc, but if it works then my only 
> argument is general misgivings about doing anything clever that involves 
> eventlet. :-)
> 
> It looks like the HTTP API for etcd has moved out of experimental 
> status[3] at this point, so that's no longer an issue. There was some 
> vague concern from a downstream packaging perspective that the grpc 
> library might use a funky build system, whereas the etcd3-gateway 
> library only depends on existing OpenStack requirements.
> 
> On the other hand, I don't know how much of a hassle it is to deploy and 
> manage a grpc-gateway. I'm kind of hoping someone has already been down 
> this road and can advise about what they found.
> 
> Thanks.
> 
> -Ben
> 
> 1: https://etherpad.openstack.org/p/BOS-etcd-base-service
> 2: 
> https://github.com/embercsi/ember-csi/blob/5bd4dffe9107bc906d14a45cd819d9a659c19047/ember_csi/ember_csi.py#L1106-L1111 
> 
> 3: https://github.com/grpc-ecosystem/grpc-gateway