<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Joshua,
<div class=""><br class="">
</div>
<div class="">The tenancy boundary in Magnum is the bay. You can place whatever single-tenant COE you want into the bay (Kubernetes, Mesos, Docker Swarm). This allows you to use native tools to interact with the COE in that bay, rather than using an OpenStack
specific client. If you want to use the OpenStack client to create both bays, pods, and containers, you can do that today. You also have the choice, for example, to run kubctl against your Kubernetes bay, if you so desire. </div>
<div class=""><br class="">
</div>
<div class="">Bays offer both a management and security isolation between multiple tenants. There is no intent to share a single bay between multiple tenants. In your use case, you would simply create two bays, one for each of the yahoo-mail.XX tenants. I am
not convinced that having an uber-tenant makes sense.</div>
<div class=""><br class="">
</div>
<div class="">Adrian</div>
<div class=""><br class="">
<div>
<blockquote type="cite" class="">
<div class="">On Sep 30, 2015, at 1:13 PM, Joshua Harlow <<a href="mailto:harlowja@outlook.com" class="">harlowja@outlook.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Adrian
Otto wrote:</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
Thanks everyone who has provided feedback on this thread. The good<br class="">
news is that most of what has been asked for from Magnum is actually<br class="">
in scope already, and some of it has already been implemented. We<br class="">
never aimed to be a COE deployment service. That happens to be a<br class="">
necessity to achieve our more ambitious goal: We want to provide a<br class="">
compelling Containers-as-a-Service solution for OpenStack clouds in a<br class="">
way that offers maximum leverage of what’s already in OpenStack,<br class="">
while giving end users the ability to use their favorite tools to<br class="">
interact with their COE of choice, with the multi-tenancy capability<br class="">
we expect from all OpenStack services, and simplified integration<br class="">
with a wealth of existing OpenStack services (Identity,<br class="">
Orchestration, Images, Networks, Storage, etc.).<br class="">
<br class="">
The areas we have disagreement are whether the features offered for<br class="">
the k8s COE should be mirrored in other COE’s. We have not attempted<br class="">
to do that yet, and my suggestion is to continue resisting that<br class="">
temptation because it is not aligned with our vision. We are not here<br class="">
to re-invent container management as a hosted service. Instead, we<br class="">
aim to integrate prevailing technology, and make it work great with<br class="">
OpenStack. For example, adding docker-compose capability to Magnum is<br class="">
currently out-of-scope, and I think it should stay that way. With<br class="">
that said, I’m willing to have a discussion about this with the<br class="">
community at our upcoming Summit.<br class="">
<br class="">
An argument could be made for feature consistency among various COE<br class="">
options (Bay Types). I see this as a relatively low value pursuit.<br class="">
Basic features like integration with OpenStack Networking and<br class="">
OpenStack Storage services should be universal. Whether you can<br class="">
present a YAML file for a bay to perform internal orchestration is<br class="">
not important in my view, as long as there is a prevailing way of<br class="">
addressing that need. In the case of Docker Bays, you can simply<br class="">
point a docker-compose client at it, and that will work fine.<br class="">
<br class="">
</blockquote>
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">So
an interesting question, but how is tenancy going to work, will there be a keystone tenancy <-> COE tenancy adapter? From my understanding a whole bay (COE?) is owned by a tenant, which is great for tenants that want to ~experiment~ with a COE but seems disjoint
from the end goal of an integrated COE where the tenancy model of both keystone and the COE is either the same or is adapted via some adapter layer.</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">For
example:</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">1)
Bay that is connected to uber-tenant 'yahoo'</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""> 1.1)
Pod inside bay that is connected to tenant '</span><a href="http://yahoo-mail.us/" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">yahoo-mail.us</a><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">'</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""> 1.2)
Pod inside bay that is connected to tenant 'yahoo-mail.in'</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""> ...</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">All
those tenancy information is in keystone, not replicated/synced into the COE (or in some other COE specific disjoint system).</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Thoughts?</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">This
one becomes especially hard if said COE(s) don't even have a tenancy model in the first place :-/</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
Thanks,<br class="">
<br class="">
Adrian<br class="">
<br class="">
<blockquote type="cite" class="">On Sep 30, 2015, at 8:58 AM, Devdatta<br class="">
Kulkarni<<a href="mailto:devdatta.kulkarni@RACKSPACE.COM" class="">devdatta.kulkarni@RACKSPACE.COM</a>> wrote:<br class="">
<br class="">
+1 Hongbin.<br class="">
<br class="">
From perspective of Solum, which hopes to use Magnum for its<br class="">
application container scheduling requirements, deep integration of<br class="">
COEs with OpenStack services like Keystone will be useful.<br class="">
Specifically, I am thinking that it will be good if Solum can<br class="">
depend on Keystone tokens to deploy and schedule containers on the<br class="">
Bay nodes instead of having to use COE specific credentials. That<br class="">
way, container resources will become first class components that<br class="">
can be monitored using Ceilometer, access controlled using<br class="">
Keystone, and managed from within Horizon.<br class="">
<br class="">
Regards, Devdatta<br class="">
<br class="">
<br class="">
From: Hongbin Lu<<a href="mailto:hongbin.lu@huawei.com" class="">hongbin.lu@huawei.com</a>> Sent: Wednesday, September<br class="">
30, 2015 9:44 AM To: OpenStack Development Mailing List (not for<br class="">
usage questions) Subject: Re: [openstack-dev] [magnum]swarm +<br class="">
compose = k8s?<br class="">
<br class="">
<br class="">
+1 from me as well.<br class="">
<br class="">
I think what makes Magnum appealing is the promise to provide<br class="">
container-as-a-service. I see coe deployment as a helper to achieve<br class="">
the promise, instead of the main goal.<br class="">
<br class="">
Best regards, Hongbin<br class="">
<br class="">
<br class="">
From: Jay Lau [<a href="mailto:jay.lau.513@gmail.com" class="">mailto:jay.lau.513@gmail.com</a>] Sent: September-29-15<br class="">
10:57 PM To: OpenStack Development Mailing List (not for usage<br class="">
questions) Subject: Re: [openstack-dev] [magnum]swarm + compose =<br class="">
k8s?<br class="">
<br class="">
<br class="">
<br class="">
+1 to Egor, I think that the final goal of Magnum is container as a<br class="">
service but not coe deployment as a service. ;-)<br class="">
<br class="">
Especially we are also working on Magnum UI, the Magnum UI should<br class="">
export some interfaces to enable end user can create container<br class="">
applications but not only coe deployment.<br class="">
<br class="">
I hope that the Magnum can be treated as another "Nova" which is<br class="">
focusing on container service. I know it is difficult to unify all<br class="">
of the concepts in different coe (k8s has pod, service, rc, swarm<br class="">
only has container, nova only has VM, PM with different<br class="">
hypervisors), but this deserve some deep dive and thinking to see<br class="">
how can move forward.....<br class="">
<br class="">
<br class="">
<br class="">
<br class="">
<br class="">
On Wed, Sep 30, 2015 at 1:11 AM, Egor Guz<<a href="mailto:EGuz@walmartlabs.com" class="">EGuz@walmartlabs.com</a>><br class="">
wrote: definitely ;), but the are some thoughts to Tom’s email.<br class="">
<br class="">
I agree that we shouldn't reinvent apis, but I don’t think Magnum<br class="">
should only focus at deployment (I feel we will become another<br class="">
Puppet/Chef/Ansible module if we do it ):) I belive our goal should<br class="">
be seamlessly integrate Kub/Mesos/Swarm to OpenStack ecosystem<br class="">
(Neutron/Cinder/Barbican/etc) even if we need to step in to<br class="">
Kub/Mesos/Swarm communities for that.<br class="">
<br class="">
— Egor<br class="">
<br class="">
From: Adrian<br class="">
Otto<<a href="mailto:adrian.otto@rackspace.com" class="">adrian.otto@rackspace.com</a><<a href="mailto:adrian.otto@rackspace.com" class="">mailto:adrian.otto@rackspace.com</a>>><br class="">
Reply-To: "OpenStack Development Mailing List (not for usage<br class="">
questions)"<<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Date:
Tuesday, September 29, 2015 at 08:44</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">To: "OpenStack Development Mailing List (not for usage<br class="">
questions)"<<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Subject:
Re: [openstack-dev] [magnum]swarm + compose = k8s?</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class=""><br class="">
This is definitely a topic we should cover in Tokyo.<br class="">
<br class="">
On Sep 29, 2015, at 8:28 AM, Daneyon Hansen<br class="">
(danehans)<<a href="mailto:danehans@cisco.com" class="">danehans@cisco.com</a><<a href="mailto:danehans@cisco.com" class="">mailto:danehans@cisco.com</a>>> wrote:<br class="">
<br class="">
<br class="">
+1<br class="">
<br class="">
From: Tom Cammann<<a href="mailto:tom.cammann@hpe.com" class="">tom.cammann@hpe.com</a><<a href="mailto:tom.cammann@hpe.com" class="">mailto:tom.cammann@hpe.com</a>>><br class="">
Reply-To:<br class="">
"<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>"<<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Date:
Tuesday, September 29, 2015 at 2:22 AM</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">To:<br class="">
"<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>"<<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Subject:
Re: [openstack-dev] [magnum]swarm + compose = k8s?</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class=""><br class="">
This has been my thinking in the last couple of months to<br class="">
completely deprecate the COE specific APIs such as pod/service/rc<br class="">
and container.<br class="">
<br class="">
As we now support Mesos, Kubernetes and Docker Swarm its going to<br class="">
be very difficult and probably a wasted effort trying to<br class="">
consolidate their separate APIs under a single Magnum API.<br class="">
<br class="">
I'm starting to see Magnum as COEDaaS - Container Orchestration<br class="">
Engine Deployment as a Service.<br class="">
<br class="">
On 29/09/15 06:30, Ton Ngo wrote: Would it make sense to ask the<br class="">
opposite of Wanghua's question: should pod/service/rc be deprecated<br class="">
if the user can easily get to the k8s api? Even if we want to<br class="">
orchestrate these in a Heat template, the corresponding heat<br class="">
resources can just interface with k8s instead of Magnum. Ton Ngo,<br class="">
<br class="">
<ATT00001.gif>Egor Guz ---09/28/2015 10:20:02 PM---Also I belive<br class="">
docker compose is just command line tool which doesn’t have any api<br class="">
or scheduling feat<br class="">
<br class="">
From: Egor Guz<<a href="mailto:EGuz@walmartlabs.com" class="">EGuz@walmartlabs.com</a>><<a href="mailto:EGuz@walmartlabs.com" class="">mailto:EGuz@walmartlabs.com</a>><br class="">
To:<br class="">
"<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a>"<<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>><br class="">
<<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a>><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Date:
09/28/2015 10:20 PM</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">Subject: Re: [openstack-dev] [magnum]swarm + compose = k8s?<br class="">
________________________________<br class="">
<br class="">
<br class="">
<br class="">
Also I belive docker compose is just command line tool which<br class="">
doesn’t have any api or scheduling features. But during last Docker<br class="">
Conf hackathon PayPal folks implemented docker compose executor for<br class="">
Mesos (<a href="https://github.com/mohitsoni/compose-executor" class="">https://github.com/mohitsoni/compose-executor</a>) which can<br class="">
give you pod like experience.<br class="">
<br class="">
— Egor<br class="">
<br class="">
From: Adrian<br class="">
Otto<<a href="mailto:adrian.otto@rackspace.com" class="">adrian.otto@rackspace.com</a><<a href="mailto:adrian.otto@rackspace.com" class="">mailto:adrian.otto@rackspace.com</a>><<a href="mailto:adrian.otto@rackspace.com" class="">mailto:adrian.otto@rackspace.com</a>>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Reply-To:
"OpenStack Development Mailing List (not for usage questions)"<<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>></span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">Date: Monday, September 28, 2015 at 22:03 To: "OpenStack<br class="">
Development Mailing List (not for usage<br class="">
questions)"<<a href="mailto:openstack-dev@lists.openstack.org" class="">openstack-dev@lists.openstack.org</a><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>><<a href="mailto:openstack-dev@lists.openstack.org" class="">mailto:openstack-dev@lists.openstack.org</a>>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Subject:
Re: [openstack-dev] [magnum]swarm + compose = k8s?</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class=""><br class="">
Wanghua,<br class="">
<br class="">
I do follow your logic, but docker-compose only needs the docker<br class="">
API to operate. We are intentionally avoiding re-inventing the<br class="">
wheel. Our goal is not to replace docker swarm (or other existing<br class="">
systems), but to compliment it/them. We want to offer users of<br class="">
Docker the richness of native APIs and supporting tools. This way<br class="">
they will not need to compromise features or wait longer for us to<br class="">
implement each new feature as it is added. Keep in mind that our<br class="">
pod, service, and replication controller resources pre-date this<br class="">
philosophy. If we started out with the current approach, those<br class="">
would not exist in Magnum.<br class="">
<br class="">
Thanks,<br class="">
<br class="">
Adrian<br class="">
<br class="">
On Sep 28, 2015, at 8:32 PM, 王华<br class="">
<<a href="mailto:wanghua.humble@gmail.com" class="">wanghua.humble@gmail.com</a><<a href="mailto:wanghua.humble@gmail.com" class="">mailto:wanghua.humble@gmail.com</a>><<a href="mailto:wanghua.humble@gmail.com" class="">mailto:wanghua.humble@gmail.com</a>>><br class="">
wrote:<br class="">
<br class="">
Hi folks,<br class="">
<br class="">
Magnum now exposes service, pod, etc to users in kubernetes coe,<br class="">
but exposes container in swarm coe. As I know, swarm is only a<br class="">
scheduler of container, which is like nova in openstack. Docker<br class="">
compose is a orchestration program which is like heat in openstack.<br class="">
k8s is the combination of scheduler and orchestration. So I think<br class="">
it is better to expose the apis in compose to users which are at<br class="">
the same level as k8s.<br class="">
<br class="">
<br class="">
Regards Wanghua<br class="">
__________________________________________________________________________<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OpenStack
Development Mailing List (not for usage questions)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">Unsubscribe:<br class="">
<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a><<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">mailto:OpenStack-dev-request@lists.openstack.org</a>><<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">mailto:OpenStack-dev-request@lists.openstack.org</a>>?subject:unsubscribe<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a></span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">__________________________________________________________________________<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OpenStack
Development Mailing List (not for usage questions)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">Unsubscribe:<br class="">
<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<<a href="mailto:OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" class="">mailto:OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a>><br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a></span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class=""><br class="">
<br class="">
<br class="">
<br class="">
<br class="">
__________________________________________________________________________<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OpenStack
Development Mailing List (not for usage questions)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">Unsubscribe:<br class="">
<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<<a href="mailto:OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" class="">mailto:OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a>><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br class="">
<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""><ATT00001.gif>__________________________________________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">OpenStack Development Mailing List (not for usage questions)<br class="">
<br class="">
<br class="">
Unsubscribe:<br class="">
<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a><<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">mailto:OpenStack-dev-request@lists.openstack.org</a>>?subject:unsubscribe<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a></span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class=""><br class="">
__________________________________________________________________________<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OpenStack
Development Mailing List (not for usage questions)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">Unsubscribe:<br class="">
<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br class="">
<br class="">
<br class="">
<br class="">
--<br class="">
<br class="">
<br class="">
<br class="">
<br class="">
<br class="">
Thanks, Jay Lau (Guangya Liu)<br class="">
<br class="">
__________________________________________________________________________<br class="">
<br class="">
<br class="">
</blockquote>
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OpenStack
Development Mailing List (not for usage questions)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" class="">Unsubscribe:<br class="">
<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br class="">
</blockquote>
<br class="">
__________________________________________________________________________<br class="">
<br class="">
<br class="">
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OpenStack
Development Mailing List (not for usage questions)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
Unsubscribe:<br class="">
<a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br class="">
</blockquote>
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">__________________________________________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OpenStack
Development Mailing List (not for usage questions)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Unsubscribe:<span class="Apple-converted-space"> </span></span><a href="mailto:OpenStack-dev-request@lists.openstack.org" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">OpenStack-dev-request@lists.openstack.org</a><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">?subject:unsubscribe</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a></div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>