<div dir="ltr">Let's wait more opinions ;) I don;t think that we know everything. </div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr">Regards,<div>Sergey.</div></div></div></div>
<br><div class="gmail_quote">On 17 April 2015 at 18:10, <span dir="ltr"><<a href="mailto:ashish.jain14@wipro.com" target="_blank">ashish.jain14@wipro.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>So ultimately this means there is no way to autoscale docker containers on openstack until and unless ceilometer adds an inspector for docker hypervisor something similar to this (<a href="https://github.com/openstack/ceilometer/tree/master/ceilometer/compute/virt" target="_blank">https://github.com/openstack/ceilometer/tree/master/ceilometer/compute/virt</a>).<br>
</p>
<p><br>
</p>
<p>Regards</p>
<p>Ashish<br>
</p>
<div style="color:rgb(33,33,33)">
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Sergey Kraynev <<a href="mailto:skraynev@mirantis.com" target="_blank">skraynev@mirantis.com</a>><br>
<b>Sent:</b> Friday, April 17, 2015 8:12 PM<div><div class="h5"><br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Subject:</b> Re: [openstack-dev] [nova-docker][ceilometer][heat] Autoscaling docker in openstack</div></div></font>
<div> </div>
</div><div><div class="h5">
<div>
<div dir="ltr">
<div class="gmail_extra">@VACHNIS: yeah. in this case we blocked by ceilometer. AFAIK, ceilometer collect metrics from Nova:Server, not from docker directly. <br>
</div>
<div class="gmail_extra">So mentioned bp is make sense (add support for this feature to ceilomete, then to heat).</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">Regards,</div>
<div class="gmail_extra">Sergey.</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On 17 April 2015 at 17:11, VACHNIS, AVI (AVI) <span dir="ltr">
<<a href="mailto:avi.vachnis@alcatel-lucent.com" target="_blank">avi.vachnis@alcatel-lucent.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div>
<div style="font-size:10pt">
<p style="margin-top:0px;margin-bottom:0px">Hi,</p>
<p style="margin-top:0px;margin-bottom:0px">@Ashish, if the limitation you've mentioned for #1 still exists, I join your question how heat auto-scale-group may work w/o ceilometer being able to collect docker metrics?</p>
</div>
</div>
</blockquote>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div>
<div style="font-size:10pt">
<p style="margin-top:0px;margin-bottom:0px"> </p>
<p style="margin-top:0px;margin-bottom:0px">@Sergey, hey. Are you saying that ceilometer do collects metrics on docker underlying nova::server resource?</p>
</div>
</div>
</blockquote>
<div><br>
</div>
<div><br>
</div>
<div> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div>
<div style="font-size:10pt">
<p style="margin-top:0px;margin-bottom:0px"> </p>
<div>
<div>
<p style="margin-top:0px;margin-bottom:0px">-Avi</p>
</div>
</div>
<p style="margin-top:0px;margin-bottom:0px"> </p>
<p style="margin-top:0px;margin-bottom:0px">------ Original message------</p>
<p style="margin-top:0px;margin-bottom:0px"><b>From: </b><a href="mailto:ashish.jain14@wipro.com" target="_blank">ashish.jain14@wipro.com</a></p>
<p style="margin-top:0px;margin-bottom:0px"><b>Date: </b>Fri, Apr 17, 2015 4:56 PM</p>
<p style="margin-top:0px;margin-bottom:0px"><b>To: </b><a href="mailto:openstack-dev@lists.openstack.org" target="_blank">openstack-dev@lists.openstack.org</a>;</p>
<div>
<div>
<p style="margin-top:0px;margin-bottom:0px"><b>Subject:</b>Re: [openstack-dev] [nova-docker][ceilometer][heat] Autoscaling docker in openstack</p>
<p style="margin-top:0px;margin-bottom:0px"> </p>
</div>
</div>
</div>
<div>
<div><u></u>
<div style="font-size:12pt;color:rgb(0,0,0);font-family:Calibri,Arial,Helvetica,sans-serif;background-color:rgb(255,255,255)">
<p>Hi Segey,</p>
<p><br>
</p>
<p>So IIUC approach #2 may still help to autoscale docker on openstack. I will try that out and post questions on heat irc thanks.</p>
<p><br>
</p>
<p>Regards</p>
<p>Ashish<br>
</p>
<div style="color:rgb(33,33,33)">
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Sergey Kraynev <<a href="mailto:skraynev@mirantis.com" target="_blank">skraynev@mirantis.com</a>><br>
<b>Sent:</b> Friday, April 17, 2015 7:01 PM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Subject:</b> Re: [openstack-dev] [nova-docker][ceilometer][heat] Autoscaling docker in openstack</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div class="gmail_extra">Hi, Ashish.</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">Honestly I am not familiar with most part of these ways, but can add more information from Heat side (item 2).</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">I am surprised, that you have missed Heat autoscaling mechanism (You should look it :) ). It's one of the important part of Heat project.</div>
<div class="gmail_extra">It allows to scale vms/stacks by using Ceilometer alarms. There are couple examples of autoscale templates:</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra"><a href="https://github.com/openstack/heat-templates/blob/master/hot/autoscaling.yaml" target="_blank">https://github.com/openstack/heat-templates/blob/master/hot/autoscaling.yaml</a> (with LoadBalancer)</div>
<div class="gmail_extra"><a href="https://github.com/openstack/heat-templates/blob/master/hot/asg_of_servers.yaml" target="_blank">https://github.com/openstack/heat-templates/blob/master/hot/asg_of_servers.yaml<br>
</a></div>
<div class="gmail_extra"><a href="https://github.com/openstack/heat-templates/blob/master/hot/asg_of_servers.yaml" target="_blank">https://github.com/openstack/heat-templates/blob/master/hot/asg_of_stacks.yaml<br>
</a></div>
<div class="gmail_extra"><a href="https://github.com/openstack/heat-templates/blob/master/hot/asg_of_servers.yaml" target="_blank"><br>
</a></div>
<div class="gmail_extra">It's true, that Docker plugin for Heat create docker server on Nova::Server resource. So you may write template Docker resource + Server resource (similar on third template) and scale by using Ceilometer alarms.</div>
<div class="gmail_extra">If you have any questions how to use it, please got to #heat irc channel and ask us :)</div>
<div class="gmail_extra">Also another way (AFAIK) is to use SoftwareDeployment/Config and deploy Server with docker inside (without docker plugin). In this way, I suppose, Steve Baker can help with advise :)</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On 17 April 2015 at 16:06, <span dir="ltr"><<a href="mailto:ashish.jain14@wipro.com" target="_blank">ashish.jain14@wipro.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>
Hi,<br>
<br>
I have been working on running docker on openstack. I had a discussion on multiple IRC and IIUC there are 5 different ways of running docker on openstack. IIUC currently there is no way to autoscale docker on openstack. Please correct me if I am wrong<br>
<br>
<br>
1) Using nova-docker driver - Running docker as a Nova::Server using nova-docker hypervisor<br>
2) Using nova-plugin for heat - Running docker using DockerInc::Docker::Container<br>
3) Using magnum - IIUC no automation as of now, manually it is possible. Not enough documentation available<br>
4) heat compose - Saw some samples available @<a href="https://github.com/openstack/heat-templates/tree/master/hot/software-config/elements/heat-config-docker-compose" target="_blank">https://github.com/openstack/heat-templates/tree/master/hot/software-config/elements/heat-config-docker-compose</a><br>
5) Swarm support - Still in development<br>
<br>
Issues with each on the above approaches<br>
<br>
1) Using nova-docker driver - IIUC there is no way for ceilometer to collect and emit statistics for docker hypervisor. So that mean ceilometer does not have any stats available once you switch to docker driver.<br>
This link (<a href="https://github.com/openstack/ceilometer/tree/master/ceilometer/compute/virt" target="_blank">https://github.com/openstack/ceilometer/tree/master/ceilometer/compute/virt</a>) currently does not have anything for docker hypervisor.<br>
<br>
2) Using nova-plugin for heat - Using this approach docker containers run on a Nova VM. However I do not see any illustration which suggests that you can autoscale using this approach.<br>
<br>
3) Using magnum - Currently only possible by manually invoking it.<br>
<br>
4) heat compose - Sample available at the above link just talks about deploying it up but nothing about auto scaling<br>
<br>
5) Swarm Support - Still in dev<br>
<br>
While I understand some of these options may enable us during the future release to autoscale docker on openstack. But looking currently I feel option #1 is most mature(probably) and by plugging in a ceilometer inspector for docker hypervisor it may be possible.
Another approach could be to using cfn-push-stats to probably push some stats from docker container.<br>
<br>
Please advice through your valued suggestions that time being what is the best way to achieve auto scaling for docker on openstack. I am ready to contribute to it in the best possible way.<br>
<br>
Regards<br>
Ashish<br>
<br>
<br>
<br>
<br>
<br>
<br>
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should
not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments
for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. <a href="http://www.wipro.com" target="_blank">www.wipro.com</a><br>
<br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</div>
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should
not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments
for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.
<a href="http://www.wipro.com" target="_blank">www.wipro.com</a> <u></u></div>
</div>
</div>
<br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div></div></div>
</div><div><div class="h5">
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should
not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments
for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. <a href="http://www.wipro.com" target="_blank">www.wipro.com</a>
</div></div></div>
<br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>