<div dir="ltr">Hi Konglingxian<div><br></div><div>1. evacuate</div><div> - Nova user request for evacuate operation manually.</div><div> - Evacuate call rebuild method in compute</div><div><br></div><div>2. auto-ha</div><div>
- All operation is doing automatically.</div><div> - Only role of administrator is register auto-ha-hosts, fixing broken host, restoring migrated vm.</div><div> - auto-ha call stop-start method.( start method is modified for scheduling when start method is called. <a href="https://wiki.openstack.org/wiki/Start">https://wiki.openstack.org/wiki/Start</a> )</div>
<div><br></div><div><br></div><div>Important thing is Operation level.</div><div><br></div><div>If one fo compute nodes is broken, it cannot receive any rpc call and operate any action.</div><div><br></div><div>We need auto operation model when compute node broken occurs because administrators cannot monitors services always.<br>
</div><div><br></div><div>I wonder this is enough answer. If you don't understand, please ask me.</div><div><br></div><div>Thanks.</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br>
</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/8/14 Konglingxian <span dir="ltr"><<a href="mailto:konglingxian@huawei.com" target="_blank">konglingxian@huawei.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="ZH-CN" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#1f497d">Hi yongiman:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#1f497d">I wander what’s the difference between your ‘auto HA’ API and ‘evacuate’<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="EN-US" style="font-family:"\005fae\008f6f\0096c5\009ed1","sans-serif"">------------------------------------------------------------<u></u><u></u></span></b></p>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="EN-US" style="font-size:10.5pt;font-family:"\005fae\008f6f\0096c5\009ed1","sans-serif";color:#00b0f0">Lingxian Kong<u></u><u></u></span></b></p>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="EN-US" style="font-size:10.5pt;font-family:"\005fae\008f6f\0096c5\009ed1","sans-serif";color:red">Huawei Technologies Co.,LTD.<u></u><u></u></span></b></p>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="EN-US" style="font-size:9.0pt;font-family:"\005fae\008f6f\0096c5\009ed1","sans-serif";color:#1f497d">IT Product Line CloudOS PDU<u></u><u></u></span></b></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><b><span lang="EN-US" style="font-size:9.0pt;font-family:"\005fae\008f6f\0096c5\009ed1","sans-serif";color:#1f497d">China, Xi'an<u></u><u></u></span></b></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><b><span lang="EN-US" style="font-size:9.0pt;font-family:"\005fae\008f6f\0096c5\009ed1","sans-serif";color:#1f497d">Mobile: +86-18602962792<u></u><u></u></span></b></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><b><span lang="EN-US" style="font-size:9.0pt;font-family:"\005fae\008f6f\0096c5\009ed1","sans-serif";color:#1f497d">Email: <a href="mailto:konglingxian@huawei.com" target="_blank">konglingxian@huawei.com</a></span></b><b><span lang="EN-US" style="font-size:9.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u><u></u></span></b></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> <a href="mailto:yongiman@gmail.com" target="_blank">yongiman@gmail.com</a> [mailto:<a href="mailto:yongiman@gmail.com" target="_blank">yongiman@gmail.com</a>]
<br>
<b>Sent:</b> Tuesday, August 13, 2013 9:12 PM</span></p><div class="im"><br>
<b>To:</b> OpenStack Development Mailing List<br>
</div><b>Cc:</b> OpenStack Development Mailing List<br>
<b>Subject:</b> Re: [openstack-dev] <span style="font-size:10.0pt">答复</span><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">: Proposal for approving Auto HA development blueprint.<u></u><u></u></span><p>
</p>
</div>
</div><div><div class="h5">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">For realizing auto HA function, we need monitoring service like ceilometer.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Ceilometer monitors status of compute nodes ( network interface..connection, healthcheck,,etc,,)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">What I focus on is that this operation goes on automatically.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Nova expose auto ha API. When nova received a auto api call. VMs automatically migrate to auto ha host.( which is extra compute node for only auto ha)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">All of information of auto ha is stored in auto_ha_hosts table.<br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">In this tables, used column of auto ha hosts is changed to true<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Administrator check broken compute node and fix( or replace ) the compute node.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">After fixing the compute node, VMs is migrating to operating compute nodes. Now auto ha host is empty again.<br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">When the number of runnning VMs in the auto ha host is zero, used column is replaced to false for using again by periodic task.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Combination with monitoring service is important. Howerver in this blueprint, I want to realize nova's auto ha operation.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">My wiki page is still building now, I will fill out as soon as possbile.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">I am expecting your advices . Thank you very much~!<u></u><u></u></span></p>
</div>
<p style="margin-right:0cm;margin-bottom:8.4pt;margin-left:0cm">
<span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US"><br>
Sent from my iPad<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><br>
On 2013. 8. 13., at </span><span style="font-family:"Batang","serif"">오후</span><span lang="EN-US"> 8:01, balaji patnala <<a href="mailto:patnala003@gmail.com" target="_blank">patnala003@gmail.com</a>> wrote:<u></u><u></u></span></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US">Potential candidate as new service like Ceilometer, Heat etc for OpenStack and provide High Availability of VMs. Good topic to discuss at Summit for implementation post Havana Release. <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Tue, Aug 13, 2013 at 12:03 PM, Alex Glikson <<a href="mailto:GLIKSON@il.ibm.com" target="_blank">GLIKSON@il.ibm.com</a>> wrote:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Arial","sans-serif"">Agree. Some enhancements to Nova might be still required (e.g., to handle resource reservations, so that there is enough capacity), but the end-to-end framework probably should
be outside of existing services, probably talking to Nova, Ceilometer and potentially other components (maybe Cinder, Neutron, Ironic), and 'orchestrating' failure detection, fencing and recovery.</span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Arial","sans-serif"">Probably worth a discussion at the upcoming summit.</span><span lang="EN-US">
<br>
<br>
<br>
</span><span lang="EN-US" style="font-family:"Arial","sans-serif"">Regards,</span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Arial","sans-serif"">Alex</span><span lang="EN-US">
<br>
<br>
<br>
<br>
</span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif";color:#5f5f5f">From: </span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif"">Konglingxian <<a href="mailto:konglingxian@huawei.com" target="_blank">konglingxian@huawei.com</a>></span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif";color:#5f5f5f">To: </span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif"">OpenStack Development Mailing List <<a href="mailto:openstack-dev@lists.openstack.org" target="_blank">openstack-dev@lists.openstack.org</a>>,
</span><span lang="EN-US"><br>
</span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif";color:#5f5f5f">Date: </span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif"">13/08/2013 07:07 AM</span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif";color:#5f5f5f">Subject: </span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif"">[openstack-dev]
</span><span style="font-size:7.5pt">答复</span><span lang="EN-US" style="font-size:7.5pt;font-family:"Arial","sans-serif"">: Proposal for approving Auto HA development blueprint.</span><span lang="EN-US">
<u></u><u></u></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span lang="EN-US">
<hr size="2" width="100%" noshade style="color:#a0a0a0" align="center">
</span></div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080">Hi yongiman:</span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080"> </span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080">Your idea is good, but I think the auto HA operation is not OpenStack’s business. IMO, Ceilometer offers ‘monitoring’, Nova offers ‘evacuation’, and you can combine them to
realize HA operation.</span><span lang="EN-US"> <br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080"> </span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080">So, I’m afraid I can’t understand the specific implementation details very well.</span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080"> </span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080">Any different opinions?</span><span lang="EN-US">
<br>
</span><span lang="EN-US" style="font-family:"Calibri","sans-serif";color:#004080"> </span><span lang="EN-US">
<br>
</span><b>发件人<span lang="EN-US">:</span></b><span lang="EN-US"> <a href="mailto:yongiman@gmail.com" target="_blank">
yongiman@gmail.com</a> [<a href="mailto:yongiman@gmail.com" target="_blank">mailto:yongiman@gmail.com</a>]
<b><br>
</b></span><b>发送时间<span lang="EN-US">:</span></b><span lang="EN-US"> 2013</span>年<span lang="EN-US">8</span>月<span lang="EN-US">12</span>日<span lang="EN-US"> 20:52<b><br>
</b></span><b>收件人<span lang="EN-US">:</span></b><span lang="EN-US"> <a href="mailto:openstack-dev@lists.openstack.org" target="_blank">
openstack-dev@lists.openstack.org</a><b><br>
</b></span><b>主题<span lang="EN-US">:</span></b><span lang="EN-US"> Re: [openstack-dev] Proposal for approving Auto HA development blueprint.
<br>
<br>
<br>
<br>
Hi, <br>
<br>
Now, I am developing auto ha operation for vm high availability. <br>
<br>
This function is all progress automatically. <br>
<br>
It needs other service like ceilometer. <br>
<br>
ceilometer monitors compute nodes. <br>
<br>
When ceilometer detects broken compute node, it send a api call to Nova, <br>
nova exposes for auto ha API. <br>
<br>
When received auto ha call, nova progress auto ha operation. <br>
<br>
All auto ha enabled VM where are running on broken host are all migrated to auto ha Host which is extra compute node for using only Auto-HA function.
<br>
<br>
Below is my blueprint and wiki page. <br>
<br>
Wiki page is not yet completed. Now I am adding lots of information for this function.
<br>
<br>
Thanks <br>
<br>
<a href="https://blueprints.launchpad.net/nova/+spec/vm-auto-ha-when-host-broken" target="_blank">https://blueprints.launchpad.net/nova/+spec/vm-auto-ha-when-host-broken</a>
<br>
<u></u><u></u></span></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><a href="https://wiki.openstack.org/wiki/Autoha" target="_blank">https://wiki.openstack.org/wiki/Autoha</a><tt>_______________________________________________</tt><br>
<tt>OpenStack-dev mailing list</tt><br>
<tt><a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a></tt><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank"><tt>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</tt></a><br>
<br>
<br>
_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><u></u><u></u></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span lang="EN-US">_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><u></u><u></u></span></p>
</div>
</blockquote>
</div></div></div>
</div>
</div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>