[openstack-dev] [Openstack-sigs][self-healing][heat][vitrage][mistral] Self-Healing with Vitrage, Heat, and Mistral

Rico Lin rico.lin.guanyu at gmail.com
Tue Jul 3 06:14:13 UTC 2018

Dear all

Back to Vancouver Summit, Ifat brings out the idea of integrating Heat,
Vitrage, and Mistral to bring better self-healing scenario.
For previous works, There already works cross Heat, Mistral, and Zaqar for
self-healing [1].
And there is works cross Vitrage, and Mistral [2].
Now we plan to start working on integrating two works (as much as it
can/should be) and to make sure the scenario works and keep it working.
The integrated scenario flow will look something like this:
An existing monitor detect host/network failure and send an alarm to
Vitrage -> Vitrage deduces that the instance is down (based on the topology
and based on Vitrage templates [2]) -> Vitrage triggers Mistral to fix the
instance -> application is recovered
We created an Etherpad [3] to document all discussion/feedbacks/plans (and
will add more detail through time)
Also, create a story in self-healing SIG to track all task.

The current plans are:

   - A spec for Vitrage resources in Heat [5]
   - Create Vitrage resources in Heat
   - Write Heat Template and Vitrage Template for this scenario
   - A tempest task for above scenario
   - Add periodic job for this scenario (with above task). The best place
   to host this job (IMO) is under self-healing SIG

To create a periodic job for self-healing sig means we might also need a
place to manage those self-healing tempest test. For this scenario, I think
it will make sense if we use heat-tempest-plugin to store that scenario
test (since it will wrap as a Heat template) or use vitrage-tempest-plugin
(since most of the test scenario are actually already there).
Not sure what will happen if we create a new tempest plugin for
self-healing and no manager for it.
We still got some uncertainty to clear during working on it, but the big
picture looks like all will works(if we doing all well on above tasks).
Please provide your feedback or question if you have any.
We do needs feedbacks and reviews on patches or any works.
If you're interested in this, please join us (we need users/ops/devs!).

[1] https://github.com/openstack/heat-templates/tree/master/hot/autohealing
[3] https://etherpad.openstack.org/p/self-healing-with-vitrage-mistral-heat
[4] https://storyboard.openstack.org/#!/story/2002684
[5] https://review.openstack.org/#/c/578786

May The Force of OpenStack Be With You,

*Rico Lin*irc: ricolin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20180703/60d21bfc/attachment.html>

More information about the OpenStack-dev mailing list