<div dir="ltr"><div dir="ltr">Hi,<br><br><div class="gmail_quote"><div dir="ltr">On Wed, Oct 31, 2018 at 11:00 AM Won <<a href="mailto:wjstk16@gmail.com">wjstk16@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-im" style="color:rgb(80,0,80)">Hi,<br></span><div><div class="gmail_quote"><span class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-im"><span class="gmail-m_-3730029957097522148gmail-im" style="color:rgb(80,0,80)"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><br></div><div dir="ltr"><div style="color:rgb(34,34,34)">This is strange. I would expect your original definition to work as well, since the alarm key in Vitrage is defined by a combination of the alert name and the instance. We will check it again. </div><div style="color:rgb(34,34,34)">BTW, we solved a different bug related to Prometheus alarms not being cleared [1]. Could it be related?</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></blockquote><div><br></div></span><div style="color:rgb(80,0,80)">Using the original definition, no matter how different the instances are, the alarm names are recognized as the same alarm in vitrage.</div><div><font color="#500050">And I tried to install the rocky version and the master version on the new server and retest but the problem was not solved. The latest bugfix seems irrelevant.</font></div></span></div></div></div></blockquote><div><br></div><div>Ok. We will check this issue. For now your workaround is ok, right?</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div class="gmail_quote"><span class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-im"><span class="gmail-m_-3730029957097522148gmail-im" style="color:rgb(80,0,80)"><div></div><div><div class="gmail_quote"><span class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-im"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><span style="color:rgb(34,34,34)">Does the wrong timestamp appear if you run 'vitrage alarm list' cli command? please try running 'vitrage alarm list --debug' and send me the output.</span> <br></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></blockquote><br class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-Apple-interchange-newline"></span></div></div></span><div><font color="#500050">I have attached 'vitrage-alarm-list.txt.'<br></font></div></span></div></div></div></blockquote><div><br></div><div>I believe that you attached the wrong file. It seems like another log of vitrage-graph.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div class="gmail_quote"><span class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-im"><div><font color="#500050"></font></div><div><span class="gmail-m_-3730029957097522148gmail-im" style="color:rgb(80,0,80)"><div><div class="gmail_quote"><span class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-im"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div style="color:rgb(34,34,34)">Please send me vitrage-collector.log and vitrage-graph.log from the time that the problematic vm was created and deleted. Please also create and delete a vm on your 'ubuntu' server, so I can check the differences in the log.</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></blockquote><br class="gmail-m_-3730029957097522148gmail-m_-4965425863663943524gmail-Apple-interchange-newline"></span></div></div></span><div>I have attached 'vitrage_log_on_compute1.zip' and 'vitrage_log_on_ubuntu.zip' files. </div><div>When creating a vm on computer1, a vitrage-collect log occurred, but no log occurred when it was removed.<br></div><div></div></div></span></div></div></div></blockquote><div> </div><div>Looking at the logs, I see two issues:</div><div>1. On ubuntu server, you get a notification about the vm deletion, while on compute1 you don't get it. </div><div>Please make sure that Nova sends notifications to 'vitrage_notifications' - it should be configured in /etc/nova/nova.conf.</div><div><br></div><div>2. Once in 10 minutes (by default) nova.instance datasource queries all instances. The deleted vm is supposed to be deleted in Vitrage at this stage, even if the notification was lost. </div><div>Please check in your collector log for the a message of "<span style="font-family:Calibri;font-size:11pt">novaclient.v2.client
[-] RESP BODY</span>" before and after the deletion, and send me its content. </div>
<div><br></div><div>Br,</div><div>Ifat</div><div><br></div><div><br></div></div></div></div>