<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Title" content="">
<meta name="Keywords" content="">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:Calibri;
color:windowtext;}
span.msoIns
{mso-style-type:export-only;
mso-style-name:"";
text-decoration:underline;
color:teal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">I think optimally we should check if we are running in rax-iad, and if so, set libvirt virtualization to qemu. I was pretty sure the gate script that sets up the system sets the libvirt
type to qemu. After inspection of the gate scripts, this is not the case. Perhaps it was setup this way previously and someone changed it.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">This explains why rax gates have been so flakey for a very long time when running the deploy jobs.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">-steve<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<blockquote style="border:none;border-left:solid #B5C4DF 4.5pt;padding:0in 0in 0in 4.0pt;margin-left:3.75pt;margin-right:0in">
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-family:Calibri;color:black">From: </span>
</b><span style="font-family:Calibri;color:black">Michał Jastrzębski <inc007@gmail.com><br>
<b>Reply-To: </b>"OpenStack Development Mailing List (not for usage questions)" <openstack-dev@lists.openstack.org><br>
<b>Date: </b>Monday, January 2, 2017 at 3:37 PM<br>
<b>To: </b>"OpenStack Development Mailing List (not for usage questions)" <openstack-dev@lists.openstack.org><br>
<b>Subject: </b>Re: [openstack-dev] [kolla][rdo] libvirt 2.0 process is failed during launching qemu progress<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">XEN doesn't work well with nested kvm. We need to change nova config to pure qemu without kvm. I thought we did that in gates? <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Jan 2, 2017 2:25 PM, "Clark Boylan" <<a href="mailto:cboylan@sapwetik.org">cboylan@sapwetik.org</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal">On Sun, Jan 1, 2017, at 09:13 PM, Jeffrey Zhang wrote:<br>
> Checked more failed gate, here is the more info:<br>
><br>
> 1. only rax-iad has such issue<br>
> 2. the failed and successful gates have the same rpm installed.<br>
><br>
> So the only difference between failed gate and successful gate is the xen<br>
> hypervisor.<br>
<br>
I don't have any answers but my first thought was maybe it is related to<br>
<a href="https://bugs.launchpad.net/nova/+bug/1643911" target="_blank">https://bugs.launchpad.net/nova/+bug/1643911</a>; however, that affects<br>
libvirt 1.3.1 on Ubuntu Xenial and there is at least one instance of<br>
that occurring on a non Xen hypervisor so maybe they are not related.<br>
<br>
Also noticed that you appear to have two redundant sets of system logs<br>
in the Kolla centos job(s). See<br>
<a href="http://logs.openstack.org/80/415880/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/d94c349/logs/system_log/" target="_blank">http://logs.openstack.org/80/415880/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/d94c349/logs/system_log/</a><br>
and<br>
<a href="http://logs.openstack.org/80/415880/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/d94c349/logs/system_logs/" target="_blank">http://logs.openstack.org/80/415880/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/d94c349/logs/system_logs/</a>.<br>
<br>
As for debugging this you may be able to install libvirt's debugging<br>
symbols<br>
(<a href="http://debuginfo.centos.org/7/x86_64/libvirt-debuginfo-2.0.0-10.el7.x86_64.rpm" target="_blank">http://debuginfo.centos.org/7/x86_64/libvirt-debuginfo-2.0.0-10.el7.x86_64.rpm</a>),<br>
capture a core dump, load into gdb and go from there.<br>
<br>
Clark<br>
<br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><o:p></o:p></p>
</blockquote>
</div>
</div>
</blockquote>
</div>
</body>
</html>