<div dir="auto">XEN doesn't work well with nested kvm. We need to change nova config to pure qemu without kvm. I thought we did that in gates? </div><div class="gmail_extra"><br><div class="gmail_quote">On Jan 2, 2017 2:25 PM, "Clark Boylan" <<a href="mailto:cboylan@sapwetik.org">cboylan@sapwetik.org</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Sun, Jan 1, 2017, at 09:13 PM, Jeffrey Zhang wrote:<br>
> Checked more failed gate, here is the more info:<br>
><br>
> 1. only rax-iad has such issue<br>
> 2. the failed and successful gates have the same rpm installed.<br>
><br>
> So the only difference between failed gate and successful gate is the xen<br>
> hypervisor.<br>
<br>
I don't have any answers but my first thought was maybe it is related to<br>
<a href="https://bugs.launchpad.net/nova/+bug/1643911" rel="noreferrer" target="_blank">https://bugs.launchpad.net/<wbr>nova/+bug/1643911</a>; however, that affects<br>
libvirt 1.3.1 on Ubuntu Xenial and there is at least one instance of<br>
that occurring on a non Xen hypervisor so maybe they are not related.<br>
<br>
Also noticed that you appear to have two redundant sets of system logs<br>
in the Kolla centos job(s). See<br>
<a href="http://logs.openstack.org/80/415880/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/d94c349/logs/system_log/" rel="noreferrer" target="_blank">http://logs.openstack.org/80/<wbr>415880/1/check/gate-kolla-<wbr>dsvm-deploy-centos-binary-<wbr>centos-7-nv/d94c349/logs/<wbr>system_log/</a><br>
and<br>
<a href="http://logs.openstack.org/80/415880/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/d94c349/logs/system_logs/" rel="noreferrer" target="_blank">http://logs.openstack.org/80/<wbr>415880/1/check/gate-kolla-<wbr>dsvm-deploy-centos-binary-<wbr>centos-7-nv/d94c349/logs/<wbr>system_logs/</a>.<br>
<br>
As for debugging this you may be able to install libvirt's debugging<br>
symbols<br>
(<a href="http://debuginfo.centos.org/7/x86_64/libvirt-debuginfo-2.0.0-10.el7.x86_64.rpm" rel="noreferrer" target="_blank">http://debuginfo.centos.org/<wbr>7/x86_64/libvirt-debuginfo-2.<wbr>0.0-10.el7.x86_64.rpm</a>),<br>
capture a core dump, load into gdb and go from there.<br>
<br>
Clark<br>
<br>
______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.<wbr>openstack.org?subject:<wbr>unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack-dev</a><br>
</blockquote></div></div>