[openstack-dev] [nova] top gate bug is libvirt snapshot

Sean Dague sean at dague.net
Wed Jul 9 22:23:27 UTC 2014


The libvirt logs needed are huge, so we can't run them all the time. And
realistically, I don't think they provided us the info we needed. There
has been at least one fail on Dan's log hack patch for this scenario
today, so maybe it will be in there.

On 07/09/2014 05:44 PM, Michael Still wrote:
> Can we get our gate images tweaked to have more verbose libvirt
> logging on in general? There's been a few times in the last year or so
> when we've really needed it.
> 
> Michael
> 
> On Wed, Jul 9, 2014 at 6:01 PM, Daniel P. Berrange <berrange at redhat.com> wrote:
>> On Wed, Jul 09, 2014 at 08:58:02AM +1000, Michael Still wrote:
>>> On Wed, Jul 9, 2014 at 8:21 AM, Sean Dague <sean at dague.net> wrote:
>>>
>>>> This is also why I find it unlikely to be a qemu bug, because that's not
>>>> shared state between guests. If qemu just randomly wedges itself, that
>>>> would be detectable much easier outside of the gate. And there have been
>>>> attempts by danpb to sniff that out, and they haven't worked.
>>>
>>> Do you think it would help if we added logging of what eventlet
>>> threads are running at the time of a failure like this? I can see that
>>> it might be a bit noisey, but it might also help nail down what this
>>> is an interaction between.
>>
>> I don't think so. What I really need is more verbose libvirtd daemon
>> logs when a time when it fails. I've done a gross hack with a review
>> I have posted [1] which munges rootwrap to allow me to reconfigure
>> libvirtd and capture logs. Unfortunately I've been unable to get it
>> to fail on the snapshot bug since then - it is always hitting other
>> bugs so far :-(
>>
>> Regards,
>> Daniel
>>
>> [1] https://review.openstack.org/#/c/103066/
>> --
>> |: http://berrange.com      -o-    http://www.flickr.com/photos/dberrange/ :|
>> |: http://libvirt.org              -o-             http://virt-manager.org :|
>> |: http://autobuild.org       -o-         http://search.cpan.org/~danberr/ :|
>> |: http://entangle-photo.org       -o-       http://live.gnome.org/gtk-vnc :|
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
> 
> 


-- 
Sean Dague
http://dague.net

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 482 bytes
Desc: OpenPGP digital signature
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140709/f2235627/attachment.pgp>


More information about the OpenStack-dev mailing list