[openstack-dev] [nova][neutron][upgrade] Grenade multinode partial upgrade

Sean Dague sean at dague.net
Fri Dec 4 18:15:07 UTC 2015


On 12/04/2015 12:43 PM, Sean M. Collins wrote:
> On Mon, Nov 30, 2015 at 07:00:07AM EST, Sean Dague wrote:
>> On 11/25/2015 11:42 AM, Sean M. Collins wrote:
>>> The first run for the multinode grenade job completed.
>>>
>>> http://logs.openstack.org/35/187235/11/experimental/gate-grenade-dsvm-neutron-multinode/011124b/logs/
>>>
>>> I'm still getting my bearings in the grenade log output, but if I
>>> understand it correctly, after upgrading Neutron, when spawning a new
>>> instance we do not get successful connectivity. The odd part is we see
>>> the failure twice. Once when upgrading Nova[1], then once when upgrading
>>> Cinder[2]. I would have thought Grenade would have exited after just
>>> failing the first time. It did do a call to worlddump.
>>
>> We're calling worlddump a bunch of times in grenade during success
>> operations to try to help track down why connectivity sometimes goes
>> away when we don't do any actions which we think should affect it. The
>> Nova operation succeeded, there is a successful ping at the end of it.
>>
>> Cinder pinged, but also does ssh verification. That failed.
> 
> Ah - OK, so doing a worlddump in a grenade job is always due to
> failure. Makes sense now, thank you. We'll need to track down why
> instances become unreachable during that stage then.

Is *not* always due to a failure.

	-Sean

-- 
Sean Dague
http://dague.net



More information about the OpenStack-dev mailing list