[openstack-dev] [nova][neutron][upgrade] Grenade multinode partial upgrade

Sean M. Collins sean at coreitpro.com
Fri Dec 4 17:43:54 UTC 2015

On Mon, Nov 30, 2015 at 07:00:07AM EST, Sean Dague wrote:
> On 11/25/2015 11:42 AM, Sean M. Collins wrote:
> > The first run for the multinode grenade job completed.
> > 
> > http://logs.openstack.org/35/187235/11/experimental/gate-grenade-dsvm-neutron-multinode/011124b/logs/
> > 
> > I'm still getting my bearings in the grenade log output, but if I
> > understand it correctly, after upgrading Neutron, when spawning a new
> > instance we do not get successful connectivity. The odd part is we see
> > the failure twice. Once when upgrading Nova[1], then once when upgrading
> > Cinder[2]. I would have thought Grenade would have exited after just
> > failing the first time. It did do a call to worlddump.
> We're calling worlddump a bunch of times in grenade during success
> operations to try to help track down why connectivity sometimes goes
> away when we don't do any actions which we think should affect it. The
> Nova operation succeeded, there is a successful ping at the end of it.
> Cinder pinged, but also does ssh verification. That failed.

Ah - OK, so doing a worlddump in a grenade job is always due to
failure. Makes sense now, thank you. We'll need to track down why
instances become unreachable during that stage then.

Sean M. Collins

More information about the OpenStack-dev mailing list