[openstack-dev] [kolla][nova] Orchiestrated upgrades in kolla

Marek Zawadzki mzawadzki at mirantis.com
Thu Dec 17 11:59:42 UTC 2015


Michal, hi, what's your assumption about instances? Do we want to shut 
them down, migrate nova, and restart them or we'd like to preserve all 
running VMs?

-marek

On 04.12.2015 21:50, Michał Jastrzębski wrote:
> Hey guys,
>
> Orchiestrated upgrades is one of our highest priorities for M in 
> kolla, so following up after discussion on summit I'd like to suggest 
> an approach:
>
> Instead of creating playbook called "upgrade my openstack" we will 
> create "upgrade my nova" instead and approach to each service case by 
> case (since all of our running services are in dockers, this is possible).
> We will also make use of image tags as version carriers, so ansible 
> will deploy new container only if version tag differs from what we ask 
> it to deploy. This will help with idempotency of upgrade process.
>
> So let's start with nova. Upgrade-my-nova playbook will do something 
> like this:
>
> 0. We create snapshot of our mariadb-data container. This will affect 
> every service, but it's always good to have backup and rollback of db 
> will be manual action
>
> 1. Nova bootstrap will be called and it will perform db-migration. 
> Since current approach to nova code is add-only we shouldn't need to 
> stop services and old services should keep working on newer database. 
> Also for minor version upgrades there will be no action here unless 
> there is migration.
> 2. We upgrade all conductor at the same time. This should take mere 
> seconds since we'll have prebuilt containers
> 3. We will upgrade rest of controller services with using "series: 1" 
> in ansible to ensure rolling upgrades.
> 4. We will upgrade all of nova-compute services on it's own pace.
>
> This workflow should be pretty robust (I think it is) and it should 
> also provide idempotency.
>
> Thoughts?
>
> Regards,
> Michal
>
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-- 
Marek Zawadzki
Mirantis Kolla Team

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20151217/25337733/attachment.html>


More information about the OpenStack-dev mailing list