I've been working on testing database migrations against real data sets for the last few weeks. I haven't had a chance to document it very well yet though -- there's a blog post being drafted at the moment. If you go to http://openstack.stillhq.com/ci you can see the results of tests run against three real mysql databases -- two manually created trivial databases and a real user database from a mid-sized deployment. I'd like to add other database backends and sample user databases, but this is a work in progress. Any patch against nova which changes or adds a database migration is run through these tests. So far this work has found two bugs in migrations. Michael On Wed, Jul 3, 2013 at 4:08 PM, Boris Pavlovic <boris at pavlovic.me> wrote: > Hi Ben, > > This work was started since Grizzly started. > So there are tons of Blueprints and tons of code. > > Nova: > https://blueprints.launchpad.net/nova/+spec/db-cleanup > https://blueprints.launchpad.net/nova/+spec/db-enforce-unique-keys > https://blueprints.launchpad.net/nova/+spec/db-api-tests > https://blueprints.launchpad.net/nova/+spec/db-api-tests-on-all-backends > https://blueprints.launchpad.net/nova/+spec/db-sync-models-with-migrations > https://blueprints.launchpad.net/nova/+spec/db-session-cleanup > https://blueprints.launchpad.net/nova/+spec/db-archiving > https://blueprints.launchpad.net/nova/+spec/db-improve-archiving > > Oslo: > https://blueprints.launchpad.net/oslo/+spec/oslo-sqlalchemy-utils > https://blueprints.launchpad.net/oslo/+spec/test-migrations > https://blueprints.launchpad.net/oslo/+spec/common-unit-tests > > Cinder: > https://blueprints.launchpad.net/cinder/+spec/db-cleanup > other you could find using dependencies > > Glance: > https://blueprints.launchpad.net/glance/+spec/db-cleanup > other you could find using dependencies > > > >> One small addition I would suggest is a step to remove the unused >> sqlalchemy-migrate code once this is all done. That's my main concern >> with moving it to Oslo right now. > >> Also, is this a formal blueprint(s)? Seems like it should be. > >> -Ben > > _______________________________________________ > OpenStack-dev mailing list > OpenStack-dev at lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >