[openstack-dev] [CI][Ceilometer] Please help to understand why migrations are (not?) working in gate-tempest-devstack-vm-full

Jay Pipes jaypipes at gmail.com
Tue Sep 17 04:29:48 UTC 2013


Hi all,

I submitted a patch earlier that adds a migration to Ceilometer:

https://review.openstack.org/#/c/46841/

The patch only adds a SQLAlchemy migration file. Nothing more.

My patch failed some gate tests, so I went to investigate the cause of 
the failures, and I saw in the console log [1] the following:

2013-09-17 04:09:09.876 | 2013-09-17 04:09:09 + mysql -uroot -psecret 
-hlocalhost -e 'DROP DATABASE IF EXISTS ceilometer;'
2013-09-17 04:09:09.879 | 2013-09-17 04:09:09 + mysql -uroot -psecret 
-hlocalhost -e 'CREATE DATABASE ceilometer CHARACTER SET utf8;'
2013-09-17 04:09:09.881 | 2013-09-17 04:09:09 + 
/usr/local/bin/ceilometer-dbsync
2013-09-17 04:09:09.883 | 2013-09-17 04:09:09 2013-09-17 04:09:09.131 
23924 INFO migrate.versioning.api [-] 0 -> 1...
<snip>
2013-09-17 04:09:09.928 | 2013-09-17 04:09:09 2013-09-17 04:09:09.549 
23924 INFO migrate.versioning.api [-] 9 -> 10...
2013-09-17 04:09:09.931 | 2013-09-17 04:09:09 2013-09-17 04:09:09.560 
23924 INFO migrate.versioning.api [-] done
2013-09-17 04:09:23.191 | Process leaked file descriptors. See 
http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build 
for more information
2013-09-17 04:09:23.707 | Build step 'Execute shell' marked build as failure

Here's where I'm stumped... I added the 16th migration to Ceilometer. 
But only 10 migrations ran. So...

1) What happened to the other migrations? I *think* they actually ran -- 
because in looking at the MySQL slow log for the test run, I saw this:

UPDATE migrate_version SET version=15 WHERE migrate_version.version = 14 
AND migrate_version.repository_id = 'ceilometer';

So at least up until migration 15 succeeded... but where is the output 
in the console log?

2) What is the error that is failing the test run? I grep for "error" 
and "fail" and don't see anything that indicates an error occurred -- 
but perhaps I'm not looking in the right place?

3) Does the leaked file descriptors thing noted above have anything to 
do with running database migrations?

4) Do the Ceilometer logs get screen-scraped like the other services? I 
didn't see them in the log list [2], but perhaps I'm not looking in the 
right place?

Any and all insight would be greatly appreciated.

Best,
-jay

[1] 
http://logs.openstack.org/41/46841/2/check/gate-tempest-devstack-vm-full/c16c3be/console.html
[2] 
http://logs.openstack.org/41/46841/2/check/gate-tempest-devstack-vm-full/c16c3be/logs/



More information about the OpenStack-dev mailing list