Open Stack

Hello
	since today our glance install is not working, we are not able to boot
new machines


the only thing i see in logs is

2014-01-27 16:10:43.364 9237 INFO glance.registry.client.v1.client
[29e031a9-cb1c-4b20-8a7f-100ed10f3785 184136c2674746b5a4b27d3b13ca91f8
af41371701004068b2532695ed57f16f] Registry client request GET
/images/detail raised ServerError

on glance-registry log there is nothing like an error

2014-01-27 16:10:43.333 8771 INFO glance.registry.api.v1.images
[7c168813-dc04-4b65-ad00-0cc171afb10a 184136c2674746b5a4b27d3b13ca91f8
af41371701004068b2532695ed57f16f] Returning detailed image list


glance index fails. but it always failed for us with more than 10
images, is it expected?

# glance --debug index

[ snip snip ]

size": 3280732160}, {"status": "active", "name": "Win7x86", "deleted":
false, "container_format": "ovf", "created_at":
"2014-01-13T21:32:39.412830", "disk_format": "qcow2", "updated_at":
"2014-01-14T14:38:09.932192", "min_disk": 40, "protected": true, "id":
"d0d3b1f4-3e9e-430e-a60a-42de277291da", "min_ram": 2048, "checksum":
"f44b61df38f3d1de775a989eccc1798f", "owner":
"af41371701004068b2532695ed57f16f", "is_public": true, "deleted_at":
null, "properties": {"protected": null}, "size": 3374317568}]}

f31c2938-89b4-4fed-b78c-0d5a633313de debian-wheezy-amd64_2014-01-17
qcow2                ovf                       996999168
16ec85ff-6451-4d36-8908-c5c3b57c862b wheezy-cristian-snap           ami
                 ami                      1067450368
7fbd62fd-72e6-4f18-ba26-3df9f8295f60 couchdb-snapshot               ami
                 ami                      1150812160
6051f420-c590-43f3-a3b1-2802a74d6dc4 vmlinuz-3.2.0-4-amd64          aki
                 aki                         2827712
680680ef-0207-44fe-ad9f-6e01a4e0147a initrd-3.2.0-4-amd64           ari
                 ari                        10486978
11339ff2-9240-4c44-ad8b-091192e0301b wheezy_postgresql
qcow2                bare                     1071448064
44d691b8-57e3-44df-9d29-14a6c1f4a431 Win2012-sql
qcow2                ovf                     13241942016
784e7546-d101-4cb0-92e0-26faf7f6dfaf Win2012
qcow2                ovf                      4284743680
25e38d31-cf2b-4a13-b1bd-90936d90eab4 Win2008r2
qcow2                ovf                      3280732160
d0d3b1f4-3e9e-430e-a60a-42de277291da Win7x86
qcow2                ovf                      3374317568
curl -i -X GET -H 'X-Auth-Token: c88edf81cae841f4a5638f7267074160' -H
'Content-Type: application/json' -H 'User-Agent: python-glanceclient'
http://10.17.10.34:9292/v1/images/detail?marker=d0d3b1f4-3e9e-430e-a60a-42de277291da&limit=10

HTTP/1.1 500 Internal Server Error
date: Mon, 27 Jan 2014 19:14:28 GMT
content-length: 0
content-type: text/plain
connection: close

Request returned failure status.
HTTPInternalServerError (HTTP 500)


we use rbd as backend storage and pgsql as db
our install runs havana 2013.2.1-2
keystone uses memcached backend and uuid, we have tried restarting
glance-api and registry, keystone and memcached, but nothing.
db looks exactly the same as friday

no changes were made during the weekend. friday we were running smoothly


PS: i can send logs, config files, whatever, but they are pretty default

thanks!


-- 
1AE0 322E B8F7 4717 BDEA BF1D 44BB 1BA7 9F6C 6333