[Openstack-operators] Very Slow API operations after Grizzly upgrade.
Stephane Boisvert
stephane.boisvert at gameloft.com
Thu Aug 15 14:50:33 UTC 2013
hi,
just to make sure did you disable the debugging and verbose in nova,
keystone and horizon ? I had this enabled and it was very slow...
Hope this help.
Steph.
On 13-08-15 10:45 AM, Jonathan Proulx wrote:
> Hi All,
>
> I have a single controller node 60 compute node cloud on Ubuntu 12.04
> / cloud archive and after upgrade to grizzly everything seem
> painfully slow.
>
> I've had 'nova list' take on the order of one minute to return
> (there's 65 non-deleted instances and a total of just under 500k
> instances in the instances table but that was true before upgrade as well)
>
> The controller node is 4x busier with this tiny load of a single user
> and a few VMs as it has averaged in production with 1,500 VMs dozens
> of users and VMs starting every 6sec on average.
>
> This has me a little worried but the system is so over spec'ed that I
> can't see it as my current problem as the previous average was 5% CPU
> utilization so now I'm only at 20%. All the databases fit comfortably
> in memory with plenty of room for caching so my disk I/0 is virtually
> nothing.
>
> Not quite sure where to start. I'd like to blame conductor for
> serializing database access, but I really hope any service could
> handle at least one rack of servers before you needed to scale
> out...but besides the poor user experience of sluggish response I'm
> also getting timeouts if I try and start some number of 10's of
> servers, the usual work flow around here often involves 100's.
>
> Anyone had similar problems and/or have suggestions of where else to
> look for bottle necks.
>
> -Jon
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
--
*Stéphane Boisvert*
GNS-Shop Technical Coordinator
5800 St-Denis suite 1001
Montreal (QC), H2S 3L5
*MSN:*stephane.boisvert at gameloft.com
*E-mail:*stephane.boisvert at gameloft.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20130815/62f7c4e5/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Inbox.jpg
Type: image/jpeg
Size: 8437 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20130815/62f7c4e5/attachment.jpg>
More information about the OpenStack-operators
mailing list