Open Stack

Hi all,

Has anyone met the 'too many connections' error on IceHouse.
In my case, it only happen to cinder and heat; nova is fine. And after 
restarting keystone, everything works fine. But after some while, it 
will happen again.

I have another deployment which also has the same issue.

heat stack-delete ieccf301-stg
ERROR: Remote error: OperationalError (OperationalError) (1040, 'Too 
many connections') None None


heat-api.log:

[u'Traceback (most recent call last):\n', u'  File 
"/usr/lib/python2.6/site-packages/heat/openstack/common/rpc/amqp.py", 
line 462, in _process_data\n    **args)\n', u'  File 
"/usr/lib/python2.6/site-packages/heat/openstack/common/rpc/dispatcher.py", 
line 172, in dispatch\n    result = getattr(proxyobj, method)(ctxt, 
**kwargs)\n', u'  File 
"/usr/lib/python2.6/site-packages/heat/engine/service.py", line 63, in 
wrapped\n    return func(self, ctx, *args, **kwargs)\n', u'  File 
"/usr/lib/python2.6/site-packages/heat/engine/service.py", line 407, in 
list_stacks\n    sort_dir, filters, tenant_safe) or []\n', u' File 
"/usr/lib/python2.6/site-packages/heat/db/api.py", line 125, in 
stack_get_all\n    marker, sort_dir, filters, tenant_safe)\n', u' File 
"/usr/lib/python2.6/site-packages/heat/db/sqlalchemy/api.py", line 346, 
in stack_get_all\n    marker, sort_dir, filters).all()\n', u'  File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/orm/query.py", line 2241, 
in all\n    return list(self)\n', u'  File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/orm/query.py", line 2353, 
in __iter__\n    return self._execute_and_instances(context)\n', u'  
File "/usr/lib64/python2.6/site-packages/sqlalchemy/orm/query.py", line 
2366, in _execute_and_instances\n    close_with_result=True)\n', u' File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/orm/query.py", line 2357, 
in _connection_from_session\n    **kw)\n', u'  File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/orm/session.py", line 
799, in connection\n    close_with_result=close_with_result)\n', u' File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/orm/session.py", line 
805, in _connection_for_bind\n    return 
engine.contextual_connect(**kwargs)\n', u'  File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/engine/base.py", line 
1661, in contextual_connect\n    self.pool.connect(),\n', u'  File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/pool.py", line 272, in 
connect\n    return _ConnectionFairy(self).checkout()\n', u' File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/pool.py", line 431, in 
__init__\n    rec = self._connection_record = pool._do_get()\n', u'  
File "/usr/lib64/python2.6/site-packages/sqlalchemy/pool.py", line 772, 
in _do_get\n    return self._create_connection()\n', u'  File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/pool.py", line 225, in 
_create_connection\n    return _ConnectionRecord(self)\n', u' File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/pool.py", line 318, in 
__init__\n    self.connection = self.__connect()\n', u' File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/pool.py", line 379, in 
__connect\n    connection = self.__pool._creator()\n', u' File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/engine/strategies.py", 
line 80, in connect\n    return dialect.connect(*cargs, **cparams)\n', 
u'  File 
"/usr/lib64/python2.6/site-packages/sqlalchemy/engine/default.py", line 
283, in connect\n    return self.dbapi.connect(*cargs, **cparams)\n', 
u'  File "/usr/lib64/python2.6/site-packages/MySQLdb/__init__.py", line 
81, in Connect\n    return Connection(*args, **kwargs)\n', u'  File 
"/usr/lib64/python2.6/site-packages/MySQLdb/connections.py", line 187, 
in __init__\n    super(Connection, self).__init__(*args, **kwargs2)\n', 
u"OperationalError: (OperationalError) (1040, 'Too many connections') 
None None\n"