[openstack-dev] [mistral] db deadlock in task execution

Shtilman, Tomer (Nokia - IL) tomer.shtilman at nokia.com
Wed Jan 27 13:30:09 UTC 2016


Hi
We are seeing an  error in task execution , transaction is rollbacked an I believe its causing problems in deletion (fk violation)
Shouldn't we have some kind of retry mechanism for deadlock ?
Will be happy to get any thoughts on the matter
Thanks


[root at s54-0 ~(keystone_cb2)]# mistral task-get-result 1ef3e610-1731-45bb-847c-25f0804ca83d
"RemoteError: Remote error: InvalidRequestError This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (mysql_exceptions.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') [SQL: u'UPDATE executions_v2 SET updated_at=%s, state=%s WHERE executions_v2.id = %s'][parameters: (datetime.datetime(2016, 1, 27, 0, 11, 30, 305004), 'SUCCESS', '1ef3e610-1731-45bb-847c-25f0804ca83d')]\n[u'Traceback (most recent call last):
n', u' File \"/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py\", line 142, in _dispatch_and_reply
n executor_callback))
n', u' File \"/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py\", line 186, in _dispatch
n executor_callback)
n', u' File \"/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py\", line 129, in _do_dispatch
n result = func(ctxt, **new_args)
n', u' File \"/usr/lib/python2.7/site-packages/mistral/engine/rpc.py\", line 144, in on_action_complete
n return self._engine.on_action_complete(action_ex_id, result)
n', u' File \"/usr/lib/python2.7/site-packages/mistral/utils/init_.py\", line 112, in _logged
n return func(*args, **kw)
n', u' File \"/usr/lib/python2.7/site-packages/mistral/engine/default_engine.py\", line 267, in on_action_complete
n raise e
n', u\"InvalidRequestError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback().


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20160127/e15c6ac1/attachment.html>


More information about the OpenStack-dev mailing list