DuplicateMessageError after restart of a control node
Pawel Konczalski
pawel.konczalski at everyware.ch
Tue Jul 23 14:57:03 UTC 2019
Hello everybody,
after restart of one of the control nodes i see this error message every
few seconds int the logs:
@timestamp July 23rd 2019, 16:44:08.927
t Hostname ctlX
t Logger openstack.nova
t Payload Failed to process message ... skipping it.:
DuplicateMessageError: Found duplicate
message(f2178cffb5d249f3a1d2df1c0322f18c). Skipping it.
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
Traceback (most recent call last):
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
File
"/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py",
line 361, in _callback
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
self.callback(RabbitMessage(message))
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
File
"/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py",
line 251, in __call__
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
unique_id = self.msg_id_cache.check_duplicate_message(message)
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
File
"/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_messaging/_drivers/amqp.py",
line 122, in check_duplicate_message
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
raise rpc_common.DuplicateMessageError(msg_id=msg_id)
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
DuplicateMessageError: Found duplicate
message(f2178cffb5d249f3a1d2df1c0322f18c). Skipping it.
2019-07-23 16:44:08.927 82 ERROR oslo.messaging._drivers.impl_rabbit
t Pid 82
t Timestamp 2019-07-23 16:44:08.927
t _id AWwfSjEtsndUu9YeotwF
t _index flog-2019.07.23
# _score -
t _type fluentd
t log_level ERROR
t programname nova-scheduler
t python_module oslo.messaging._drivers.impl_rabbit
As soon as the restarted node is taken out of the cluster, the errors
disappear.
Any idea how to fix this?
Thank you
Pawel
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5227 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20190723/271bd78a/attachment.bin>
More information about the openstack-discuss
mailing list