Hi guys,
We are using Ubuntu 16 and OpenStack ansible to do our setup.
rabbitmqctl list_queues
Listing queues
(Doesn't appear to be any queues )
rabbitmqctl cluster_status
Cluster status of node
'rabbit@management-1-rabbit-mq-container-b4d7791f'
[{nodes,[{disc,['rabbit@management-1-rabbit-mq-container-b4d7791f',
'rabbit@management-2-rabbit-mq-container-b455e77d',
'rabbit@management-3-rabbit-mq-container-1d6ae377']}]},
{running_nodes,['rabbit@management-3-rabbit-mq-container-1d6ae377',
'rabbit@management-2-rabbit-mq-container-b455e77d',
'rabbit@management-1-rabbit-mq-container-b4d7791f']},
{cluster_name,<<"openstack">>},
{partitions,[]},
{alarms,[{'rabbit@management-3-rabbit-mq-container-1d6ae377',[]},
{'rabbit@management-2-rabbit-mq-container-b455e77d',[]},
{'rabbit@management-1-rabbit-mq-container-b4d7791f',[]}]}]
Regards,
Could you forward the output of the following commands on a controller node? :
rabbitmqctl cluster_statusrabbitmqctl list_queues
You won't necessarily see a high load on a Rabbit cluster that is in a bad state.
On Wed, Jul 31, 2019 at 5:19 AM Grant Morley <grant@civo.com> wrote:
Hi all,
We are randomly seeing slow instance launch / deletion times and it appears to be because of RabbitMQ. We are seeing a lot of these messages in the logs for Nova and Neutron:
ERROR oslo.messaging._drivers.impl_rabbit [-] [f4ab3ca0-b837-4962-95ef-dfd7d60686b6] AMQP server on 10.6.2.212:5671 is unreachable: Too many heartbeats missed. Trying again in 1 seconds. Client port: 37098: ConnectionForced: Too many heartbeats missed
The RabbitMQ cluster isn't under high load and I am not seeing any packets drop over the network when I do some tracing.
We are only running 15 compute nodes currently and have >1000 instances so it isn't a large deployment.
Are there any good configuration tweaks for RabbitMQ running on OpenStack Queens?
Many Thanks,