[Openstack] RabbitMQ, HAProxy, and OpenStack

Craig Jellick cjellick at godaddy.com
Tue May 6 20:22:19 UTC 2014


Hi Jitendra,

Thanks for the reply. We really appreciate it.

I've posted a gist of our HAProxy and RabbitMQ configs here:
https://gist.github.com/cjellick/9ec3c5beac5f06fae5ed
We actually don't have any logs for HAProxy right now (thanks for the painfully obvious good idea).

The queues get setup in an HA configuration with one master and two slaves.
We're running Havana with Neutron configured with the ML2 driver and ovs plugin.


/Craig J

From: Jitendra Bhaskar <jeetuindian at gmail.com<mailto:jeetuindian at gmail.com>>
Date: Tuesday, May 6, 2014 10:45 AM
To: Craig Jellick <cjellick at godaddy.com<mailto:cjellick at godaddy.com>>
Cc: "openstack at lists.openstack.org<mailto:openstack at lists.openstack.org>" <openstack at lists.openstack.org<mailto:openstack at lists.openstack.org>>
Subject: Re: [Openstack] RabbitMQ, HAProxy, and OpenStack

Hi Criag,

can we share haproxy log and config of ha proxy. We are also running in our lab and its working fine. what about rabbitmq cluster ?


On Tue, May 6, 2014 at 8:41 PM, Craig Jellick <cjellick at godaddy.com<mailto:cjellick at godaddy.com>> wrote:
HI all,

Does anyone have experience using HAProxy as a load balancer in front of a RabbitMQ cluster for OpenStack?

We have this setup in our lab and it is very susceptible to queue disconnects. In particular, the neutron security group fanout queues (q-agent-notifier-security_group-update_fanout_<random id>) will lose their client connections and back up with a lot of messages. The clients to these queues are the openstack-neutron-openvswitch-agent services.

This happens every time we hit the configured HAProxy TCP timeout. It can also happen if a Rabbit node that has a connection is restarted, if HAProxy is restarted, or if there is basically any interruption in the connection between the clients and HAProxy.

Finally, its worth noting that in our prod environment we are using F5 load balancers and we don't see this problem occur for TCP timeouts, which is the most common source of this problem in our lab environment.

Thanks in advance.


/Craig J

_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to     : openstack at lists.openstack.org<mailto:openstack at lists.openstack.org>
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack




--
 Thanks & Regards
Jitendra Kumar Bhaskar
Cell:- +91 7306311531
      :- +91 9989743042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20140506/eac47866/attachment.html>


More information about the Openstack mailing list