<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif; "><div>I haven't tried it but this might be something 'similar'</div><div><br></div><div><a href="http://www.rabbitmq.com/management.html">http://www.rabbitmq.com/management.html</a></div><div><br></div><span id="OLK_SRC_BODY_SECTION"><div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt"><span style="font-weight:bold">From: </span> Hao Wang <<a href="mailto:hao.1.wang@gmail.com">hao.1.wang@gmail.com</a>><br><span style="font-weight:bold">Date: </span> Thursday, October 11, 2012 6:20 AM<br><span style="font-weight:bold">To: </span> Joshua Harlow <<a href="mailto:harlowja@yahoo-inc.com">harlowja@yahoo-inc.com</a>><br><span style="font-weight:bold">Cc: </span> Sandy Walsh <<a href="mailto:sandy.walsh@rackspace.com">sandy.walsh@rackspace.com</a>>, "<a href="mailto:alexis@rabbitmq.com">alexis@rabbitmq.com</a>" <<a href="mailto:alexis@rabbitmq.com">alexis@rabbitmq.com</a>>, "<a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a>" <<a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a>><br><span style="font-weight:bold">Subject: </span> Re: [Openstack] Bottleneck of message queue<br></div><div><br></div><div><meta http-equiv="Content-Type" content="text/html; charset=utf-8"><div><div>Hi Sandy,</div><div><br></div><div>I couldn't access your links. Originally I though it's my laptop problem but it is not. It's not a good news for both of us that it seems your website is now being blocked by China GFW. :) Have you posted the same articles on other sites? Sorry for the
inconvenience. Thanks.</div><div><br></div>
Hi Josh,
<div><br></div><div>You're absolutely right. It's impossible to root cause issues without true data. In the meantime, your point reminds me a question, is there a way for rabbitmq to show online statistics of messages, like the output of command "netstat -i" to show the statistics
of the in and out number of packets for network interfaces?</div><div><br></div><div>Regards,</div><div>Howard<br><br><div class="gmail_quote">On Thu, Oct 11, 2012 at 1:53 AM, Joshua Harlow <span dir="ltr">
<<a href="mailto:harlowja@yahoo-inc.com" target="_blank">harlowja@yahoo-inc.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="font-size:14px;font-family:Calibri,sans-serif;word-wrap:break-word"><div>Also some real data/graphs/metrics if u have anything would go a long way in helping others see the problem.</div><div><br></div><div>Without data though its hard to know what is broke, what is the limit, and what needs to be fixed.</div><div><br></div><div>-Josh</div><div><br></div><span><div style="border-right:medium none;padding-right:0in;padding-left:0in;padding-top:3pt;text-align:left;font-size:11pt;border-bottom:medium none;font-family:Calibri;border-top:#b5c4df 1pt solid;padding-bottom:0in;border-left:medium none"><span style="font-weight:bold">From: </span>Hao Wang <<a href="mailto:hao.1.wang@gmail.com" target="_blank">hao.1.wang@gmail.com</a>><br><span style="font-weight:bold">Date: </span>Wednesday, October 10, 2012 6:50 AM<br><span style="font-weight:bold">To: </span>Sandy Walsh <<a href="mailto:sandy.walsh@rackspace.com" target="_blank">sandy.walsh@rackspace.com</a>>, "<a href="mailto:alexis@rabbitmq.com" target="_blank">alexis@rabbitmq.com</a>" <<a href="mailto:alexis@rabbitmq.com" target="_blank">alexis@rabbitmq.com</a>><br><span style="font-weight:bold">Cc: </span>"<a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>" <<a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>><br><span style="font-weight:bold">Subject: </span>Re: [Openstack] Bottleneck of message queue<br></div><div><div class="h5"><div><br></div><div><div>Thanks guys for your insightful replies. I'm studying them. If I've got anything, I'll get back to you as soon as possible.
<div><br></div><div>Have a nice day!<br><div><br></div><div>Cheers,</div><div>Howard<br><br><div class="gmail_quote">On Wed, Oct 10, 2012 at 7:25 PM, Sandy Walsh <span dir="ltr">
<<a href="mailto:sandy.walsh@rackspace.com" target="_blank">sandy.walsh@rackspace.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hey Howard,<br><br>
Queues are generally in memory, but you may turn on persistent (disk) queues in your environment. So that's your limitation. Having rabbitmq on a different server is a good idea.<br><br>
Also, Queues are only used for control, not user data, so they shouldn't be that big of a burden. Having a queue-based architecture adds some complexity for synchronization, but their benefit of giving us burst-handling capabilities far outweigh that (imho).<br><br>
If your queues are filling up, you may:<br>
1. need beefier machines processing the offending queues (or rabbit server)<br>
2. need to add more worker nodes (more network, more scheduler, though more compute isn't appropriate)<br>
3. think about clustering rabbit<br><br>
Notifications are perhaps the chattiest queues in the system, so make sure you have suitable workers there (if you have notifications turned on)<br><br>
This might help you understand the flow through the queues a little more?<br><a href="http://www.sandywalsh.com/2012/04/openstack-nova-internals-pt1-overview.html" target="_blank">http://www.sandywalsh.com/2012/04/openstack-nova-internals-pt1-overview.html</a><br><a href="http://www.sandywalsh.com/2012/09/openstack-nova-internals-pt2-services.html" target="_blank">http://www.sandywalsh.com/2012/09/openstack-nova-internals-pt2-services.html</a><br><br>Cheers,<br>
Sandy<br><br><br>
From: openstack-bounces+sandy.walsh=<a href="mailto:rackspace.com@lists.launchpad.net" target="_blank">rackspace.com@lists.launchpad.net</a> [openstack-bounces+sandy.walsh=<a href="mailto:rackspace.com@lists.launchpad.net" target="_blank">rackspace.com@lists.launchpad.net</a>]
on behalf of Hao Wang [<a href="mailto:hao.1.wang@gmail.com" target="_blank">hao.1.wang@gmail.com</a>]<br>
Sent: Tuesday, October 09, 2012 11:49 PM<br>
To: <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
Subject: [Openstack] Bottleneck of message queue<br><div><div><br><br>
Hi guys,<br><br>
I am trying to figure out how the internal interaction processes within different modules of OpenStack. Frankly speaking, while I'm reading the source codes I lost myself and have to jump out again to look at OpenStack from out of the box. I don't know if anybody
has the similiar feeling with me. Is there any picture I can follow to see the message flows?<br><br>
OpenStack is based on message queue to ensure the expansion easy. Here come my questions. Does anybody know the capacity of message queue? Would the capacity be a bottleneck of the platform?<br><br>
Thanks,<br>
Howard<br><br><br><br></div></div></blockquote></div><br></div></div></div></div></div></div></span></div></blockquote></div><br></div></div></div></span></body></html>