[Openstack] Queue Service, next steps

Monsyne Dragon mdragon at rackspace.com
Fri Feb 18 17:20:23 UTC 2011

On 2/17/11 4:21 PM, Eric Day wrote:
> Thanks to everyone who gave great feedback on the first queue service
> thread. I've updated the wiki page to include the suggestions.
> http://wiki.openstack.org/QueueService
Pondering this, I have a few thoughts:

I'll note that Erlang seems a realistic contender for this implementation.
Things like rabbitMQ and eJabberd handle a lot of traffic (if well 
configured), and this is the sort of thing erlang was designed for.

Secondly,  could we leverage existing opensource codebases to accomplish 
this?  I know AMQP was having issues over WAN links, and likely isn't 
suited for disconnected operations (I've seen one multitenant hosted 
queueing service offering AMQP interfaces (StormMQ), but they also offer 
a a REST interface as well, probably for that reason.), but could we 
swipe the core of some existing queueing system and adapt it?

Or, before we implement Yet Another Queueing Service, would it be 
possible to implement this using a REST interface plugin to say, 
rabbitMQ,  using it's 'virtual hosts' for multitenant separation, plus 
a  modest amount of code to arrange for needed zone/locality awareness 
on the cluster?

I just worry, since reliable queueing is one of those things that is 
simple in concept, but has an awful lot of nasty details. (That said, I 
have no objection to re-inventing wheels if a: our new ones fly, or b: 
the existing ones are square :>  )


     -Monsyne Dragon
     work:         210-312-4190
     mobile        210-441-0965
     google voice: 210-338-0336

Confidentiality Notice: This e-mail message (including any attached or
embedded documents) is intended for the exclusive and confidential use of the
individual or entity to which this message is addressed, and unless otherwise
expressly indicated, is confidential and privileged information of Rackspace.
Any dissemination, distribution or copying of the enclosed material is prohibited.
If you receive this transmission in error, please notify us immediately by e-mail
at abuse at rackspace.com, and delete the original message.
Your cooperation is appreciated.

More information about the Openstack mailing list