<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
We've used the standard google ref. hub. The Yagi app stores notifications (with an optional expiry) in Redis, and generates feeds from the items in redis. Redis can be clustered. Yagi is composed of two parts, the yagi-event daemon which reads from the
AMQP queue, stores notifications in redis, and pings the hub, and then the yagi-feed wsgi app, which simply pulls from redis and generates an Atom feed. N number of yagi-event daemons can be run on multiple nodes, and they divide messages coming in from
the queues between them. If one failed, the others would keep on. (And rabbit would queue the the messages until acknowledged anyway, even if all of them stopped.) The feed app can also have many instances run in parallel and be load-balanced. Most of the
hubs are the same. If your application goes down and misses a ping from the hub, it can just look at the feed for any events it missed when it comes back up.
<div><br>
</div>
<div>As far as hub HA setup, performance, etc, we have not gone into it too deeply at the moment. We are currently pushing events to another (internal) system using AtomPub (we have other internal systems that generate atom feeds, so we have an internal aggregator).
We do want to test the various hubs for scalability at some point, but we haven't done that yet . <br>
<div>
<div> </div>
<div><br>
<div>
<div>On Oct 26, 2011, at 12:59 PM, Joseph Heck wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
Have you been testing and/or working with a specific hub from the list on that wiki page (<a href="https://nebula.onconfluence.com/pages/viewpage.action?pageId=1508006">http://code.google.com/p/pubsubhubbub/wiki/Hubs</a>)?
<div><br>
</div>
<div>What I'm wondering is how we could set up a notification system that would be highly available (i.e. two nodes or a failover mechanism) that wouldn't loose data. I don't have any background with pubsubhubbub as yet, so looking for some insight from someone
who has messed with it previously.
<div><br>
</div>
<div>-joe<br>
<div><br>
</div>
<div>
<div>
<div>On Oct 26, 2011, at 10:25 AM, Monsyne Dragon wrote:</div>
<blockquote type="cite">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
I answered Roe Lee's question via email, but I figured some other folks on the list might want to know as well...<br>
<div><br>
<div>Begin forwarded message:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;">
<span style="font-family:'Helvetica'; font-size:medium; color:rgba(0, 0, 0, 1);"><b>Date:
</b></span><span style="font-family:'Helvetica'; font-size:medium;">October 26, 2011 12:21:34 AM CDT<br>
</span></div>
<div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;">
<span style="font-family:'Helvetica'; font-size:medium; color:rgba(0, 0, 0, 1);"><b>To:
</b></span><span style="font-family:'Helvetica'; font-size:medium;">Roe Lee <<a href="mailto:hrlee.us@gmail.com">hrlee.us@gmail.com</a>><br>
</span></div>
<div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;">
<span style="font-family:'Helvetica'; font-size:medium; color:rgba(0, 0, 0, 1);"><b>Subject:
</b></span><span style="font-family:'Helvetica'; font-size:medium;"><b>Re: SystemUsageData in Diablo via notification system?</b><br>
</span></div>
<br>
<div>Hello! Yes, notifications were mostly added in Diablo, and the usage data has also been expanded in the current trunk (for the Essex release).
<br>
<br>
I have updated some of the information on the implementation on notifications on the openstack wiki here:<br>
<br>
<a href="http://wiki.openstack.org/NotificationSystem#Implementation">http://wiki.openstack.org/NotificationSystem#Implementation</a>
<br>
<br>
<br>
On Oct 25, 2011, at 10:20 PM, Roe Lee wrote:<br>
<br>
<blockquote type="cite">Hi-<br>
</blockquote>
<blockquote type="cite"><br>
</blockquote>
<blockquote type="cite">I am looking for the way to get system usage data for a billing purpose<br>
</blockquote>
<blockquote type="cite">in Diablo release. Is there anyone know as to how to get event messages<br>
</blockquote>
<blockquote type="cite">such as compute.instance.create, compute.instance.delete, etc? I believe<br>
</blockquote>
<blockquote type="cite">this information cat be retrieved via log files or AMQP.<br>
</blockquote>
<blockquote type="cite"><br>
</blockquote>
<blockquote type="cite">P.S: I guess system usage data is not available in cactus.<br>
</blockquote>
<blockquote type="cite"><br>
</blockquote>
<blockquote type="cite">Hope to hearing any tips.<br>
</blockquote>
<blockquote type="cite"><br>
</blockquote>
<blockquote type="cite">Thanks,<br>
</blockquote>
<blockquote type="cite">Roe<br>
</blockquote>
<blockquote type="cite">-- <br>
</blockquote>
<blockquote type="cite">This message was sent from Launchpad by<br>
</blockquote>
<blockquote type="cite">Roe Lee (<a href="https://launchpad.net/~roe-lee">https://launchpad.net/~roe-lee</a>)<br>
</blockquote>
<blockquote type="cite">to each member of the OpenStack Team team using the "Contact this team" link<br>
</blockquote>
<blockquote type="cite">on the OpenStack Team team page (<a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a>).<br>
</blockquote>
<blockquote type="cite">For more information see<br>
</blockquote>
<blockquote type="cite"><a href="https://help.launchpad.net/YourAccount/ContactingPeople">https://help.launchpad.net/YourAccount/ContactingPeople</a><br>
</blockquote>
<br>
--<br>
<span class="Apple-tab-span" style="white-space:pre"></span>Monsyne M. Dragon<br>
<span class="Apple-tab-span" style="white-space:pre"></span>OpenStack/Nova <br>
<span class="Apple-tab-span" style="white-space:pre"></span>cell 210-441-0965<br>
<span class="Apple-tab-span" style="white-space:pre"></span>work x 5014190<br>
<br>
</div>
</blockquote>
</div>
<br>
<div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
<div>
<div>--</div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>Monsyne M. Dragon</div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>OpenStack/Nova </div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>cell 210-441-0965</div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>work x 5014190</div>
</div>
</div>
</div>
<br>
</div>
_______________________________________________<br>
Mailing list: <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>
Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>
More help : <a href="https://help.launchpad.net/ListHelp">https://help.launchpad.net/ListHelp</a><br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<div><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; ">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
<div>
<div>--</div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>Monsyne M. Dragon</div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>OpenStack/Nova </div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>cell 210-441-0965</div>
<div><span class="Apple-tab-span" style="white-space: pre; "></span>work x 5014190</div>
</div>
</div>
</span></span></div>
<br>
</div>
</div>
</div>
</body>
</html>