Is it sporadic or happens all the time?<div><br></div><div>In my case my Ceilometer VM was different from HBase VM, so I'm not sure if DHCP issues can affect localhost connections.</div><div><br></div><div>Thanks,</div>
<div>Stas<br><br><div class="gmail_quote">On 12 August 2013 15:29, Thomas Maddox <span dir="ltr"><<a href="mailto:thomas.maddox@rackspace.com" target="_blank">thomas.maddox@rackspace.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="font-size:14px;font-family:Calibri,sans-serif;word-wrap:break-word">
<div>Hmmm, that's interesting.</div>
<div><br>
</div>
<div>That would effect an all-in-one deployment? It's referencing localhost right now; not distributed. My Thrift server is hbase://<a href="http://127.0.0.1:9090/" target="_blank">127.0.0.1:9090/</a>. Or would that still effect it, because it's a software facilitated localhost reference and I'm doing dev inside
of a VM (in the cloud) rather than a hardware host?</div>
<div><br>
</div>
<div>I really appreciate your help!</div>
<div><br>
</div>
<div>-Thomas</div>
<div><br>
</div>
<span>
<div style="border-right:medium none;padding-right:0in;padding-left:0in;padding-top:3pt;text-align:left;font-size:11pt;border-bottom:medium none;font-family:Calibri;border-top:#b5c4df 1pt solid;padding-bottom:0in;border-left:medium none">
<span style="font-weight:bold">From: </span>Stas Maksimov <<a href="mailto:maksimov@gmail.com" target="_blank">maksimov@gmail.com</a>><br>
<span style="font-weight:bold">Reply-To: </span>OpenStack Development Mailing List <<a href="mailto:openstack-dev@lists.openstack.org" target="_blank">openstack-dev@lists.openstack.org</a>><br>
<span style="font-weight:bold">Date: </span>Monday, August 12, 2013 9:17 AM<br>
<span style="font-weight:bold">To: </span>OpenStack Development Mailing List <<a href="mailto:openstack-dev@lists.openstack.org" target="_blank">openstack-dev@lists.openstack.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [openstack-dev] [Ceilometer] Need help with HBase backend<br>
</div><div><div class="h5">
<div><br>
</div>
<div>
<div>Aha, so here it goes. The problem was not caused by monkey-patching or multithreading issues, it was caused by the DevStack VM losing its connection and getting a new address from the DHCP server. Once I fixed the connection issues, the problem with eventlet
disappeared.<br>
<br>
Hope this helps,
<div>Stas</div>
<div><br>
<div class="gmail_quote">On 12 August 2013 14:49, Stas Maksimov <span dir="ltr"><<a href="mailto:maksimov@gmail.com" target="_blank">maksimov@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">Hi Thomas,</p>
<p dir="ltr">I definitely saw this before, iirc it was caused by monkey-patching somewhere else in ceilometer. It was fixed in the end before i submitted hbase implementation.
</p>
<p dir="ltr">At this moment unfortunately that's all I can recollect on the subject. I'll get back to you if I have an 'aha' moment on this. Feel free to contact me off-list regarding this hbase driver.</p>
<p dir="ltr">Thanks,<br>
Stas.</p>
<div style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div>
<div style="font-size:14px;font-family:Calibri,sans-serif;word-wrap:break-word">
<div>Hey team,</div>
<div><br>
</div>
<div>I am working on a fix for retrieving the latest metadata on a resource rather than the first with the HBase implementation, and I'm running into some trouble when trying to get my dev environment to work with HBase. It looks like a concurrency issue when
it tries to store the metering data. I'm getting the following error in my logs (summary):</div>
<div><br>
</div>
<div>
<div><b>013-08-11 18:52:33.980 2445 ERROR ceilometer.collector.dispatcher.database [req-3b3c65c9-1a1b-4b5d-bba5-8224f074b176 None None]
<span style="background-color:transparent">Second simultaneous read on fileno 7 detected. Unless you really know what you're doing, make sure that only one greenthread can read any particular socket. Consider using a pools.Pool. If you do know what you're
doing and want to disable this error, call eventlet.debug.hub_prevent_multiple_readers(False)</span></b></div>
<div><br>
</div>
</div>
<div><b>Full traceback</b>: <a href="http://paste.openstack.org/show/43872/" target="_blank">http://paste.openstack.org/show/43872/</a></div>
<div><br>
</div>
<div>Has anyone else run into this lovely little problem? It looks like the implementation needs to use happybase.ConnectionPool, unless I'm missing something.</div>
<div><br>
</div>
<div>Thanks in advance for help! :)</div>
<div><br>
</div>
<div>-Thomas</div>
</div>
<br>
</div>
</div>
_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div></div></span>
</div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>