<div dir="ltr"><div><div><div><div>Pierre-Luc,<br></div><br></div>I'm still investigating this. Could you please share details about your environment? Is it devstack? <br></div>You can find me in #openstack-ceilometer channel in irc, maybe it would be faster to find out the root cause (nick _nadya_). The problem is that the issue may be related not only to HBase.<br><br></div>Thanks<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 16, 2015 at 3:53 PM, Pierre-Luc Dion <span dir="ltr"><<a href="mailto:pdion@cloudops.com" target="_blank">pdion@cloudops.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks Nadya, <div><br></div><div>I still have my test setup in place so if there is a fix to test, I should be able to pretty fast.</div><div><br></div><div>Regards,</div><div><div class="h5"><div class="gmail_extra"><br clear="all"><div><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div></div></div></div></div></div></div></div>
<br><br><div class="gmail_quote">On Tue, Jun 16, 2015 at 5:27 AM, Nadya Privalova <span dir="ltr"><<a href="mailto:nprivalova@mirantis.com" target="_blank">nprivalova@mirantis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Hi Pierre-Luc,<br><br></div>From logs it's seen that the message which was processed is <br><br>{u'read_only': False, u'instance_uuid': None, u'domain': None,
u'show_deleted': False, u'user_identity': u'- - - - -',
u'project_domain': None, u'auth_token': None, u'is_admin': True,
u'user': None, u'request_id': u'req-bf3c927f-03f4-4b64-a903-df3770cfef48', u'user_domain': None, u'tenant': None}<br><br></div>So it doesn't contain resource_id. HBase needs this field to put data into 'resource' table. Anyway, we need to handle this situation properly. Thanks for filing a bug, I will work on it.<br><br><div>Thanks,<br></div><div>Nadya<br><br></div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Fri, Jun 12, 2015 at 10:54 PM, Pierre-Luc Dion <span dir="ltr"><<a href="mailto:pdion@cloudops.com" target="_blank">pdion@cloudops.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi,<div><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div></div></div></div></div></div></div></div>
<div><br></div><div>Did anyone tried using hbase as backend for Ceilometer to collect Swift Metrics.</div><div>I've setup a test environement and It collect some metrics from swift-proxy but those 3 are missings:</div><div>and I got the following trace in ceilometer-collector.log:</div><div><br></div><div><br></div><div>2015-06-12 14:53:23.741 10403 ERROR oslo_messaging.notify.dispatcher [-] Exception during message handling</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher Traceback (most recent call last):</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py", line 91, in _dispatch_and_handle_error</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher executor_callback)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py", line 134, in _dispatch</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher metadata)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/ceilometer/collector.py", line 167, in sample</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher self.dispatcher_manager.map_method(self.method, payload)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 251, in map_method</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher method_name, *args, **kwds)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 224, in map</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher self._invoke_one_plugin(response.append, func, e, args, kwds)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 255, in _invoke_one_plugin</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher response_callback(func(e, *args, **kwds))</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 229, in _call_extension_method</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher return getattr(extension.obj, method_name)(*args, **kwds)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/ceilometer/dispatcher/database.py", line 89, in record_metering_data</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher self.meter_conn.record_metering_data(meter)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/ceilometer/storage/impl_hbase.py", line 175, in record_metering_data</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher resource, ts)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/happybase/table.py", line 434, in put</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher batch.put(row, data)</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 132, in __exit__</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher self.send()</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 58, in send</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher self._<a href="http://table.name" target="_blank">table.name</a>, bms, self._timestamp, {})</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line 1588, in mutateRowsTs</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher self.recv_mutateRowsTs()</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line 1607, in recv_mutateRowsTs</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher raise x</div><div>2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher TApplicationException: Internal error processing mutateRowsTs </div><div><br></div><div><br></div><div>I've open this bug [1] as reference.</div><div><br></div><div><br></div><div>Thanks,</div><div><br></div><div><br></div><div>[1] <a href="https://bugs.launchpad.net/ceilometer/+bug/1464265" target="_blank">https://bugs.launchpad.net/ceilometer/+bug/1464265</a></div><div><br></div><div><br></div><div><br></div></div>
<br></div></div>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br></div></div></div></div>
</blockquote></div><br></div>