[Openstack] [Kilo] Ceilometer with Hbase for Swift

Nadya Privalova nprivalova at mirantis.com
Tue Jun 16 09:27:22 UTC 2015


Hi Pierre-Luc,

>From logs it's seen that the message which was processed is

{u'read_only': False, u'instance_uuid': None, u'domain': None,
u'show_deleted': False, u'user_identity': u'- - - - -', u'project_domain':
None, u'auth_token': None, u'is_admin': True, u'user': None, u'request_id':
u'req-bf3c927f-03f4-4b64-a903-df3770cfef48', u'user_domain': None,
u'tenant': None}

So it doesn't contain resource_id. HBase needs this field to put data into
'resource' table. Anyway, we need to handle this situation properly. Thanks
for filing a bug, I will work on it.

Thanks,
Nadya


On Fri, Jun 12, 2015 at 10:54 PM, Pierre-Luc Dion <pdion at cloudops.com>
wrote:

> Hi,
>
> Did anyone tried using hbase as backend for Ceilometer to collect Swift
> Metrics.
> I've setup a test environement and It collect some metrics from
> swift-proxy but those 3 are missings:
> and I got the following trace in ceilometer-collector.log:
>
>
> 2015-06-12 14:53:23.741 10403 ERROR oslo_messaging.notify.dispatcher [-]
> Exception during message handling
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> Traceback (most recent call last):
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py",
> line 91, in _dispatch_and_handle_error
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> executor_callback)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py",
> line 134, in _dispatch
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> metadata)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/ceilometer/collector.py", line 167,
> in sample
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> self.dispatcher_manager.map_method(self.method, payload)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 251,
> in map_method
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> method_name, *args, **kwds)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 224,
> in map
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> self._invoke_one_plugin(response.append, func, e, args, kwds)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 255,
> in _invoke_one_plugin
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> response_callback(func(e, *args, **kwds))
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 229,
> in _call_extension_method
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> return getattr(extension.obj, method_name)(*args, **kwds)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/ceilometer/dispatcher/database.py",
> line 89, in record_metering_data
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> self.meter_conn.record_metering_data(meter)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/ceilometer/storage/impl_hbase.py",
> line 175, in record_metering_data
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> resource, ts)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/happybase/table.py", line 434, in put
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> batch.put(row, data)
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 132, in
> __exit__
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> self.send()
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 58, in send
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> self._table.name, bms, self._timestamp, {})
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line
> 1588, in mutateRowsTs
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> self.recv_mutateRowsTs()
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line
> 1607, in recv_mutateRowsTs
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> raise x
> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
> TApplicationException: Internal error processing mutateRowsTs
>
>
> I've open this bug [1]  as reference.
>
>
> Thanks,
>
>
> [1] https://bugs.launchpad.net/ceilometer/+bug/1464265
>
>
>
>
> _______________________________________________
> Mailing list:
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe :
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20150616/d84605c5/attachment.html>


More information about the Openstack mailing list