[Openstack] [Kilo] Ceilometer with Hbase for Swift

Pierre-Luc Dion pdion at cloudops.com
Tue Jun 16 11:53:22 UTC 2015


Thanks Nadya,

I still have my test setup in place so if there is a fix to test, I should
be able to pretty fast.

Regards,



On Tue, Jun 16, 2015 at 5:27 AM, Nadya Privalova <nprivalova at mirantis.com>
wrote:

> Hi Pierre-Luc,
>
> From logs it's seen that the message which was processed is
>
> {u'read_only': False, u'instance_uuid': None, u'domain': None,
> u'show_deleted': False, u'user_identity': u'- - - - -', u'project_domain':
> None, u'auth_token': None, u'is_admin': True, u'user': None, u'request_id':
> u'req-bf3c927f-03f4-4b64-a903-df3770cfef48', u'user_domain': None,
> u'tenant': None}
>
> So it doesn't contain resource_id. HBase needs this field to put data into
> 'resource' table. Anyway, we need to handle this situation properly. Thanks
> for filing a bug, I will work on it.
>
> Thanks,
> Nadya
>
>
> On Fri, Jun 12, 2015 at 10:54 PM, Pierre-Luc Dion <pdion at cloudops.com>
> wrote:
>
>> Hi,
>>
>> Did anyone tried using hbase as backend for Ceilometer to collect Swift
>> Metrics.
>> I've setup a test environement and It collect some metrics from
>> swift-proxy but those 3 are missings:
>> and I got the following trace in ceilometer-collector.log:
>>
>>
>> 2015-06-12 14:53:23.741 10403 ERROR oslo_messaging.notify.dispatcher [-]
>> Exception during message handling
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> Traceback (most recent call last):
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File
>> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py",
>> line 91, in _dispatch_and_handle_error
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> executor_callback)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File
>> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py",
>> line 134, in _dispatch
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> metadata)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/ceilometer/collector.py", line 167,
>> in sample
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> self.dispatcher_manager.map_method(self.method, payload)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 251,
>> in map_method
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> method_name, *args, **kwds)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 224,
>> in map
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> self._invoke_one_plugin(response.append, func, e, args, kwds)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 255,
>> in _invoke_one_plugin
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> response_callback(func(e, *args, **kwds))
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 229,
>> in _call_extension_method
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> return getattr(extension.obj, method_name)(*args, **kwds)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/ceilometer/dispatcher/database.py",
>> line 89, in record_metering_data
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> self.meter_conn.record_metering_data(meter)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/ceilometer/storage/impl_hbase.py",
>> line 175, in record_metering_data
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> resource, ts)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/happybase/table.py", line 434, in put
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> batch.put(row, data)
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 132, in
>> __exit__
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> self.send()
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 58, in send
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> self._table.name, bms, self._timestamp, {})
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line
>> 1588, in mutateRowsTs
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> self.recv_mutateRowsTs()
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line
>> 1607, in recv_mutateRowsTs
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> raise x
>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>> TApplicationException: Internal error processing mutateRowsTs
>>
>>
>> I've open this bug [1]  as reference.
>>
>>
>> Thanks,
>>
>>
>> [1] https://bugs.launchpad.net/ceilometer/+bug/1464265
>>
>>
>>
>>
>> _______________________________________________
>> Mailing list:
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>> Post to     : openstack at lists.openstack.org
>> Unsubscribe :
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20150616/e5c9fbb3/attachment.html>


More information about the Openstack mailing list