Open Stack

Pierre-Luc,

I'm still investigating this. Could you please share details about your
environment? Is it devstack?
You can find me in #openstack-ceilometer channel in irc, maybe it would be
faster to find out the root cause (nick _nadya_). The problem is that the
issue may be related not only to HBase.

Thanks

On Tue, Jun 16, 2015 at 3:53 PM, Pierre-Luc Dion <pdion at cloudops.com> wrote:

> Thanks Nadya,
>
> I still have my test setup in place so if there is a fix to test, I should
> be able to pretty fast.
>
> Regards,
>
>
>
> On Tue, Jun 16, 2015 at 5:27 AM, Nadya Privalova <nprivalova at mirantis.com>
> wrote:
>
>> Hi Pierre-Luc,
>>
>> From logs it's seen that the message which was processed is
>>
>> {u'read_only': False, u'instance_uuid': None, u'domain': None,
>> u'show_deleted': False, u'user_identity': u'- - - - -', u'project_domain':
>> None, u'auth_token': None, u'is_admin': True, u'user': None, u'request_id':
>> u'req-bf3c927f-03f4-4b64-a903-df3770cfef48', u'user_domain': None,
>> u'tenant': None}
>>
>> So it doesn't contain resource_id. HBase needs this field to put data
>> into 'resource' table. Anyway, we need to handle this situation properly.
>> Thanks for filing a bug, I will work on it.
>>
>> Thanks,
>> Nadya
>>
>>
>> On Fri, Jun 12, 2015 at 10:54 PM, Pierre-Luc Dion <pdion at cloudops.com>
>> wrote:
>>
>>> Hi,
>>>
>>> Did anyone tried using hbase as backend for Ceilometer to collect Swift
>>> Metrics.
>>> I've setup a test environement and It collect some metrics from
>>> swift-proxy but those 3 are missings:
>>> and I got the following trace in ceilometer-collector.log:
>>>
>>>
>>> 2015-06-12 14:53:23.741 10403 ERROR oslo_messaging.notify.dispatcher [-]
>>> Exception during message handling
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> Traceback (most recent call last):
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File
>>> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py",
>>> line 91, in _dispatch_and_handle_error
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> executor_callback)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File
>>> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py",
>>> line 134, in _dispatch
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> metadata)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/ceilometer/collector.py", line 167,
>>> in sample
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> self.dispatcher_manager.map_method(self.method, payload)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 251,
>>> in map_method
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> method_name, *args, **kwds)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 224,
>>> in map
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> self._invoke_one_plugin(response.append, func, e, args, kwds)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 255,
>>> in _invoke_one_plugin
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> response_callback(func(e, *args, **kwds))
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 229,
>>> in _call_extension_method
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> return getattr(extension.obj, method_name)(*args, **kwds)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/ceilometer/dispatcher/database.py",
>>> line 89, in record_metering_data
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> self.meter_conn.record_metering_data(meter)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/ceilometer/storage/impl_hbase.py",
>>> line 175, in record_metering_data
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> resource, ts)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/happybase/table.py", line 434, in put
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> batch.put(row, data)
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 132, in
>>> __exit__
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> self.send()
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 58, in send
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> self._table.name, bms, self._timestamp, {})
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line
>>> 1588, in mutateRowsTs
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> self.recv_mutateRowsTs()
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line
>>> 1607, in recv_mutateRowsTs
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> raise x
>>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher
>>> TApplicationException: Internal error processing mutateRowsTs
>>>
>>>
>>> I've open this bug [1]  as reference.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> [1] https://bugs.launchpad.net/ceilometer/+bug/1464265
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list:
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to     : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20150617/b5831ec8/attachment.html>