<div dir="ltr"><div class="gmail_default" style="font-family:tahoma,sans-serif">Hi Glynn,<br>Thanks for helping. I also started to exclude ceilometer as a culprit when I commented out the monitoring settings on the compute host and still got the error.<br>
My nova-conductor init.d file suggest that nova-conductor use nova.conf as a configuration file.<br>I double checked the nova.conf files across both controller and compute and there is no difference between them except the parameter "my_ip".</div>
<div class="gmail_default" style="font-family:tahoma,sans-serif">I might be missing a nova.conf parameter...<br><br></div><div class="gmail_extra"><div><div dir="ltr"><div><div class="gmail_default" style="font-family:tahoma,sans-serif">
Cheers,</div><br></div><font face="tahoma, sans-serif"><b style="color:rgb(51,51,51)">BUSSY Jean-Daniel</b><br><br></font></div></div><br><div class="gmail_quote">On Wed, Nov 20, 2013 at 6:34 PM, Eoghan Glynn <span dir="ltr"><<a href="mailto:eglynn@redhat.com" target="_blank">eglynn@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
Hi Jean-Daniel,<br>
<br>
That doesn't look like a ceilometer issue.<br>
<br>
Rather, IIUC it's a case of the nova-compute agent reporting an issue<br>
from the nova-conductor service when it calls out to the conductor over<br>
RPC to record the beginning of a task in the task log.<br>
<br>
Interestingly, the error message seems to suggest that the nova-conductor<br>
is using sqlite:<br>
<div class="im"><br>
DBError SQLite DateTime type only accepts Python datetime and date objects as input.<br>
<br>
</div>whereas the nova.conf you quote suggests that mysql is in use:<br>
<br>
connection = mysql://nova:password@infra-eval-03/nova<br>
<br>
Please check the config used by your nova-conductor service, as the<br>
same DB should be configured for the nova services across the board.<br>
<br>
Cheers,<br>
Eoghan<br>
<div><div class="h5"><br>
----- Original Message -----<br>
> Hi stackers!<br>
><br>
> When integrating ceilometer I experience periodic task errors on a compute<br>
> node.<br>
> I paste below my configurations, if anyone has experienced this or a clue of<br>
> what could be the cause info would be very helpful.<br>
><br>
> The error output is:<br>
> nova-compute.log======================================<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> Traceback (most recent call last):<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/periodic_task.py",<br>
> line 180, in run_periodic_tasks<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> task(self, context)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4495, in<br>
> _instance_usage_audit<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> self.host, num_instances)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 372, in<br>
> start_instance_usage_audit<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> "Instance usage audit started...")<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 279, in<br>
> task_log_begin_task<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> task_items, message)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 411, in<br>
> task_log_begin_task<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> task_items=task_items, message=message)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/rpcclient.py", line 85, in call<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> return self._invoke(self.proxy.call, ctxt, method, **kwargs)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/rpcclient.py", line 63, in _invoke<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> return cast_or_call(ctxt, msg, **self.kwargs)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/proxy.py", line<br>
> 126, in call<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> result = rpc.call(context, real_topic, msg, timeout)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/__init__.py",<br>
> line 139, in call<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> return _get_impl().call(CONF, context, topic, msg, timeout)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_kombu.py",<br>
> line 816, in call<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> rpc_amqp.get_connection_pool(conf, Connection))<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line<br>
> 574, in call<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task rv =<br>
> list(rv)<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line<br>
> 539, in __iter__<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task raise<br>
> result<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> RemoteError: Remote error: DBError SQLite DateTime type only accepts Python<br>
> datetime and date objects as input. (original cause: TypeError: SQLite<br>
> DateTime type only accepts Python datetime and date objects as input.)<br>
> 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted,<br>
> task_name, state, host, period_beginning, period_ending, message,<br>
> task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)'<br>
> [{'period_ending': u'2013-11-20T06:00:00.000000', 'state': 'RUNNING',<br>
> 'updated_at': None, 'host': u'infra-eval-06', 'task_items': 2, 'task_name':<br>
> u'instance_usage_audit', 'period_beginning': u'2013-11-20T05:00:00.000000',<br>
> 'message': u'Instance usage audit started...', 'deleted_at': None}]<br>
> 2013-11-20 15:01:46.068 22480 TRACE nova.openstack.common.periodic_task<br>
> [u'Traceback (most recent call last):\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line<br>
> 461, in _process_data\n **args)\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py",<br>
> line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt,<br>
> **kwargs)\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 471, in<br>
> task_log_begin_task\n message)\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 1891, in<br>
> task_log_begin_task\n message)\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 108, in<br>
> wrapper\n return f(*args, **kwargs)\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 5435, in<br>
> task_log_begin_task\n task.save()\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/models.py",<br>
> line 53, in save\n session.flush()\n', u' File<br>
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/session.py",<br>
> line 543, in _wrap\n raise exception.DBError(e)\n', u"DBError: SQLite<br>
> DateTime type only accepts Python datetime and date objects as input.<br>
> (original cause: TypeError: SQLite DateTime type only accepts Python<br>
> datetime and date objects as input.) 'INSERT INTO task_log (created_at,<br>
> updated_at, deleted_at, deleted, task_name, state, host, period_beginning,<br>
> period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?,<br>
> ?, ?, ?, ?)' [{'period_ending': u'2013-11-20T06:00:00.000000', 'state':<br>
> 'RUNNING', 'updated_at': None, 'host': u'infra-eval-06', 'task_items': 2,<br>
> 'task_name': u'instance_usage_audit', 'period_beginning':<br>
> u'2013-11-20T05:00:00.000000', 'message': u'Instance usage audit<br>
> started...', 'deleted_at': None}]\n"].<br>
> ===========================================<br>
><br>
> My nova.conf is:<br>
> nova.conf===========================================<br>
> [DEFAULT]<br>
> dhcpbridge_flagfile=/etc/nova/nova.conf<br>
> dhcpbridge=/usr/bin/nova-dhcpbridge<br>
> logdir=/var/log/nova<br>
> state_path=/var/lib/nova<br>
> lock_path=/var/lock/nova<br>
> force_dhcp_release=True<br>
> iscsi_helper=tgtadm<br>
> libvirt_use_virtio_for_bridges=True<br>
> connection_type=libvirt<br>
> root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf<br>
> verbose=False<br>
> debug=False<br>
> ec2_private_dns_show_ip=True<br>
> api_paste_config=/etc/nova/api-paste.ini<br>
> volumes_path=/var/lib/nova/volumes<br>
> enabled_apis=ec2,osapi_compute,metadata<br>
> connection = mysql://nova:password@infra-eval-03/nova<br>
> my_ip=192.168.1.26<br>
> vncserver_listen=0.0.0.0<br>
> vncserver_proxyclient_address=172.16.1.16<br>
> rpc_backend = nova.rpc.impl_kombu<br>
> rabbit_host = infra-eval-03<br>
> glance_host = infra-eval-03<br>
> network_api_class=nova.network.neutronv2.api.API<br>
</div></div>> neutron_url= <a href="http://infra-eval-03:9696" target="_blank">http://infra-eval-03:9696</a><br>
> neutron_auth_strategy=keystone<br>
> neutron_admin_tenant_name=service<br>
> neutron_admin_username=neutron<br>
> neutron_admin_password=password<br>
> neutron_admin_auth_url= <a href="http://infra-eval-03:35357/v2.0" target="_blank">http://infra-eval-03:35357/v2.0</a><br>
<div><div class="h5">> firewall_driver=nova.virt.firewall.NoopFirewallDriver<br>
> ===========================================<br>
><br>
> My ceilometer conf file is:<br>
> ceilometer.conf===========================================<br>
> [DEFAULT]<br>
> sqlite_db=ceilometer.sqlite<br>
> log_dir=/var/log/ceilometer<br>
> rabbit_host=infra-eval-03<br>
> [publisher_rpc]<br>
> metering_secret=password<br>
> [ssl]<br>
> [database]<br>
> connection = mongodb://ceilometer:password@infra-eval-03:27017/ceilometer<br>
> [alarm]<br>
> [rpc_notifier2]<br>
> [api]<br>
> [service_credentials]<br>
> [dispatcher_file]<br>
> [keystone_authtoken]<br>
> auth_host = infra-eval-03<br>
> auth_port = 35357<br>
> auth_protocol = http<br>
> admin_tenant_name = service<br>
> admin_user = ceilometer<br>
> admin_password = password<br>
> auth_uri = <a href="http://192.168.1.23:5000" target="_blank">http://192.168.1.23:5000</a><br>
> [collector]<br>
> [matchmaker_ring]<br>
> [matchmaker_redis]<br>
> ===========================================<br>
><br>
> regards<br>
><br>
><br>
> BUSSY Jean-Daniel<br>
><br>
><br>
</div></div>> _______________________________________________<br>
> Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
> Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
> Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
><br>
</blockquote></div><br></div></div>