Open Stack

Hi Adhi,

The point is that there is a mismatch between what Nova believes exists, and what really exists on the hypervisor.  How were the instances deleted?

Check the hypervisors that each server Nova knows about - I suspect at least one is expected to exist on the XenServer for which the compute will not start.

Bob

From: Adhi Priharmanto [mailto:adhi.pri at gmail.com]
Sent: 18 May 2017 16:40
To: Bob Ball <bob.ball at citrix.com>
Cc: openstack <openstack at lists.openstack.org>; #OpenStack External Email <openstack at citrix.com>
Subject: Re: [Openstack] [Ocata-Xenserver] Nova-compute wouldn't start

hi Bob,
I don't have any vm/instance on that compute/xenserver , I'm deleted all vm since last week.

On Thu, May 18, 2017 at 6:03 PM, Bob Ball <bob.ball at citrix.com<mailto:bob.ball at citrix.com>> wrote:
Hi Adhi,

Very interesting.  I suspect that  self._get_vif_ref, below, is returning None.  This appears to be when the VM does not exist on the host - perhaps the VM was renamed, deleted, or it has been migrated to a different host and Nova’s records didn’t get updated?

I believe the issue is most likely occurring at http://git.openstack.org/cgit/openstack/nova/tree/nova/virt/xenapi/vif.py?h=15.0.4#n246 where we attempt to detect the VM based on the instance’s name in Nova’s database.
Do you have VMs on this host? They don’t have to be running (for example if the host rebooted then the VMs may exist but in a shutdown state)

Could you check that the VMs that are on the host still have the name associated with them according to Nova?
For example:
root at host~/openrc# openstack server show 3662f9b8-1303-496a-8c21-97bba312432c
…
| OS-EXT-SRV-ATTR:instance_name        | instance-0000914e                                                                                                                                                           |
…
| name                                 | dsvm-devstack-citrix-mia-nodepool-683420                                                                                                                                    |

In this case, the server has the name dsvm-devstack-citrix-mia-nodepool-683420 but on the hypervisor the VM itself has the name  instance-0000914e

Thanks,

Bob


From: Adhi Priharmanto [mailto:adhi.pri at gmail.com<mailto:adhi.pri at gmail.com>]
Sent: 18 May 2017 10:34
To: openstack <openstack at lists.openstack.org<mailto:openstack at lists.openstack.org>>
Subject: [Openstack] [Ocata-Xenserver] Nova-compute wouldn't start

Hi all,
I have openstack RDO ocata using xenserver as Hypervisor, setup manually. It works fine about 2 weeks, today my nova-compute wouldn't start and when I check the nova-compute log :
2017-05-18 16:29:24.769 10764 INFO nova.service [-] Starting compute node (version 15.0.0-1.el7)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service [req-f29142ce-c68a-4d0a-b6ff-ba5b0a67ec6a - - - - -] Error starting thread.
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service Traceback (most recent call last):
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 722, in run_service
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     service.start()
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/nova/service.py", line 144, in start
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     self.manager.init_host()
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1152, in init_host
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     self._init_instance(context, instance)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 949, in _init_instance
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     self.driver.plug_vifs(instance, net_info)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/driver.py", line 309, in plug_vifs
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     self._vmops.plug_vifs(instance, network_info)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/vmops.py", line 1959, in plug_vifs
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     self.vif_driver.plug(instance, vif, device=device)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/vif.py", line 250, in plug
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     vif_ref = self._get_vif_ref(vif, vm_ref)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/vif.py", line 42, in _get_vif_ref
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     vif_refs = self._session.call_xenapi("VM.get_VIFs", vm_ref)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/os_xenapi/client/session.py", line 200, in call_xenapi
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     return session.xenapi_request(method, args)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/os_xenapi/client/XenAPI.py", line 130, in xenapi_request
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     result = _parse_result(getattr(self, methodname)(*full_params))
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib64/python2.7/xmlrpclib.py", line 1233, in __call__
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     return self.__send(self.__name, args)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib64/python2.7/xmlrpclib.py", line 1581, in __request
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     allow_none=self.__allow_none)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib64/python2.7/xmlrpclib.py", line 1086, in dumps
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     data = m.dumps(params)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib64/python2.7/xmlrpclib.py", line 633, in dumps
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     dump(v, write)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib64/python2.7/xmlrpclib.py", line 655, in __dump
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     f(self, value, write)
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service   File "/usr/lib64/python2.7/xmlrpclib.py", line 659, in dump_nil
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service     raise TypeError, "cannot marshal None unless allow_none is enabled"
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service TypeError: cannot marshal None unless allow_none is enabled
2017-05-18 16:29:24.847 10764 ERROR oslo_service.service

Anyone can help me with this problem ?

--
Cheers,


Adhi Priharmanto
about.me/a_dhi<http://about.me/a_dhi>






+62-812-82121584<tel:+62%20812-8212-1584>




--
Cheers,


Adhi Priharmanto
about.me/a_dhi






+62-812-82121584

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20170518/8e009419/attachment.html>