New nova compute nodes not correctly adding into service

Grant Morley grant at civo.com
Thu Dec 24 16:33:11 UTC 2020


Hi All,

I was wondering if anyone could point me in the right direction with an 
issue we are having adding in new compute nodes to our platform. We have 
been trying to add a few new compute nodes to increase our capacity and 
upon configuring them with OSA and them appearing to be in service we 
have noticed that no new instances are provisioning onto them. We did a 
test by disabling all compute nodes except for the new ones and an 
instance launch failed with "No valid compute hosts were found"

We have enabled debug mode on Nova and also looked at the nova-api 
containers ( scheduler, compute etc ) and it appears there is not even 
an attempt to try and launch an instance on the new hosts from what we 
can see.

The only thing we have noticed on the newly added hosts is that the 
"privsep-helper" doesn't appear to be started whereas on a working node 
it is running.

We have not changed the software versions of OpenStack or OSA, we are 
running Queens.

The newly added compute node is reporting itself back fine from what we 
can see:

  Total usable vcpus: 72, total allocated vcpus: 0 
_report_final_resource_view 
/openstack/venvs/nova-17.1.2/lib/python2.7/site-packages/nova/compute/resource_tracker.py:827
2020-12-24 16:26:32.895 6491 INFO nova.compute.resource_tracker 
[req-6c58a97e-b7cb-4987-a219-da5b1ce156f8 - - - - -] Final resource 
view: name=compute-27.openstack.local phys_ram=257826MB used_ram=2048MB 
phys_disk=30166GB used_disk=0GB total_vcpus=72 used_vcpus=0 pci_stats=[]
2020-12-24 16:26:33.022 6491 DEBUG nova.compute.resource_tracker 
[req-6c58a97e-b7cb-4987-a219-da5b1ce156f8 - - - - -] Compute_service 
record updated for compute-27:compute-27.openstack.local 
_update_available_resource 
/openstack/venvs/nova-17.1.2/lib/python2.7/site-packages/nova/compute/resource_tracker.py:767
2020-12-24 16:26:33.023 6491 DEBUG oslo_concurrency.lockutils 
[req-6c58a97e-b7cb-4987-a219-da5b1ce156f8 - - - - -] Lock 
"compute_resources" released by 
"nova.compute.resource_tracker._update_available_resource" :: held 
0.334s inner 
/openstack/venvs/nova-17.1.2/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285
2020-12-24 16:26:35.001 6491 DEBUG oslo_service.periodic_task 
[req-6c58a97e-b7cb-4987-a219-da5b1ce156f8 - - - - -] Running periodic 
task ComputeManager._poll_rebooting_instances run_periodic_tasks 
/openstack/venvs/nova-17.1.2/lib/python2.7/site-packages/oslo_service/periodic_task.py:215

Does anyone know of any other logs we can check / enable that might lead 
us in the right direction to figure out why the new hosts are not adding in?

Any help would be greatly appreciated as we are a bit stumped at the moment.

Many thanks,

-- 
Grant Morley
Site Reliability Engineer, Civo Ltd
Unit H-K, Gateway 1000, Whittle Way
Stevenage, Herts, SG1 2FP, UK
	

Visit us at www.civo.com <https://www.civo.com/> 	
	Signup for an account now > <https://www.civo.com/signup>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20201224/8286f4ae/attachment.html>


More information about the openstack-discuss mailing list