These are the nova-compute logs but I think it just catches the error from the neutron component. Any logs from neutron-server, ovs-agent, libvirt-agent?

Can you share the "openstack network show NETWORK_ID_HERE" of the network you are attaching the VM to?

On Fri, Oct 8, 2021 at 9:53 AM Midhunlal Nb <midhunlaln66@gmail.com> wrote:

Hi,

This is the log i am getting while launching a new vm

Oct 08 19:11:20 ubuntu nova-compute[7324]: 2021-10-08 19:11:20.479 7324 INFO nova.compute.manager [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Took 0.13 seconds to destroy the instance on the hypervisor.
Oct 08 19:11:21 ubuntu nova-compute[7324]: 2021-10-08 19:11:21.272 7324 INFO nova.compute.manager [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Took 0.79 seconds to detach 1 volumes for instance.
Oct 08 19:11:21 ubuntu nova-compute[7324]: 2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Failed to allocate network(s): nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Traceback (most recent call last):
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7235, in _create_guest_with_network
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     post_xml_callback=post_xml_callback)
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     next(self.gen)
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/compute/manager.py", line 479, in wait_for_instance_event
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     actual_event = event.wait()
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/eventlet/event.py", line 125, in wait
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     result = hub.switch()
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/eventlet/hubs/hub.py", line 313, in switch
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     return self.greenlet.switch()
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] eventlet.timeout.Timeout: 300 seconds
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] During handling of the above exception, another exception occurred:
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Traceback (most recent call last):
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/compute/manager.py", line 2397, in _build_and_run_instance
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     accel_info=accel_info)
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 4200, in spawn
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     cleanup_instance_disks=created_disks)
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]   File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7258, in _create_guest_with_network
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]     raise exception.VirtualInterfaceCreateException()
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
                                           2021-10-08 19:11:21.562 7324 ERROR nova.compute.manager [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3]
Oct 08 19:11:21 ubuntu nova-compute[7324]: 2021-10-08 19:11:21.566 7324 ERROR nova.compute.manager [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Build of instance 364564c2-bfa6-4354-a4da-a18a3fef43c3 aborted: Failed to allocate the network(s), not rescheduling.: nova.exception.BuildAbortException: Build of instance 364564c2-bfa6-4354-a4da-a18a3fef43c3 aborted: Failed to allocate the network(s), not rescheduling.
Oct 08 19:11:21 ubuntu nova-compute[7324]: 2021-10-08 19:11:21.569 7324 INFO os_vif [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] Successfully unplugged vif VIFBridge(active=False,address=fa:16:3e:d9:9b:c8,bridge_name='brqc130c00e-0e',has_traffic_filtering=True,id=94600cad-caec-4810-bf6a-b5b9f7a26553,network=Network(c130c00e-0ec1-47a3-9b17-cc3294b286bd),plugin='linux_bridge',port_profile=<?>,preserve_on_delete=False,vif_name='tap94600cad-ca')
Oct 08 19:11:22 ubuntu nova-compute[7324]: 2021-10-08 19:11:22.658 7324 INFO nova.compute.manager [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Took 1.09 seconds to deallocate network for instance.
Oct 08 19:11:22 ubuntu nova-compute[7324]: 2021-10-08 19:11:22.789 7324 INFO nova.compute.manager [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Detaching volume 07041181-318b-4fae-b71e-02ac7b11bca3
Oct 08 19:11:22 ubuntu nova-compute[7324]: 2021-10-08 19:11:22.894 7324 ERROR nova.virt.block_device [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] Unable to call for a driver detach of volume 07041181-318b-4fae-b71e-02ac7b11bca3 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 364564c2-bfa6-4354-a4da-a18a3fef43c3 aborted: Failed to allocate the network(s), not rescheduling.
Oct 08 19:11:22 ubuntu nova-compute[7324]: 2021-10-08 19:11:22.927 7324 ERROR nova.volume.cinder [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] Delete attachment failed for attachment 95b1c9a4-ed58-4d22-bf99-2dd14808d9fb. Error: Volume attachment could not be found with filter: attachment_id = 95b1c9a4-ed58-4d22-bf99-2dd14808d9fb. (HTTP 404) (Request-ID: req-a40b9e2c-74a1-4f14-9eda-70a4302ec9bd) Code: 404: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 95b1c9a4-ed58-4d22-bf99-2dd14808d9fb. (HTTP 404) (Request-ID: req-a40b9e2c-74a1-4f14-9eda-70a4302ec9bd)
Oct 08 19:11:22 ubuntu nova-compute[7324]: 2021-10-08 19:11:22.929 7324 WARNING nova.compute.manager [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] Failed to detach volume: 07041181-318b-4fae-b71e-02ac7b11bca3 due to Volume attachment 95b1c9a4-ed58-4d22-bf99-2dd14808d9fb could not be found.: nova.exception.VolumeAttachmentNotFound: Volume attachment 95b1c9a4-ed58-4d22-bf99-2dd14808d9fb could not be found.
Oct 08 19:11:23 ubuntu nova-compute[7324]: 2021-10-08 19:11:23.467 7324 INFO nova.scheduler.client.report [req-6e8938e0-3205-41bd-9a1d-b23c7347f6e0 791cd0d24be84ce1ae6a4e3ce805e2ec 1c2192a5c417457ea4c76ed7a55bcb2a - default default] Deleted allocation for instance 364564c2-bfa6-4354-a4da-a18a3fef43c3
Oct 08 19:11:34 ubuntu nova-compute[7324]: 2021-10-08 19:11:34.955 7324 INFO nova.compute.manager [-] [instance: 364564c2-bfa6-4354-a4da-a18a3fef43c3] VM Stopped (Lifecycle Event)
Oct 08 19:11:46 ubuntu nova-compute[7324]: 2021-10-08 19:11:46.028 7324 WARNING nova.virt.libvirt.imagecache [req-327f8ca8-a486-4240-b3f6-0b81

Thanks & Regards

Midhunlal N B

On Fri, Oct 8, 2021 at 6:44 PM Laurent Dumont <laurentfdumont@gmail.com> wrote:

There are essentially two types of networks, vlan and vxlan, that can be attached to a VM. Ideally, you want to look at the logs on the controllers and the compute node.

Openstack-ansible seems to send stuff here https://docs.openstack.org/openstack-ansible/mitaka/install-guide/ops-logging.html#:~:text=Finding%20logs,at%20%2Fopenstack%2Flog%2F.

On Fri, Oct 8, 2021 at 9:05 AM Midhunlal Nb <midhunlaln66@gmail.com> wrote:

Hi Laurent,

Thank you very much for your reply.we configured our network as per official document .Please take a look at below details.

--->Controller node configured with below interfaces

bond1,bond0,br-mgmt,br-vxlan,br-storage,br-vlan

---> Compute node

bond1,bond0,br-mgmt,br-vxlan,br-storage

I don't have much more experience in openstack,I think here we used vlan network.

Thanks & Regards

Midhunlal N B

+918921245637

On Fri, Oct 8, 2021 at 6:19 PM Laurent Dumont <laurentfdumont@gmail.com> wrote:

You will need to look at the neutron-server logs + the ovs/libviirt agent logs on the compute. The error returned from the VM creation is not useful most of the time.

Was this a vxlan or vlan network?

On Fri, Oct 8, 2021 at 8:45 AM Midhunlal Nb <midhunlaln66@gmail.com> wrote:

Hi team,

-->Successfully I installed Openstack ansible 23.1.0.dev35.

--->I logged in to  horizon and created a new network and launched a vm but I am getting an error.

Error: Failed to perform requested operation on instance "hope", the instance has an error status: Please try again later [Error: Build of instance b6f42229-06d6-4365-8a20-07df869f1610 aborted: Failed to allocate the network(s), not rescheduling.].

-->Then I checked log 

| fault                               | {'code': 500, 'created': '2021-10-08T12:26:44Z', 'message': 'Build of instance b6f42229-06d6-4365-8a20-07df869f1610 aborted: Failed to allocate the network(s), not rescheduling.', 'details': 'Traceback (most recent call last):\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7235, in _create_guest_with_network\n    post_xml_callback=post_xml_callback)\n  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__\n    next(self.gen)\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/compute/manager.py", line 479, in wait_for_instance_event\n    actual_event = event.wait()\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/eventlet/event.py", line 125, in wait\n    result = hub.switch()\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/eventlet/hubs/hub.py", line 313, in switch\n    return self.greenlet.switch()\neventlet.timeout.Timeout: 300 seconds\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/compute/manager.py", line 2397, in _build_and_run_instance\n    accel_info=accel_info)\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 4200, in spawn\n    cleanup_instance_disks=created_disks)\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7258, in _create_guest_with_network\n    raise exception.VirtualInterfaceCreateException()\nnova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/compute/manager.py", line 2219, in _do_build_and_run_instance\n    filter_properties, request_spec, accel_uuids)\n  File "/openstack/venvs/nova-23.1.0.dev42/lib/python3.6/site-packages/nova/compute/manager.py", line 2458, in _build_and_run_instance\n    reason=msg)\nnova.exception.BuildAbortException: Build of instance b6f42229-06d6-4365-8a20-07df869f1610 aborted: Failed to allocate the network(s), not rescheduling.\n'} |

Please help me with this error.

Thanks & Regards

Midhunlal N B