Open Stack

Hi,

Dnia czwartek, 9 czerwca 2022 10:58:46 CEST tim+openstack.org at coote.org pisze:
> Hullo
> I’m trying to spin up a simple OS environment in  a single vm and think that I’m making some silly mistake, but cannot spot it. Any hints would be greatly expected. I’ve tried this on a couple of laptops, with the same result, so I suspect that it’s something to do with how I’ve set up my vm, but I cannot identify it. (I think that there may be a few other devstack issues, but I’ve got to get it working to log any bugs).
> 
> I’m using a vagrant box and VirtualBox on x86 Macs (Monterey), and the devstack install/build process. Everything seems to install, but when I try:
> 
> `openstack server create --flavor 42 --image cirros-0.5.2-x86_64-disk --nic net-id=2a1a4a3a-a47b-48bd-a7df-c90fc75a1c63 --security-group default wibble`
> 
> The network id is identified from this:
> “”"
> [vagrant at localhost devstack]$ openstack network list
> +--------------------------------------+---------+----------------------------------------------------------------------------+
> | ID                                   | Name    | Subnets                                                                    |
> +--------------------------------------+---------+----------------------------------------------------------------------------+
> | 205fa7d7-7067-4f63-b3d9-6a9b37b4f11f | public  | 1bbbfa3c-8e0a-483f-a084-4e38241b3315, eecfc603-c057-4b28-90bd-950a47345410 |
> | 2a1a4a3a-a47b-48bd-a7df-c90fc75a1c63 | private | e7377bed-3e22-4e8d-9c2d-ea7ba740fcfd, f915b88c-9988-4e1f-9060-a6295465699a |
> | fab3fb15-cbd2-45fe-8451-3f0063d59454 | shared  | 97e6d8e6-0f57-48bc-8f1d-e30587086153                                       |
> +--------------------------------------+---------+——————————————————————————————————————+
> “””
> 
> Using a public network fails with an error that this isn’t allowed.
> 
> With the private network above, the failure throws out the following errors.
> “”"
> [vagrant at localhost devstack]$ sudo journalctl -f |grep ERROR
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [None req-01294678-b54a-4e40-964c-488ccf03d66c demo demo] [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Instance failed to spawn: nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last):
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7510, in _create_guest_with_network
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     guest = self._create_guest(
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     next(self.gen)
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 556, in wait_for_instance_event
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     self._wait_for_instance_events(
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 468, in _wait_for_instance_events
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     actual_event = event.wait()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 433, in wait
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     instance_event = self.event.wait()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/usr/local/lib/python3.9/site-packages/eventlet/event.py", line 125, in wait
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     result = hub.switch()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/usr/local/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     return self.greenlet.switch()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] eventlet.timeout.Timeout: 300 seconds
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] 
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] During handling of the above exception, another exception occurred:
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] 
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last):
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 2728, in _build_resources
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     yield resources
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 2487, in _build_and_run_instance
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     self.driver.spawn(context, instance, image_meta,
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4344, in spawn
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     self._create_guest_with_network(
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7528, in _create_guest_with_network
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     raise exception.VirtualInterfaceCreateException()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] 
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [None req-01294678-b54a-4e40-964c-488ccf03d66c demo demo] [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Failed to allocate network(s): nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last):
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7510, in _create_guest_with_network
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     guest = self._create_guest(
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     next(self.gen)
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 556, in wait_for_instance_event
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     self._wait_for_instance_events(
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 468, in _wait_for_instance_events
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     actual_event = event.wait()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 433, in wait
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     instance_event = self.event.wait()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/usr/local/lib/python3.9/site-packages/eventlet/event.py", line 125, in wait
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     result = hub.switch()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/usr/local/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     return self.greenlet.switch()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] eventlet.timeout.Timeout: 300 seconds
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] 
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] During handling of the above exception, another exception occurred:
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] 
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last):
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/compute/manager.py", line 2487, in _build_and_run_instance
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     self.driver.spawn(context, instance, image_meta,
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4344, in spawn
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     self._create_guest_with_network(
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7528, in _create_guest_with_network
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315]     raise exception.VirtualInterfaceCreateException()
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] 
> Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [None req-01294678-b54a-4e40-964c-488ccf03d66c demo demo] [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Build of instance 20e1b5bf-130a-48f9-af4e-9b4c7a475315 aborted: Failed to allocate the network(s), not rescheduling.: nova.exception.BuildAbortException: Build of instance 20e1b5bf-130a-48f9-af4e-9b4c7a475315 aborted: Failed to allocate the network(s), not rescheduling.
> “”"
> 
> The Vagrantfile (commented out lines relate to trying this with Ubunutu, which failed the same way, and attempts to use multiple vms):
> “”"
> # -*- mode: ruby -*-
> # vi: set ft=ruby :
> 
> $script = <<-SHELL
> dnf update -y
> #apt update
> #apt upgrade 
> echo "updated"
> systemctl disable firewalld
> systemctl stop firewalld
> systemctl disable NetworkManager
> systemctl stop NetworkManager
> systemctl enable network
> systemctl start network
> #dnf config-manager --enable powertools
> #dnf install -y centos-release-openstack-yoga
> dnf update -y
> dnf install -y git python3-pip
> #dnf install -y openstack-packstack
> #packstack --provision-demo=n --os-neutron-ml2-type-drivers=vxlan,flat,vlan --gen-answer-file=packstack-answers.txt
> #sed -i -e 's:10.0.2.15:10.1.0.10:' packstack-answers.txt
> # not for centos 9 
> #dnf install -y network-scripts
> dnf install -y net-tools
> #cat /vagrant/answers.addon >> packstack-answers.txt
> # don't want this, but httpd won't start without it
> setenforce 0
> pip3 install invoke
> #packstack --allinone
> cd /vagrant
> # permissions all wrong: ./go.sh  # need su - vagrant cd /vagrant && ./go.sh (?)
> # cd devstack
> # not working: wrong user ./stack.sh
> SHELL
> 
> Vagrant.configure(2) do |config|
> 
>   config.vm.box = "eurolinux-vagrant/centos-stream-9"
>   #config.vm.box = "hashicorp/bionic64"
> 
> #  machines = {
> #    'node1.example.dd'
>     #'node1.example.dd'    => { :ip => '10.1.0.10'},
>   #  'node2.example.dd'    => { :ip =>'10.1.0.12'},
> #  }
> 
>   config.hostmanager.enabled = true
>   config.hostmanager.manage_host = true
>   config.hostmanager.manage_guest = true
>   config.hostmanager.ignore_private_ip = false
>   config.hostmanager.include_offline = true
> 
>   config.ssh.pty = true
> 
>   config.vm.provision "shell", inline: $script
> 
>   config.vm.network "forwarded_port", guest: 80, host: 8080
> 
> #  machines.each do | hostname, attrs|
> #    config.vm.define hostname do |machine|
> #      machine.vm.hostname = hostname
> #      machine.vm.network :private_network, :ip => attrs[:ip]
> 
> #      machine.vm.provider "virtualbox" do | v |
>       config.vm.provider "virtualbox" do | v |
>         #v.memory = "4096"
>         #v.memory = "8192"
>         v.memory = "9216"
>         v.cpus = "2"
>       end
> 
>     #end
> #  end
> end
> “””
> 
> I think that the vm has enough RAM, although there is minimal swap being used, but I think that this is not significant as there is much more RAM used for caching files.
> 
> Any obvious hints as to why the spin up fails to create the NIC - or somewhere to look for further and better details?
> 
> Tim
> 

This is some issue in neutron while provisioning port. Please check neutron server and neutron agents logs (depending on You backend it can be neutron-ovs-agent and neutron-dhcp-agent, or in case of OVN most of the things You will find in the neutron-server logs).


-- 
Slawek Kaplonski
Principal Software Engineer
Red Hat
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: This is a digitally signed message part.
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20220614/e51879d5/attachment.sig>