- openstack-discuss - lists.openstack.org

[kolla-ansible][xena] Facing network issue when providing SR-IOV support
by Harshit Mishra 22 Jun '22

22 Jun '22

Hi! I have deployed Openstack Xena using kolla-ansible (v13.0.1) on a multi-node setup (1 controller+network, multiple computes). On this cluster I would like to have support for normal, as well as direct (SR-IOV) vNIC types. I have done all the pre-requirement like configure VF on SR-IOV network interface. In the current deployment, I have created two physnets, one for flat network (called physnet1 on br-ex), and one for SR-IOV (called sriovnet1 on Intel 10G 2P X520 card). I am creating one network of VXLAN type for normal vNIC, and one of VLAN type on sriovnet1 (called sriov_network) for direct vNIC. Mapping of PF with provider in sriov-agent.ini: # cat /etc/kolla/neutron-sriov-agent/sriov_agent.ini [sriov_nic] physical_device_mappings = sriovnet1:enp8s0f1 exclude_devices = [securitygroup] firewall_driver = neutron.agent.firewall.NoopFirewallDriver ---------------------------------------------- ml2_conf.ini on controller node: # cat /etc/kolla/neutron-server/ml2_conf.ini [ml2] type_drivers = flat,vlan,vxlan tenant_network_types = vxlan,vlan,flat mechanism_drivers = openvswitch,l2population,sriovnicswitch extension_drivers = port_security [ml2_type_vlan] network_vlan_ranges = physnet1,sriovnet1:1000:1009 [ml2_type_flat] flat_networks = physnet1,sriovnet1 [ml2_sriov] agent_required = False supported_pci_vendor_devs = 8086:10ed [ml2_type_vxlan] vni_ranges = 1:1000 ---------------------------------------------- # grep -nr enabled_filters /etc/kolla/nova-scheduler/ /etc/kolla/nova-scheduler/nova.conf:13:enabled_filters = ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter,SameHostFilter,DifferentHostFilter,AggregateInstanceExtraSpecsFilter,PciPassthroughFilter ---------------------------------------------- # grep passthrough /etc/kolla/nova-compute/nova.conf passthrough_whitelist = [{"physical_network": "sriovnet1", "devname": "enp8s0f1"}] The interfaces on VMs from normal vNICs are able to communicate inter-compute. The same is not working for the direct vNICs belonging to the sriov_network. I have tried multiple config changes, but none seem to work. Please help in solving this issue, or suggest a different way of achieving this if this is wrong or not optimal. Thanks! Regards, Harshit Mishra

1 0

[Dev] [Skyline] Boot from Image directly
by Oezcan Isik 21 Jun '22

21 Jun '22

Hi, Will Skyline support boot from image directly during instance creation. Instead of choosing a system disk (volume) every time. Kind Regards, -- Ozcan Isik Software Engineer STAG CERN IT

2 1

[TripleO] no more patches for tripleo stable/victoria please (going EOL)
by Marios Andreou 21 Jun '22

21 Jun '22

Hello o/ as proposed at [1][2] we are moving ahead with transitioning stable/victoria tripleo repos to End Of Life. In order to do this we need to have no open patches against stable/victoria. So please stop posting new patches for tripleo stable/victoria and if you have open patches please merge or abandon these by next Tuesday 21st June (for reference, list of repos with currently open patches at [3]). No problem if someone needs a few more days we can wait just please reach out here or on irc. If there are no such requests then I will abandon all open reviews on 21st and respin [2] to pick up any new commits between now and then. thanks for your help, marios [1] http://lists.openstack.org/pipermail/openstack-discuss/2022-June/028829.html [2] https://review.opendev.org/c/openstack/releases/+/845148 [3] (list of repos with open reviews): * https://review.opendev.org/q/project:openstack%252Fos-net-config+status:ope… * https://review.opendev.org/q/project:openstack%252Fpython-tripleoclient+sta… * https://review.opendev.org/q/project:openstack%252Ftripleo-ansible+status:o… * https://review.opendev.org/q/project:openstack%252Ftripleo-common+status:op… * https://review.opendev.org/q/project:openstack%252Ftripleo-heat-templates+s… * https://review.opendev.org/q/project:openstack%252Ftripleo-image-elements+s… * https://review.opendev.org/q/project:openstack%252Ftripleo-puppet-elements+… * https://review.opendev.org/q/project:openstack%252Ftripleo-validations+stat…

4 8

Propose to add Takashi Kajinami as heat core reviewer
by Rico Lin 21 Jun '22

21 Jun '22

Hi all I want to suggest adding Takashi Kajinami <tkajinam(a)redhat.com> as heat core reviewer. Who help provide valid reviews and fixes for issues on heat. Will be great to have Takashi Kajinami join heat core reviewer team and help. *Rico Lin*

4 4

Re: Regarding Floating IP is existing Setup
by Eugen Block 21 Jun '22

21 Jun '22

Could this be a race condition? I saw something similar, too, when a user tried to attach floating IPs via terraform or ansible (I'm not quite sure) at the same time to two different VMs. We could trace it in the Logs that the port was first attached to the first instance and then failed for the other. I don't recall if they use a workaround at the moment or if just works now, will need to check with them. If this is a race condition can you do anything about it in Heat? Like some sort of delay? It could be a bug, though. Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: > Hi Eugen, > > These are orchestration Heat templates, if there is a Single FLoating IP > creation using this templates it works fine, But if there are multiple > floating IP attachment it shows there is a issue on 2 to 3 floating IP > attached to the instance > > Regards > Adivya Singh > > On Tue, Jun 21, 2022 at 5:59 PM Eugen Block <eblock(a)nde.ag> wrote: > >> Do you have ha routers enabled? >> >> > Most of the template having issue , Have all instance having FLoating >> IP, a >> > Stack with a single floating IP have chance of issue very less >> >> I don't quite understand that sentence, could you please clarify? >> >> Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: >> >> > hi Eugen, >> > >> > The current setup is 3 controller nodes, The Load is not much on each >> > controller and the number of DHCP agent is always set to 2 as per the >> > standard in the neutron.conf, The L3 agent seems to be stables as other >> > router namespace works fine under it, Only few router Namespace get >> > affected under the agent. >> > >> > Most of the template having issue , Have all instance having FLoating >> IP, a >> > Stack with a single floating IP have chance of issue very less >> > >> > Regards >> > Adivya Singh >> > >> > On Tue, Jun 21, 2022 at 1:18 PM Eugen Block <eblock(a)nde.ag> wrote: >> > >> >> Hi, >> >> >> >> this sounds very familiar to me, I had to deal with something similar >> >> a couple of times in a heavily used cluster with 2 control nodes. What >> >> does your setup look like, is it a HA setup? I would start checking >> >> the DHCP and L3 agents. After increasing dhcp_agents_per_network to 2 >> >> in neutron.conf and restarting the services this didn't occur again >> >> (yet). This would impact floating IPs as well, sometimes I had to >> >> disable and enable the affected router(s). If you only have one >> >> control node a different approach is necessary. Do you see a high load >> >> on the control node? >> >> >> >> >> >> Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: >> >> >> >> > hi Team, >> >> > >> >> > We got a issue in Xena release, where we set the environment in Ubuntu >> >> > Platform, But later we get some issues in Floating IP not reachable. >> >> > >> >> > In a Network node, not all router namespace are Impacted and only few >> of >> >> > them get affected, So we can not comment Network node has a issue. >> >> > >> >> > The L3 agent where the Router is tied up, Worked just fine, as other >> >> > routers work Fine. >> >> > >> >> > and the one having issue in Floating IP, if i unassigned and assigned >> it >> >> > starts working most of the time. >> >> > >> >> > Any thoughts on this >> >> > >> >> > Regards >> >> > Adivya Singh >> >> >> >> >> >> >> >> >> >> >> >> >> >> >>

1 0

[Tripleo] - IPv6 Wallaby Undercloud Installation failure
by Anirudh Gupta 21 Jun '22

21 Jun '22

Hi Team, I am trying to deploy Openstack Wallaby Undercloud on IPv6, but facing the below error: 2022-06-14 05:01:23.213708 | 52540083-cfa2-3f20-e9dc-00000000286f | TASK | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_4 2022-06-14 05:03:22.912816 | 52540083-cfa2-3f20-e9dc-00000000286f | FATAL | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_4 | undercloud | error={"changed": false, "msg": "Service ironic_pxe_tftp has not started yet"} 2022-06-14 05:03:22.914400 | 52540083-cfa2-3f20-e9dc-00000000286f | TIMING | tripleo_container_manage : Manage container systemd Sample Undercloud.conf is as follows: [DEFAULT] clean_nodes = true cleanup = false container_cli = podman container_healthcheck_disabled = true container_images_file = /home/stack/containers-prepare-parameter.yaml deployment_user = stack enable_ironic = true enable_ironic_inspector = true enable_neutron = true enable_routed_networks = false generate_service_certificate = false ipv6_address_mode = dhcpv6-stateful ipxe_enabled = true local_interface = enp8s0 local_ip = aaaa:aaaa:aaaa::1/64 subnets = ctlplane-subnet undercloud_admin_host = aaaa:aaaa:aaaa::1 undercloud_hostname = undercloud.com undercloud_ntp_servers = 30.30.30.3 undercloud_public_host = aaaa:aaaa:aaaa::1 undercloud_timezone = UTC [ctlplane-subnet] cidr = aaaa:aaaa:aaaa::/64 dhcp_end = aaaa:aaaa:aaaa::f dhcp_start = aaaa:aaaa:aaaa::a gateway = aaaa:aaaa:aaaa::1 inspection_iprange = aaaa:aaaa:aaaa::3,aaaa:aaaa:aaaa::9 Can someone please help in this regard. Anirudh Gupta

7 21

[nova] custom metric for weigh scheduling
by Arnaud Morin 21 Jun '22

21 Jun '22

Hey nova team, Some context: I want nova-scheduler to favor instances on some computes based on some hypervisor metrics/traits. E.G. I have 2 hypervisors hosting few instances. One of them is having an old kernel, that I will upgrade some day. The second is already having the correct target kernel. I want the scheduler to favor booting on the second host (good kernel). How can I achieve that without disabling the bad_kernel hypervisor? I was thinking about something in the weight scheduler. I was first thinking about using placement traits (having a custom traits) and reading traits from a weight scheduler. But it seems not doable out of the box. And it also seems not a good idea at all to call placement API from weight scheduler. Maybe I am missing something here because I was expecting to have the traits given by placement up to the nova scheduler. Second shoot, I found the metrics weight [1] which rely on the compute monitors. It seems less hacky, but I will still have to write custom monitor to retrieve such metrics. Am I missing an option here? Is there anyone doing such thing is the community? [1] https://github.com/openstack/nova/blob/master/nova/scheduler/weights/metric… [2] https://github.com/openstack/nova/tree/master/nova/compute/monitors Cheers, Arnaud.

1 0

Re: Few Open Questions: Openstack vs Proprietary cloud stacks
by Lazuardi Nasution 21 Jun '22

21 Jun '22

> > > Hi Krish, Please find inline comment based my experience on banking implementation. Best regards. > Date: Tue, 21 Jun 2022 12:29:01 +0530 > From: KK CHN <kkchn.in(a)gmail.com> > To: openstack-discuss(a)lists.openstack.org > Subject: Few Open Questions: Openstack vs Proprietary cloud stacks > Message-ID: > <CAKgGyB8L-tQKR49Ru4tqCzox5C5o57sJZ+LbfHUpxBu== > ecxyQ(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > List, > > Very recently I came across a discussion with a banking corporation who > are heavy users of VMware in all their Data Centre operations .. > > They asked me a lot of questions in comparison with openstack vs other > proprietary vendors (such as VMware. ). > > > As I am promoting OpenStack I need to clarify these questions raised by > the organization. > > I request your inputs for these queries . > > 1. Does OpenStack support Hyper Converged Infrastructure ? > Or any HCI vendors already with OpenStack solutions? Please share the > URL/link of case studies of OpenStack HCI. > Any documentation/Reference to install openstack as HCI solution with > supported H/W OEM details . I can try out ... > Yes, I have experienced with HCI by using OpenStack and Ceph. > 2. Is there any performance benchmark for openstack to compare with other > such cloud stacks ( URL/reference links kindly share ) > I have done some performance test by using CBTool which is the corr of SPEC Cloud IaaS benchmark. So, so the result can be compared with published SPEC Cloud IaaS result as long it has same benchmark parameters. > 3. What is the market share of OpenStack all over the world ? ( If any > statistics kindly share.) > Any survey reports available how many large and medium organizations are > using Openstack distributions for private/public cloud use in production ? > Maybe you can refer to OpenStack surveys. It seem that on any forms (including customized), OpenStack os popular for public cloud. > 4. Does OpenStack new versions support VDI(Virtual Desktop Infrastructure) > solutions out of the box.? pls give a reference link / url for the same. > Actually, VDI consists managed desktop VMs. I haven't use it but maybe Guacamole can be used for VDI on OpenStack. > 5. What is the alternative for VROPS and VRA (including self service > capabilities, Blueprint/Template based deployment) in OpenStack and any > comparative study on the capabilities available. ( Please share inputs if > any to refer. ) > OpenStack includes self service capability. Yes, it has template based deployment like Heat and catalog based deployment like Murano. > 6. What is the alternative of VMWARE Network Insights and VMWARE > CodeStream and Vrealize Loginsights in OpenStack ? > I use other open source products for monitoring and log analysis. Somethink like Prometheus, Loki, etc. > 7. Any major capability available in VMware cloud stack for which > alternative is not available in OpenStack out of the box ? > I have no idea about this. But it is hard to have apple to apple comparison. > 8. Tools to maintain multiple OpenStack Cluster, any concept of > Supervisory cluster available There are some cloud management products which are compatible with OpenStack. But for me, Ansible and/or BASH scripting are good enough. > 9. Who all are the large organizations who deployed OpenStack as their > alternative over proprietary solutions(eg: VMware cloud and virtualization > products ..) > I have no idea with this. > 10. Does OpenInfra Foundation also provide direct support For OpenStack > Deployment ? If yes Kindly share the link / url where to contact > /approach for paid support ? in case the clients need paid support ? > It seem OpenInfra doesn't, but OpenInfra member do. CMIIW. > > 11. Regarding security of cloud environments /infrastructure, what are the > USPs of OpenStack cloud security over other competing cloud middleware > providers ? and the vulnerability handling model/mechanism in production ? > On OpenStack, every tenants can be fully isolated. Anyway, some security products may have another approach to enhance the security. Floating IP concept is good for hiding non service (externally) instance. > Thanks in advance for your invaluable inputs. > > Each and every input from each member is valuable for me to showcase as > solid proofs to defend and promote the openstack over proprietary market > leaders. > > Krish >

1 0

[cinder] cinder backup benji driver.
by Jesper Schmitz Mouridsen 20 Jun '22

20 Jun '22

Hi, I have been looking into using benji-backup[1] in a cinder-backup driver[2]. I have not tested it thoroughly enough yet, but both in devstack and in a multinode setup.(focal victoria). On devstack I get a newer sqlalchemy that satisfies Benji's requirements list. I have not found issues with downgrading Benji to use an earlier version of sqlalchemy found in canonical focal repos. But that also needs some testing. I asked the author of Benji why he chose a version as high as he did. So just a little info about this work. Any comments on the idea? Thanks. Jesper Schmitz Mouridsen. [1] https://benji-backup.me/ [2] https://github.com/jsm222/cinder-backup-benji-driver

1 0

[neutron] CI meeting 21.06 cancelled
by Slawek Kaplonski 20 Jun '22

20 Jun '22

Hi, I will be on PTO this Tuesday and I will not be able to run Neutron CI meeting. We don't have anything really urgent what can't wait one week more so lets cancel this week's meeting. See You on the Neutron CI meeting next week. -- Slawek Kaplonski Principal Software Engineer Red Hat

1 0

[kolla][monasca] No more Monasca for AArch64? Or Ubuntu?
by Marcin Juszkiewicz 20 Jun '22

20 Jun '22

Monasca bumped confluent-kafka-python to newer version. And that generates side effects on AArch64 (all distributions Kolla supports) and on Ubuntu 22.04 (any architecture). Why? #error "confluent-kafka-python requires librdkafka v1.9.0 or later. Install the latest version of librdkafka from the Confluent repositories, see http://docs.confluent.io/current/installation.html" Debian/stable has 1.6.0, Ubuntu/22.04 has 1.8.0 versions. On x86-64 architecture we can fetch wheel files for CentOS Stream 8, CentOS Stream 9, Debian/stable and Ubuntu/20.04 as they use Python 3.6/3.8/3.9 versions for which there are wheel files provided by upstream. On Ubuntu 22.04 we have Python 3.10 for which there is no wheel file from upstream... Sure, on x86-64 we can use extra repository from upstream and build 'confluent-kafka-python' from source. And probably we will go that way later in a cycle. But on AArch64 we have no other way than disabling build of Monasca. There is no way to satisfy dependency :( https://review.opendev.org/c/openstack/kolla/+/846800

1 0

[Neutron] What is the best tool for automated data plane testing with openstack?
by ROBERTO BARTZEN ACOSTA 20 Jun '22

20 Jun '22

Hey there, I'm using OpenStack(old version) with neutron OVN CMS-plugin and I need to migrate to the Yoga release (Ubuntu ovn v22.03.0 and ovs v2.17.0). I'm interested in validating a series of fixed issues on openvswitch and ovn in the releases related to the OpenStack Yoga version (e.g. https://github.com/ovn-org/ovn/commit/ccbbbd0584e52c2aa88436a431fe7a6deffd2… ). What OpenStack automated testing tool do you use or recommend to validate the data plane? Best regards Roberto -- _‘Esta mensagem é direcionada apenas para os endereços constantes no cabeçalho inicial. Se você não está listado nos endereços constantes no cabeçalho, pedimos-lhe que desconsidere completamente o conteúdo dessa mensagem e cuja cópia, encaminhamento e/ou execução das ações citadas estão imediatamente anuladas e proibidas’._ * **‘Apesar do Magazine Luiza tomar todas as precauções razoáveis para assegurar que nenhum vírus esteja presente nesse e-mail, a empresa não poderá aceitar a responsabilidade por quaisquer perdas ou danos causados por esse e-mail ou por seus anexos’.*

4 4

[sdk] Question about openstacksdk
by pspal83＠hotmail.com 20 Jun '22

20 Jun '22

Hi All, I am new to OpenStack SDA API and I need help. While I am running my basic py file I am always getting the below error, Please suggest. Code: import openstack conn = openstack.connect(cloud='openstack') for server in conn.compute.servers(): print(server.to_dict()) Error: [pke@vm01 ~]$ python openstack-connect.py Traceback (most recent call last): File "openstack-connect.py", line 7, in <module> for server in conn.compute.servers(): File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 87, in __get__ proxy = self._make_proxy(instance) File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 262, in _make_proxy found_version = temp_adapter.get_api_major_version() File "/usr/local/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 354, in get_api_major_version return self.session.get_api_major_version(auth or self.auth, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1276, in get_api_major_version return auth.get_api_major_version(self, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 500, in get_api_major_version data = get_endpoint_data(discover_versions=discover_versions) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data service_catalog = self.get_access(session).service_catalog File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 134, in get_access self.auth_ref = self.get_auth_ref(session) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref return self._plugin.get_auth_ref(session, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref authenticated=False, log=False, **rkwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1149, in post return self.request(url, 'POST', **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 986, in request raise exceptions.from_response(resp, method, url)keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-0e898e09-0dbc-4beb-8414-8dcdc4f6631e) RegardsPradeep Kumar On Monday, 20 June, 2022, 04:54:19 pm IST, pspal83(a)hotmail.com <pspal83(a)hotmail.com> wrote: Hi All, I am new to OpenStack SDA API and I need help. While I am running my basic py file I am always getting the below error, Please suggest. Code: import openstack conn = openstack.connect(cloud='openstack') for server in conn.compute.servers(): print(server.to_dict()) Error: [pke@vm01 ~]$ python openstack-connect.py Traceback (most recent call last): File "openstack-connect.py", line 7, in <module> for server in conn.compute.servers(): File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 87, in __get__ proxy = self._make_proxy(instance) File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 262, in _make_proxy found_version = temp_adapter.get_api_major_version() File "/usr/local/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 354, in get_api_major_version return self.session.get_api_major_version(auth or self.auth, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1276, in get_api_major_version return auth.get_api_major_version(self, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 500, in get_api_major_version data = get_endpoint_data(discover_versions=discover_versions) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data service_catalog = self.get_access(session).service_catalog File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 134, in get_access self.auth_ref = self.get_auth_ref(session) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref return self._plugin.get_auth_ref(session, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref authenticated=False, log=False, **rkwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1149, in post return self.request(url, 'POST', **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 986, in request raise exceptions.from_response(resp, method, url)keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-0e898e09-0dbc-4beb-8414-8dcdc4f6631e) RegardsPradeep Kumar

3 3

[neutron] bug deputy report June 13th to 19th
by Miguel Lavalle 19 Jun '22

19 Jun '22

Hi, Here's this week's bugs deputy report: Requires follow up ============== https://bugs.launchpad.net/neutron/+bug/1979089 l3ha router delete race condition if state changes to master. Waiting for more info from reporter High ==== https://bugs.launchpad.net/neutron/+bug/1978938 [9-stream][master][yoga] ovs/ovn fips jobs fails randomly with DNS issue. Assigned to Yatin Karel. Proposed fix: https://review.opendev.org/c/openstack/neutron/+/846001 Medium ====== https://bugs.launchpad.net/neutron/+bug/1978571 VPNaaS: creating ipsec site connection fails (in master). Assigned to Bodo Petermann. Proposed fix: https://review.opendev.org/c/openstack/neutron-vpnaas/+/845759 https://bugs.launchpad.net/neutron/+bug/1979072 Duplicated port binding registers per port, due to live-migration failures. Assigned to Rodolfo Alonso. Proposed fix: https://review.opendev.org/c/openstack/neutron/+/846422 https://bugs.launchpad.net/neutron/+bug/1979002 DVR router takes too long to learn octavia LB VIP. Unassigned. We may need help from Octavia team RFE === https://bugs.launchpad.net/neutron/+bug/1979044. [RFE] Adding the "rekey" parameter to the api for strongswan like "dpd_action". This is really for vpnass and requires further triaging Incomplete ======== https://bugs.launchpad.net/neutron/+bug/1978775 ovn: ovs-system: deferred action limit reached, drop recirc action. Waiting for more info from reporter

1 0

Re: [ceph-users] Suggestion to build ceph storage
by Satish Patel 19 Jun '22

19 Jun '22

Sent from my iPhone > On Jun 18, 2022, at 10:47 AM, Anthony D'Atri <anthony.datri(a)gmail.com> wrote: > > Please do not CC the list. It was my mistake, sorry about that. > >> 15 Total servers and each server has a 12x18TB HDD (spinning disk) . We >> understand SSD/NvME would be best fit but it's way out of budget. > > NVMe SSDs can be surprisingly competitive when you consider IOPS/$, density, and the cost of the HBA you don’t need. Yes totally and I have only single slot to mount one NvME on motherboard. Let’s say I want to put single M.2 NvME then what size I would go for ? > >> Ceph recommends using a faster disk for wal/db if the data disk is slow and >> in my case I do have a slower disk for data. >> >> Question: >> 1. Let's say if i want to put a NvME disk for wal/db then what size i >> should buy. > > Since you specify 12xHDD, you’re thinking an add-in PCI card? Or do you have rear bays? I have raid controller connected to all drivers in side box. > > >> 2. Do I need to partition wal/db for each OSD or just a single >> partition can share for all OSDs? > > Each OSD. What size of partition I should create for each 18TB OSD? > >> 3. Can I put the OS on the same disk where the wal/db is going to sit ? > > Bad idea. I can understand but I have redundancy of 3 copy just in case of failure. And OS disk doesn’t hammer correct? > >> (This way i don't need to spend extra money for extra disk) > > Boot drives are cheap. I have no extra slot left that is why planning to share but I can explore more. > >> >> Any suggestions you have for this kind of storage would be much >> appreciated. >> _______________________________________________ >> ceph-users mailing list -- ceph-users(a)ceph.io >> To unsubscribe send an email to ceph-users-leave(a)ceph.io >

2 1

Re: [trove] Devstack Installation Fails with Internal Server Error
by Hirotaka Wakabayashi 18 Jun '22

18 Jun '22

Hi, KK CHN # Added [trove] topic to the subject. Please see: # https://wiki.openstack.org/wiki/MailingListEtiquette#Subjects I use CentOS Stream9 but I have successfully installed devstack with Trove. Here is my Jinja2 version in my devstack environment. ``` $ pip list | grep Jinja Jinja2 3.1.2 ``` > https://docs.openstack.org/trove/latest/install/install-devstack.html I will check the docs and update if needed. Thanks in advance, Hirotaka On Friday, June 17, 2022 at 10:45:54 PM GMT+9, <openstack-discuss-request(a)lists.openstack.org> wrote: Send openstack-discuss mailing list submissions to openstack-discuss(a)lists.openstack.org To subscribe or unsubscribe via the World Wide Web, visit http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss or, via email, send a message with subject or body 'help' to openstack-discuss-request(a)lists.openstack.org You can reach the person managing the list at openstack-discuss-owner(a)lists.openstack.org When replying, please edit your Subject line so it is more specific than "Re: Contents of openstack-discuss digest..." Today's Topics: 1. Re: Devstack Installation Fails with Internal Server Error (HTTP 500) (KK CHN) ---------------------------------------------------------------------- Message: 1 Date: Fri, 17 Jun 2022 15:46:25 +0530 From: KK CHN <kkchn.in(a)gmail.com> To: openstack-discuss(a)lists.openstack.org Subject: Re: Devstack Installation Fails with Internal Server Error (HTTP 500) Message-ID: <CAKgGyB9jqOQ5tXduxkvNNGL4ewHmm-__YG7zDa4wk+ZhmhYDNg(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" I have tried the Trove Devstack installation on Ubuntu20.04 too.. But no success.. ( As I have made no progress in Debian 11 Trove-Devstak installation, I tried a number of times but all failed with the error ). To my experience.. The same error for Ubuntu 20.04 also. Followed the same stuff : https://docs.openstack.org/trove/latest/install/install-devstack.html The compete Error log here https://paste.openstack.org/show/bwSXZXHRtHWHnaOO2Fb4/ It reports an Error starting with 2022-06-17 09:58:04.720 | ERROR: Cannot install trove==17.1.0.dev31 because these package versions have conflicting dependencies. 2022-06-17 09:58:04.721 | 2022-06-17 09:58:04.721 | The conflict is caused by: 2022-06-17 09:58:04.721 | trove 17.1.0.dev31 depends on Jinja2>=2.10 2022-06-17 09:58:04.721 | The user requested (constraint) jinja2===3.1.2 How to overcome this Jinja dependency, where we need to edit this and what jinja suitable ? 2022-06-17 09:58:04.721 | And finally Exit with error 2022-06-17 09:58:07.560 | + /usr/local/lib/python3.8/dist-packages/diskimage_builder/lib/img-functions:trap_cleanup:38 : exit 1 Error on exit stack@kk:~/devstack$ uname -a Linux kk 5.11.0-27-generic #29~20.04.1-Ubuntu SMP Wed Aug 11 15:58:17 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux stack@kk:~/devstack$ On Thu, Jun 16, 2022 at 11:51 AM KK CHN <kkchn.in(a)gmail.com> wrote: > Update to my Devstack installation Error. > > I have crossed this Internal Error ( HTTP 500) and ended up with a new > error for the Trove Devstack Installation attempts. > ################################################## > 2022-06-16 05:46:40.183 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:26 > : total_kB=16393076 > 2022-06-16 05:46:40.188 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:29 > : RAM_NEEDED=4 > 2022-06-16 05:46:40.192 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:30 > : '[' 16393076 -lt 4194304 ']' > 2022-06-16 05:46:40.197 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:30 > : return 0 > 2022-06-16 05:46:40.202 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:cleanup_image_dir:236 > : timeout 120 sh -c 'while ! sudo umount -f /tmp/dib_image.WMpKoawa; do > sleep 1; done' > 2022-06-16 05:46:40.225 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:cleanup_image_dir:241 > : rm -rf --one-file-system /tmp/dib_image.WMpKoawa > 2022-06-16 05:46:40.231 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/img-functions:trap_cleanup:38 > : exit 1 > Error on exit > # Warning: iptables-legacy tables present, use iptables-legacy to see them > # Warning: iptables-legacy tables present, use iptables-legacy to see them > # Warning: iptables-legacy tables present, use iptables-legacy to see them > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ > > ############################################################################# > > I am able to login to the Horizon dash board inspite the ./stack.sh > script Exit with the above error status.. And in the image section, I am > able to view cirros-0.5.2-x86_64-disk > <http://10.184.48.187/dashboard/ngdetails/OS::Glance::Image/be0c8769-286c-4b…> > image in the dashboard. > > But on the terminal when I issue the command DEVSTACK_TROVE/devstack$ > openstack datastore version list mysql it says > " Datastore 'mysql' cannot found. HTTP(404). > > #############Here the tty output > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ source ./openrc > WARNING: setting legacy OS_TENANT_NAME to support cli tools. > > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack datastore > version list mysql > Datastore 'mysql' cannot be found. (HTTP 404) > > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack server list > > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack image list > > +--------------------------------------+--------------------------+--------+ > | ID | Name | Status > | > > +--------------------------------------+--------------------------+--------+ > | be0c8769-286c-4b61-b989-a037e0e9601c | cirros-0.5.2-x86_64-disk | active > | > > +--------------------------------------+--------------------------+--------+ > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack datastore > version list mysql > Datastore 'mysql' cannot be found. (HTTP 404) > > ####################################################################################### > > > So I ended up with the TROVE installation failing ? Or what does this > error mean ? How can I fix this to get a devstack installed successfully > with Trove-DbaaS feature up and running ? > > > Any help / directions much appreciated .... > > [ How I rectify the earlier errors of HTTP 500 : I just created a VM > again with same debian 11 image and 'stack' user created with /opt/stack > dir and freshly git cloned devstack to DEVSTACK_TROVE/ Dir.. > Then created the same local.conf file which I posted in my earlier mail. > and reran ./stack.sh script . This time I was able to get the > dashboard up and be able to login(earlier it's not possible to get the > dashboard too) ] > > Krish > > > > > > On Wed, Jun 15, 2022 at 12:31 PM KK CHN <kkchn.in(a)gmail.com> wrote: > >> This is my latest devstack installation error.. No clues why it >> fails repeatedly; earlier it was during the uploading stage of the cirros >> image, internal server error ( HTTP 500 ) occurred. This was repeated >> multiple times. So I posted for the first time in this thread. >> >> In this iteration for starting afresh, I have removed the stack user and >> /opt/stack directory manually, and freshly created 'stack' user with sudo >> permissions and /opt/stack directory with stack:stack ownership, and >> fresh git cloned(git clone https://opendev.org/openstack/devstack ) to >> /opt/DEVSTACK_stack folder and created local.conf ( attached here) . >> Then executed ./stack.sh . >> >> Got the following error this time ... Any clues why it fails here ? >> Platform (on a VM with Debian uname output) : Linux XenaCtrl1 >> 5.10.0-9-amd64 #1 SMP Debian 5.10.70-1 (2021-09-30) x86_64 GNU/Linux >> >> [image: Trove_installationError.png] >> >> On Tue, Jun 14, 2022 at 8:46 PM Sean Mooney <smooney(a)redhat.com> wrote: >> >>> On Tue, 2022-06-14 at 06:37 -0700, Dan Smith wrote: >>> > > i hit the same issue the other day if you recall me asking about it. >>> > > didnt check my devstack logs to see if it installed or not but i can >>> > > see if i can repoduce it tomorrow. >>> > >>> > I checked with the OP and they have it installed properly, >>> > system-wide. I was assuming your issue might have been venv (or >>> > ordering) related, but theirs was not. There are some other weird >>> things >>> > going on with their setup, so I'm not so sure. >>> nope, was not useing a vnev or anything special, it just devstack >>> installed normaly more or less >>> but driven by the ansible roles. the run devstack rull litrally just >>> opens a shell and invokes >>> stack.sh so i dont think there was anything specific ot how i was >>> invoking it. >>> >>> > >>> > --Dan >>> > >>> >>>

1 0

[nova]tempest-integrated-compute-centos-9-stream is broken since yesterday
by Balazs Gibizer 17 Jun '22

17 Jun '22

Hi, Please hold you rechecks as $subject is 100% fail on master with error: libvirt.libvirtError: internal error: unable to execute QEMU command 'netdev_add': File descriptor named '(null)' has not been found Cheers, gibi [1]https://zuul.opendev.org/t/openstack/builds?job_name=tempest-integrated-c… [2]https://bugs.launchpad.net/nova/+bug/1979047

2 2

Devstack Installation Fails with Internal Server Error (HTTP 500)
by KK CHN 17 Jun '22

17 Jun '22

List, I am trying Devstack installation on a Virtual Machine to try TROVE DbaaS. All the time ./stack.sh command stops with the same error message at this particular point + functions:_upload_image:121 : openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create cirros-0.5.2-x86_64-disk --public --container-format bare --disk-format qcow2 --property hw_rng_model=virtio Internal Server Error (HTTP 500) I have ./unstack.sh && ./clean.sh and re run ./stack.sh multiple time but no progress. Here always the script exit with error . Screenshot attached (using "stack" user created by the devstack/tool/ stack user script) my local.conf file as follows here 10.184.48.187 is my VMs IP Any hints to rectify this error most welcome!! ############################################################ [[local|localrc]] RECLONE=False HOST_IP=10.184.48.187 enable_plugin trove https://opendev.org/openstack/trove enable_plugin trove-dashboard https://opendev.org/openstack/trove-dashboard LIBS_FROM_GIT+=,python-troveclient DATABASE_PASSWORD=password ADMIN_PASSWORD=password SERVICE_PASSWORD=password SERVICE_TOKEN=password RABBIT_PASSWORD=password LOGFILE=$DEST/logs/stack.sh.log VERBOSE=True LOG_COLOR=False LOGDAYS=1 IPV4_ADDRS_SAFE_TO_USE=10.111.0.0/26 FIXED_RANGE=10.111.0.0/26 NETWORK_GATEWAY=10.111.0.1 FLOATING_RANGE=10.184.48.0/24 PUBLIC_NETWORK_GATEWAY=10.184.48.1 #pre requisites ENABLED_SERVICES=rabbit,mysql,key #nova enable_service horizon enable_service n-api enable_service n-cpu enable_service n-cond enable_service n-sch enable_service n-api-meta enable_service placement-api enable_service placement-client #Glance enable_service g-api enable_service g-reg #Cinder enable_service cinder enable_service c-api enable_service c-vol enable_service c-sch #Neutron enable_service q-svc enable_service q-agt enable_service q-dhcp enable_service q-l3 enable_service q-meta #enable DVR Q_AGENT=openvswitch Q_DVR_MODE=legacy Q_ML2_PLUGIN_MECHANISM_DRIVERS=openvswitch Q_ML2_TENANT_NETWORK_TYPE=vxlan Q_PLUGIN=ml2 #SWIFT ENABLED_SERVICES+=,swift SWIFT_HASH=66a3d6b56c1f479c8b4e70ab5c2000f5 SWIFT_REPLICAS=1 stack@XenaCtrl1:/home/cloud/trove_devstack/devstack$ #################################################################

8 19

[nova] nova-live-migraton and nova-grenade-multinode is in bad shape on master
by Balazs Gibizer 17 Jun '22

17 Jun '22

Hi, Since yesterday we started seeing both $subject jobs to fail with [1]. [1]https://bugs.launchpad.net/tempest/+bug/1979052

2 2

[all][tc] What's happening in Technical Committee: summary 17 June 2022: Reading: 5 min
by Ghanshyam Mann 17 Jun '22

17 Jun '22

Hello Everyone, Here is this week's summary of the Technical Committee activities. 1. TC Meetings: ============ * We had this week's meeting on 16 June. Most of the meeting discussions are summarized in this email. Meeting full logs are available @https://meetings.opendev.org/meetings/tc/2022/tc.2022-06-16-15.00.log.html * Next TC weekly meeting will be on 23 June Thursday at 15:00 UTC, feel free to add the topic on the agenda[1] by 22 June. 2. What we completed this week: ========================= * The TC presented the "OpenStack Updates" to the Board of Directors meeting in Berlin. Due to COVID and no in-person board meeting, OpenStack community and Board did not have any interaction for 2.5 years. As Board meet in-person in Berlin summit, The TC presented the "OpenStack Updates" to them which is much appreciated by the Board. Along with updates, OpenStack's current challenges are acknowledged and discussed especially operator+develoepr less interaction, fewer contributors, and less diversity in contribution. You can see the slides here[2]. 3. Activities In progress: ================== TC Tracker for Zed cycle ------------------------------ * Zed tracker etherpad includes the TC working items[3], many items are in-progress. Open Reviews ----------------- * Four open reviews for ongoing activities[4]. New release cadence "SLURP" open items -------------------------------------------------- 1. release notes strategy: Brian is working on this[5] and has some ideas on automating the releasenotes process which is under testing[5]. This work is required by m-3 of the 2023.1 release so we have time but he mentioned to do it well before that. Improve project governance --------------------------------- Slawek updated the framework proposal as per review comments and is under review[6]. New ELK service dashboard: e-r service ----------------------------------------------- No update this week. Consistent and Secure Default RBAC ------------------------------------------- We have operators feedback[7] and we will be discussing it in policy popup meeting on Tuesday 21 June[8] Please note that operator feedback is very important for us to proceed on 'scope' in SRBAC. If you are operator or know anyone around you, we request you to provide feedback. 2021 User Survey TC Question Analysis ----------------------------------------------- No update on this. The survey summary is up for review[9]. Feel free to check and provide feedback. Zed cycle Leaderless projects ---------------------------------- No updates on this. Only Adjutant project is leaderless/maintainer-less. We will check Adjutant's the situation again on ML and hope Braden will be ready with their company side permission[10]. Fixing Zuul config error ---------------------------- Requesting projects with zuul config error to look into those and fix them which should not take much time[11][12]. Project updates ------------------- * None 4. How to contact the TC: ==================== If you would like to discuss or give feedback to TC, you can reach out to us in multiple ways: 1. Email: you can send the email with tag [tc] on openstack-discuss ML[13]. 2. Weekly meeting: The Technical Committee conduct a weekly meeting every Thursday 15 UTC [14] 3. Ping us using 'tc-members' nickname on #openstack-tc IRC channel. [1] https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting [2] https://docs.google.com/presentation/d/1yCiZy_9A6hURXD0BRdr33OlK7Ugch5EgSvF… [3] https://etherpad.opendev.org/p/tc-zed-tracker [4] https://review.opendev.org/q/projects:openstack/governance+status:open [5] https://review.opendev.org/c/openstack/project-team-guide/+/843457 [6] https://review.opendev.org/c/openstack/governance/+/839880 [7] http://lists.openstack.org/pipermail/openstack-discuss/2022-June/029098.html [8] https://wiki.openstack.org/wiki/Consistent_and_Secure_Default_Policies_Popu… [9] https://review.opendev.org/c/openstack/governance/+/836888 [10] http://lists.openstack.org/pipermail/openstack-discuss/2022-March/027626.ht… [11] https://etherpad.opendev.org/p/zuul-config-error-openstack [12] http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028603.html [13] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss [14] http://eavesdrop.openstack.org/#Technical_Committee_Meeting -gmann

1 0

nova evacuate
by Parsa Aminian 17 Jun '22

17 Jun '22

Hi On kolla ansible with ceph wallaby version ,evacuating instances from failed compute to another compute is associated with the no valid host error .The command that was executed for this case is as follows: nova host-evacuate --target_host TARGET_HOST FAILED_HOST The interesting thing is that this is done successfully from the horizon if the Shared Storage option is selected . how can I solve this issue ?

1 0

[neutron] Drivers meeting agenda - 17.06.2022.
by Lajos Katona 17 Jun '22

17 Jun '22

Hi Neutron Drivers, The agenda for tomorrow's drivers meeting is at [1]. [RFE] Improve performance of bulk port create/delete with networking-generic-switch (#linkhttps:// bugs.launchpad.net/neutron/+bug/1976270) [1] https://wiki.openstack.org/wiki/Meetings/NeutronDrivers#Agenda See you at the meeting tomorrow. Lajos Katona (lajoskatona)

2 2

Re: Devstack Installation Fails with Internal Server Error (HTTP 500)
by Dan Smith 17 Jun '22

17 Jun '22

> With this ^ I realized that restarting g-api might not have been a > good indicator of anything resolving because in this example the > plugin load failure occurs while checking quota for an inbound > request. I'm not sure whether services load the dbcounter passively > when they start or if it's only when database accesses are initiated. I would have though it would be when the enginefacade is created, which I suspect happens at load time. However, perhaps the plugin bit doesn't occur until the first connection is made, where it needs to use the URL. Not sure. In nova, that would happen at startup time too, but probably not glance. > I also don't understand how or why one project can't load the plugin > but the rest can. And I wonder whether it's a coincidence that it was > glance in the two examples we have so far. Yeah, your confirmation that we've loaded it multiple times before rules out the ordering thing (as I expected) but maybe it rules back in it being something specific to glance. Maybe we should ping zzzeek to look. --Dan

1 0

[cinder] festival of XS reviews 17th June 2022
by Rajat Dhasmana 17 Jun '22

17 Jun '22

Hello Argonauts, We will be having our monthly festival of XS reviews today i.e. 17th June (Friday) from 1400-1600 UTC. Following are some additional details: Date: 17th June, 2022 Time: 1400-1600 UTC Meeting link: https://meetpad.opendev.org/cinder-festival-of-reviews etherpad: https://etherpad.opendev.org/p/cinder-festival-of-reviews Thanks and regards Rajat Dhasmana

1 0

Re: Devstack Installation Fails with Internal Server Error (HTTP 500)
by melanie witt 16 Jun '22

16 Jun '22

I had tried to send this earlier with devstack output attached without thinking about the large size of the text. Sorry :( On Thu Jun 16 2022 16:56:21 GMT-0700 (Pacific Daylight Time), Dan Smith <dms(a)danplanet.com> wrote: >> It looks like copies of this may be getting repeatedly concatenated >> into the plugin variable: >> >> https://opendev.org/openstack/devstack/src/commit/44d07f300150f7297773a2150… > > I don't think that's actually happening. If it was, restarting glance > wouldn't help (as Melanie indicated) and it also should never really > work. I was thinking that was more likely an artifact of the error > message or something. Looking at the config files, they seem right. For > example: > > https://zuul.opendev.org/t/openstack/build/ff5a7a6fc87840579b102b244f28200f… I didn't notice this before but before things error with glance, other projects had no problem loading the dbcounter plugin, keystone-manage: > +lib/keystone:init_keystone:484 /usr/local/bin/keystone-manage --config-file /etc/keystone/keystone.conf db_sync > INFO dbcounter [-] Registered counter for database keystone > DEBUG oslo_db.sqlalchemy.engines [-] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=371448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} > DEBUG dbcounter [-] [371448] Writer thread running {{(pid=371448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Yet glance fails to load it during two separate glance-manage calls: > +lib/glance:init_glance:489 /usr/local/bin/glance-manage --config-file /etc/glance/glance-api.conf db_sync > CRITICAL glance [-] Unhandled error: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.plugins:dbcounterplugin=dbcounterplugin=dbcounter [...] > +lib/glance:init_glance:492 /usr/local/bin/glance-manage --config-file /etc/glance/glance-api.conf db_load_metadefs > CRITICAL glance [-] Unhandled error: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.plugins:dbcounterplugin=dbcounterplugin=dbcounter Then cinder-manage loads it fine: > +lib/cinder:init_cinder:440 /usr/local/bin/cinder-manage --config-file /etc/cinder/cinder.conf db sync > INFO dbcounter [-] Registered counter for database cinder > DEBUG oslo_db.sqlalchemy.engines [-] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=391785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} > DEBUG dbcounter [-] [391785] Writer thread running {{(pid=391785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Then nova-manage: > +lib/nova:init_nova:843 /usr/local/bin/nova-manage --config-file /etc/nova/nova.conf api_db sync > Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. > INFO dbcounter [-] Registered counter for database nova_api > DEBUG dbcounter [-] [394510] Writer thread running {{(pid=394510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} [...] > INFO dbcounter [-] Registered counter for database nova_cell0 > DEBUG dbcounter [-] [394520] Writer thread running {{(pid=394520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} [...] > INFO dbcounter [-] Registered counter for database nova_cell1 > DEBUG dbcounter [-] [394531] Writer thread running {{(pid=394531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Finally glance fails to load the plugin in the g-api service when an image upload is requested: > +functions:_upload_image:121 openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create cirros-0.5.2-x86_64-disk --public --container-format bare --disk-format qcow2 --property hw_rng_model=virtio > /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead > from cryptography.utils import int_from_bytes > /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead > from cryptography.utils import int_from_bytes > HttpException: 500: Server Error for url: http://192.168.42.11/image/v2/images, The server has either erred or is incapable of performing the requested operation.: 500 Internal Server Error With this ^ I realized that restarting g-api might not have been a good indicator of anything resolving because in this example the plugin load failure occurs while checking quota for an inbound request. I'm not sure whether services load the dbcounter passively when they start or if it's only when database accesses are initiated. I also don't understand how or why one project can't load the plugin but the rest can. And I wonder whether it's a coincidence that it was glance in the two examples we have so far. -melwitt

2 1

[all][tc][policy] RBAC discussion policy pop-up meeting on Tuesday 21 June (biweekly meeting)
by Ghanshyam Mann 16 Jun '22

16 Jun '22

Hello Everyone, As discussed in the last meeting, we were waiting for the operator feedback from various places including ops meetup in Berlin[1]. We have a good amount of feedback and I have summarized those in our central feedback etherpad. If you have any feedback from your customer, feel free to add it to the ethrpad before our next meeting on 21 June. - https://etherpad.opendev.org/p/rbac-operator-feedback#L45 We will discuss the feedback and decide on the next step in our next policy popup meeting on Tuesday 21 June 2022 14:00 UTC. We will have this meeting biweekly, I am also attaching the .ics file in this email. Meeting Details: - Joining Info: https://wiki.openstack.org/wiki/Consistent_and_Secure_Default_Policies_Popu… - Agenda: https://etherpad.opendev.org/p/rbac-zed-ptg#L97 [1] http://lists.openstack.org/pipermail/openstack-discuss/2022-June/028878.html -gmann

1 0

[dev][infra][tact-sig] Updating Zuul's Default Ansible Version to Ansible v5
by Jeremy Stanley 16 Jun '22

16 Jun '22

Just a heads up, in case you haven't seen Clark's announcement on OpenDev's service-announce ML, the default Ansible version Zuul invokes to run jobs will be changing at the end of this month: https://lists.opendev.org/pipermail/service-announce/2022-June/000041.html Feel free to reach out with any concerns. -- Jeremy Stanley

1 0

[Image Encryption] No meeting next week
by Josephine Seifert 16 Jun '22

16 Jun '22

Hi, there will be no meeting next monday. greetings Josephine (Luzi)

1 0

raw and qcow2 format
by fereshteh loghmani 16 Jun '22

16 Jun '22

hello I have a question about disk format in OpenStack. I created a new server and shut off that server and with the command qemu-img info disk I found my "disk format" in qcow2 and it shows the "backing file format: raw". could you tell me why these 2 are different? (I use OpenStack without ceph and without volumes.) thank you

2 1

evacuate problem
by fereshteh loghmani 16 Jun '22

16 Jun '22

hello i use masakari for migrate servers when the compute being down. i install these container on the region: masakari-monitors masakari-engine masakari-api hacluster-pacemaker hacluster-corosync and on the compute server i install "hacluster-pacemaker-remote". In openstack i created segment and I added 2 hosts (in this case the name of that 2 hosts are: R3SG5 & R3SG12). for testing evacuate function i shut off one of that compute that i added in host. (in this case i shutoff R3SG5) i attached the log that i found in this directory: /var/log/kolla/masakari/masakari-hostmonitor.log ********* INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] 'R3SG5' is 'online' (current: 'online'). INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] 'R3SG12' is 'online' (current: 'online'). WARNING masakarimonitors.hostmonitor.host_handler.handle_host [-] Corosync communication using 'eth0' is failed.: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. ERROR masakarimonitors.hostmonitor.host_handler.handle_host [-] Corosync communication is failed. INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] 'R3SG5' is 'offline' (current: 'offline'). INFO masakarimonitors.ha.masakari [-] Send a notification. {'notification': {'type': 'COMPUTE_HOST', 'hostname': 'R3SG5', 'generated_time': datetime.datetime(2022, 6, 14, 7, 6, 46, 138867), 'payload': {'event': 'STOPPED', 'cluster_status': 'OFFLINE', 'host_status': 'NORMAL'}}} INFO masakarimonitors.ha.masakari [-] Response: openstack.instance_ha.v1.notification.Notification(type=COMPUTE_HOST, hostname=R3SG5, generated_time=2022-06-14T07:06:46.138867, payload={'event': 'STOPPED', 'cluster_status': 'OFFLINE', 'host_status': 'NORMAL'}, id=105, notification_uuid=a7364095-cc7d-48f8-b963-c64ba147897c, source_host_uuid=6328f08c-c752-43d5-4689-801d91dd67ec, status=new, created_at=2022-06-14T07:06:47.000000, updated_at=None, location=Munch({'cloud': 'controller', 'region_name': 'RegionThree', 'zone': None, 'project': Munch({'id': 'a75a951b4537478e8cea39a932f830da', 'name': None, 'domain_id': None, 'domain_name': None})})) INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] 'R3SG12' is 'online' (current: 'online'). WARNING masakarimonitors.hostmonitor.host_handler.handle_host [-] Corosync communication using 'eth0' is failed.: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. ERROR masakarimonitors.hostmonitor.host_handler.handle_host [-] Corosync communication is failed. INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] 'R3SG5' is 'offline' (current: 'offline'). INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] 'R3SG12' is 'online' (current: 'online'). WARNING masakarimonitors.hostmonitor.host_handler.handle_host [-] Corosync communication using 'eth0' is failed.: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. ***************** also i checked nova_scheduler logs and on that directory i receive error: *** ERROR oslo_messaging.rpc.server nova.exception.NoValidHost: No valid host was found. There are not enough hosts available. ******* finally in OpenStack dashboard in the notification section tatus change from running to failed. after the error state that shows in the notification section, my VM that was on R3SG5 became to ERROR state and the VM still exists on R3SG5 and it doenst been migrated to R3SG12. could you please help me why evacuate function doesn't work correctly?

2 1

Error while deploying ReaR | openstak wallaby | tripleo
by Swogat Pradhan 16 Jun '22

16 Jun '22

Hi, Steps to Reproduce: 1. Add /usr/share/openstack-tripleo-heat-templates/environments/backup-and-restore/rear.yaml as a environment file in openstack overcloud deploy command 2. Run the deployement, in step 0 or 1 the error should come up. Actual results: 2022-06-16 14:52:07.581055 | 48d539a1-1679-6c30-81d1-000000007f7d | TASK | Check backup server IP 2022-06-16 14:52:18.186942 | 48d539a1-1679-6c30-81d1-000000007f7d | FATAL | Check backup server IP | overcloud-controller-1 | error={"changed": true, "cmd": ["ping", "-c", "1", "192.168.24.1"], "delta": "0:00:10.011643", "end": "2022-06-16 06:52:18.119615", "msg": "non-zero return code", "rc": 1, "start": "2022-06-16 06:52:08.107972", "stderr": "", "stderr_lines": [], "stdout": "PING 192.168.24.1 (192.168.24.1) 56(84) bytes of data.\n\n--- 192.168.24.1 ping statistics ---\n1 packets transmitted, 0 received, 100% packet loss, time 0ms", "stdout_lines": ["PING 192.168.24.1 (192.168.24.1) 56(84) bytes of data.", "", "--- 192.168.24.1 ping statistics ---", "1 packets transmitted, 0 received, 100% packet loss, time 0ms"]} Expected results: ReaR in tripleo should be deployed without errors Additional info: There is no 192.168.24.0 subnet in my setup Should i make a host entry in all the overcloud nodes and undercloud node like below? 192.268.24.1 undercloud 192.268.24.1 overcloud-controller-1 With Regards, Swogat pradhan

1 0

How to setup murano and trove in a existing tripleo setup
by Swogat Pradhan 16 Jun '22

16 Jun '22

Hi, I have a running Openstack cloud based on Wallaby which was deployed in tripleo. I have a requirement to set up additional services like REAR, MURANO and TROVE. But murano and trove are not available in tripleo. How can I set it up? Should i manually install murano and trove and integrate it in the existing openstack. Will it in any way affect the setup? With Regards Swogat pradhan

1 0

[all][tc] Technical Committee next weekly meeting on 16 June 2022 at 1500 UTC
by Ghanshyam Mann 15 Jun '22

15 Jun '22

Hello Everyone, The technical Committee's next weekly meeting is scheduled for 16 June 2022, at 1500 UTC. If you would like to add topics for discussion, please add them to the below wiki page by Wednesday, 15 June at 2100 UTC. https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting -gmann

1 1

Migrate vmware to Openstack
by Mohammed, Moiz 15 Jun '22

15 Jun '22

Hello, Is there any tool or are aware of to convert from Vmware to Openstack qcow2? Moiz Mohammed | Systems Engineer - Compute Infrastructure (704)-378-2934 O | (415) 866-3183 M | Oncall Phone: 1-866-577-0007 Ext 802 7815 Cresent Executive Dr, Floor#2 | Charlotte, NC 28217 [cid:image002.png@01D3AA4F.EFCE7660]

3 2

504 Gateway time out error while loading OpenStack Projects
by Adivya Singh 15 Jun '22

15 Jun '22

hi Team, We have Xena release installed on Ubuntu Openstack, Lately we are getting "504 Gateway Timeout error ", As the we moved from 1 node to 3 node Open Stack i do not see any error in haproxy , neither there is a time out when i ping external-VIP-IP configured. Apache 2 are also loaded, tried to delete the Horizon Container and created it again, but no errors, Still the same errors. Any guesses on that Regards Adivya Singh

3 3

Re: Migrate vmware to Openstack
by tim+openstack.org＠coote.org 15 Jun '22

15 Jun '22

Isn’t the bigger issue migrating the code that deploys the vms and other resources? Is there a common Terraform model? > On 15 Jun 2022, at 15:00, Danny Webb <Danny.Webb(a)thehutgroup.com <mailto:Danny.Webb@thehutgroup.com>> wrote: > > Hi Moiz, > > you can use qemu-img to convert between formats. > > https://docs.openstack.org/image-guide/convert-images.html <https://docs.openstack.org/image-guide/convert-images.html> > > Cheers, > > Danny > > From: Mohammed, Moiz <Moiz.Mohammed(a)charter.com <mailto:Moiz.Mohammed@charter.com>> > Sent: 15 June 2022 14:35 > To: openstack-discuss(a)lists.openstack.org <mailto:openstack-discuss@lists.openstack.org> <openstack-discuss(a)lists.openstack.org <mailto:openstack-discuss@lists.openstack.org>> > Subject: Migrate vmware to Openstack > > > CAUTION: This email originates from outside THG > > > > Hello, > > Is there any tool or are aware of to convert from Vmware to Openstack qcow2? > > > Moiz Mohammed | Systems Engineer – Compute Infrastructure > (704)-378-2934 O | (415) 866-3183 M | Oncall Phone: 1-866-577-0007 Ext 802 > 7815 Cresent Executive Dr, Floor#2 | Charlotte, NC 28217 > <image001.png> > > Danny Webb > Principal OpenStack Engineer > The Hut Group <http://www.thehutgroup.com/> > > Tel: > Email: Danny.Webb(a)thehutgroup.com <mailto:Danny.Webb@thehutgroup.com> > > For the purposes of this email, the "company" means The Hut Group Limited, a company registered in England and Wales (company number 6539496) whose registered office is at Fifth Floor, Voyager House, Chicago Avenue, Manchester Airport, M90 3DQ and/or any of its respective subsidiaries. > > Confidentiality Notice > This e-mail is confidential and intended for the use of the named recipient only. If you are not the intended recipient please notify us by telephone immediately on +44(0)1606 811888 or return it to us by e-mail. Please then delete it from your system and note that any use, dissemination, forwarding, printing or copying is strictly prohibited. Any views or opinions are solely those of the author and do not necessarily represent those of the company. > > Encryptions and Viruses > Please note that this e-mail and any attachments have not been encrypted. They may therefore be liable to be compromised. Please also note that it is your responsibility to scan this e-mail and any attachments for viruses. We do not, to the extent permitted by law, accept any liability (whether in contract, negligence or otherwise) for any virus infection and/or external compromise of security and/or confidentiality in relation to transmissions sent by e-mail. > > Monitoring > Activity and use of the company's systems is monitored to secure its effective use and operation and for other lawful business purposes. Communications using these systems will also be monitored and may be recorded to secure effective use and operation and for other lawful business purposes. > hgvyjuv

1 0

split brains
by tim+openstack.org＠coote.org 15 Jun '22

15 Jun '22

Hullo I’ve encountered a couple of firms that have run into challenges with Open Stack environments becoming ‘split brain’, e.g. https://www.youtube.com/watch?v=JZwYZqx0RMk <https://www.youtube.com/watch?v=JZwYZqx0RMk> The narrative is that there’s an issue with the RabbitMQ messaging that is causing this. I’ve used RabbitMQ since it was being developed by various banks and I’ve successfully deployed it to control large scale IoT systems. I’ve always found it reliable as a MoM approach, although I’ve never tried the transactional message type that comes with AMQP 1.0 (I think that’s the version). Can anyone cast any light on what this type of scenario is referring to? tia Tim

1 0

Poor upload speed of ubuntu 18.04 vm
by AJ_ sunny 15 Jun '22

15 Jun '22

Hi team, I am getting very less upload speed for specific Ubuntu 18.04 vm in Openstack environment deployed through kolla ansible method Any idea why i am getting this issue for ubuntu 18.04? Thanks Arihant Jain

1 0

[kolla] Weekly meeting 15th June 2022 cancelled
by Michał Nasiadka 15 Jun '22

15 Jun '22

Hello Koalas, Sorry for late notice - but the meeting today is cancelled - I can’t join (and as well most of the key members can’t). If you have any important questions - please ask them on #openstack-kolla. See you next week, Michal Nasiadka

1 0

[cinder] Bug deputy report for week of 06-15-2022
by Sofia Enriquez 15 Jun '22

15 Jun '22

This is a bug report from 06-08-2022 to 06-15-2022. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Medium: - https://bugs.launchpad.net/cinder/+bug/1978294 "[NFS/NetApp] No feedback from Nova when extending attached Volumes." Assigned to Konrad Gub. - https://bugs.launchpad.net/os-brick/+bug/1967157 "Fails to extend in-use (non LUKS v1) encrypted volumes." Fix proposed to master. Low - https://bugs.launchpad.net/cinder/+bug/1978020 "Old-style Glance location URI sent when uploading a volume to an image." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1978290 "[IBM Storwize] Optimize SSH calls in create replicated volume." Unassigned. - https://bugs.launchpad.net/cinder/+bug/1978729 "cinder-backup context.message_action is None on errors." Unassigned. Cheers, Sofia -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

[cinder] Failed to delete volume
by Michal Arbet 15 Jun '22

15 Jun '22

Hi, I would like to ask if someone saw issue when volume failed to delete, log below : This is happening from time to time. LOG : https://paste.opendev.org/show/b1jRCxuBFnnVzf64i9yV/ Thanks, Michal Arbet Openstack Engineer Ultimum Technologies a.s. Na Poříčí 1047/26, 11000 Praha 1 Czech Republic +420 604 228 897 michal.arbet(a)ultimum.io *https://ultimum.io <https://ultimum.io/>* LinkedIn <https://www.linkedin.com/company/ultimum-technologies> | Twitter <https://twitter.com/ultimumtech> | Facebook <https://www.facebook.com/ultimumtechnologies/timeline>

4 5

[qa][refstack][python-tempestconf] adding image
by Mohammed Naser 15 Jun '22

15 Jun '22

Hi there, I'm wondering if the python-tempestconf team is open to publishing Docker images that contain `python-tempestconf`. This is something that we have a need for downstream but we'd be happy to contribute upstream. The main thing is that we'd need to setup an organization on Docker hub to publish things to. Is that something that the team is interested in? We can contribute it if that is the case. Thanks, Mohammed -- Mohammed Naser VEXXHOST, Inc.

3 2

New install on CentOS: what versions, etc.?
by Ken D'Ambrosio 14 Jun '22

14 Jun '22

Hey, all. We're currently running (I hope you're sitting) Juno, and we're thinking about rolling out a new OpenStack version. My boss has asked me if CentOS 7.9 a) would be supported for control/compute nodes, and, if so, if there are any long-term potential issues, and b) if there would be any concerns about versions of client OSes. Thanks! -Ken

3 2

[interop][refstack][summit] Interoperability testing feedback
by Martin Kopec 14 Jun '22

14 Jun '22

Hi everyone, we got great feedback during the summit, if you wanna check the topics we discussed, see this etherpad [1]. Feel also free to add additional concerns with the current interop processes. I was happy to see that many of you are thinking about interoperability and want to improve the testing in this regard. IWG has been seeking feedback from operators as well as users for some time now to make sure it helps with interoperability as much as possible. If you haven't already, please fill out this short (2-3 min) questionnaire [2]. Public Cloud SIG hosted an interesting session in terms of interoperability testing as well, see their etherpad [3]. I'm sure that you'll see further communication in that regard soon. I look forward to future collaboration between IWG and Public Cloud SIG. [1] https://etherpad.opendev.org/p/Berlin2022-Forum-InteropWG [2] https://forms.gle/YW95Hb2LoppaiLxv8 [3] https://etherpad.opendev.org/p/berlin-summit-future-public-cloud-sig Regards, -- Martin Kopec Senior Software Quality Engineer Red Hat EMEA IM: kopecmartin

1 0

[keystone] Getting a token from existing token
by hai wu 14 Jun '22

14 Jun '22

Is it possible to get a new token from an existing token, and at the same time, to have the new token expiration time extended? (token renewal from existing token) It seems the token expiration time is not extended when trying the same curl command as shown in section "Getting a token from a token" in this doc: https://docs.openstack.org/keystone/train/api_curl_examples.html. Quote: curl -i \ -H "Content-Type: application/json" \ -d ' { "auth": { "identity": { "methods": ["token"], "token": { "id": "'$OS_TOKEN'" } } } }' \ "http://localhost:5000/v3/auth/tokens" ; echo

1 0

Re: snapshot problem
by Eugen Block 14 Jun '22

14 Jun '22

You should respond to the list so other users can try to support you. So nova is trying to live snapshot the instance: > 2022-06-12 16:25:55.603 7 INFO nova.compute.manager > [req-5ecfdf74-7cf3-481a-aa12-140deae202f7 > 4dbffaa9c14e401c8c210e23ebe0ab7b ef940663426b4c87a751afaf13b758e0 - > default default] [instance: 25c8d676-e20a-4238-a45c-d51daa62b941] > instance snapshotting > [...] [instance: 25c8d676-e20a-4238-a45c-d51daa62b941] Beginning > live snapshot process But I don't see any 'rbd snap create' command. Either the rbd image doesn't support it or there is some setting to keep all rbd images "flat". Can you check any relevant configs you might have in nova? Also can you show the output of 'rbd info <pool>/25c8d676-e20a-4238-a45c-d51daa62b941_disk' ? Then to test if the underlying rbd functions work as expected you could try to create a live snapshot manually: rbd snap create <pool>/25c8d676-e20a-4238-a45c-d51daa62b941_disk@test-snap And paste any relevant output here. Zitat von Parsa Aminian <p.aminian.server(a)gmail.com>: > Its not working for any instances and all of them are paused . I enable > debug logs please check the logs : > > 2022-06-12 16:16:13.478 7 DEBUG nova.compute.manager > [req-2ecf34c3-72e7-4f33-89cb-9b250cd6d223 - - - - -] Triggering sync for > uuid 25c8d676-e20a-4238-a45c-d51daa62b941 _sync_power_states > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:9693 > 2022-06-12 16:16:13.506 7 DEBUG oslo_concurrency.lockutils [-] Lock > "25c8d676-e20a-4238-a45c-d51daa62b941" acquired by > "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" > :: waited 0.000s inner > /var/lib/kolla/venv/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:359 > 2022-06-12 16:16:43.562 7 DEBUG nova.compute.resource_tracker > [req-2ecf34c3-72e7-4f33-89cb-9b250cd6d223 - - - - -] Instance > 25c8d676-e20a-4238-a45c-d51daa62b941 actively managed on this compute host > and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': > 1024, 'DISK_GB': 20}}. _remove_deleted_instances_allocations > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/resource_tracker.py:1539 > 2022-06-12 16:25:55.104 7 DEBUG nova.compute.manager > [req-5ecfdf74-7cf3-481a-aa12-140deae202f7 4dbffaa9c14e401c8c210e23ebe0ab7b > ef940663426b4c87a751afaf13b758e0 - default default] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] Checking state _get_power_state > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:1569 > 2022-06-12 16:25:55.603 7 INFO nova.compute.manager > [req-5ecfdf74-7cf3-481a-aa12-140deae202f7 4dbffaa9c14e401c8c210e23ebe0ab7b > ef940663426b4c87a751afaf13b758e0 - default default] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] instance snapshotting > 63426b4c87a751afaf13b758e0 - default default] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] Beginning live snapshot process > default default] Lazy-loading 'pci_devices' on Instance uuid > 25c8d676-e20a-4238-a45c-d51daa62b941 obj_load_attr > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/objects/instance.py:1101 > 2022-06-12 16:25:57.250 7 DEBUG nova.objects.instance > [req-5ecfdf74-7cf3-481a-aa12-140deae202f7 4dbffaa9c14e401c8c210e23ebe0ab7b > ef940663426b4c87a751afaf13b758e0 - default default] Lazy-loading > 'pci_devices' on Instance uuid 25c8d676-e20a-4238-a45c-d51daa62b941 > obj_load_attr > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/objects/instance.py:1101 > 2022-06-12 16:25:57.317 7 DEBUG nova.virt.driver [-] Emitting event > <LifecycleEvent: 1655034957.3158934, 25c8d676-e20a-4238-a45c-d51daa62b941 > => Paused> emit_event > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/driver.py:1704 > 2022-06-12 16:25:57.318 7 INFO nova.compute.manager [-] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] VM Paused (Lifecycle Event) > 2022-06-12 16:25:57.389 7 DEBUG nova.compute.manager > [req-40444d74-f2fa-4569-87dd-375139938e81 - - - - -] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] Checking state _get_power_state > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:1569 > 2022-06-12 16:25:57.395 7 DEBUG nova.compute.manager > [req-40444d74-f2fa-4569-87dd-375139938e81 - - - - -] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] Synchronizing instance power state > after lifecycle event "Paused"; current vm_state: active, current > task_state: image_pending_upload, current DB power_state: 1, VM > power_state: 3 handle_lifecycle_event > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:1299 > 2022-06-12 16:25:57.487 7 INFO nova.compute.manager > [req-40444d74-f2fa-4569-87dd-375139938e81 - - - - -] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] During sync_power_state the instance > has a pending task (image_pending_upload). Skip. > 2022-06-12 16:26:02.039 7 DEBUG oslo_concurrency.processutils > [req-5ecfdf74-7cf3-481a-aa12-140deae202f7 4dbffaa9c14e401c8c210e23ebe0ab7b > ef940663426b4c87a751afaf13b758e0 - default default] Running cmd > (subprocess): qemu-img convert -t none -O raw -f raw > rbd:vms/25c8d676-e20a-4238-a45c-d51daa62b941_disk:id=cinder:conf=/etc/ceph/ceph.conf > /var/lib/nova/instances/snapshots/tmpv21b_i59/8717dec4c99c4ef7bac752e2a48690ad > execute > /var/lib/kolla/venv/lib/python3.6/site-packages/oslo_concurrency/processutils.py:384 > 2022-06-12 16:26:17.075 7 DEBUG nova.virt.driver [-] Emitting event > <LifecycleEvent: 1655034962.0316682, 25c8d676-e20a-4238-a45c-d51daa62b941 > => Stopped> emit_event > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/driver.py:1704 > INFO nova.compute.manager [-] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] VM Stopped (Lifecycle Event) > DEBUG nova.compute.manager [req-f9f8cbf5-6208-4dca-aca6-48dee87f38fa - - - > - -] [instance: 25c8d676-e20a-4238-a45c-d51daa62b941] Checking state > _get_power_state > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:1569 > DEBUG nova.compute.manager [req-f9f8cbf5-6208-4dca-aca6-48dee87f38fa - - - > - -] [instance: 25c8d676-e20a-4238-a45c-d51daa62b941] Synchronizing > instance power state after lifecycle event "Stopped"; current vm_state: > active, current task_state: image_pending_upload, current DB power_state: > 1, VM power_state: 4 handle_lifecycle_event > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:1299 > INFO nova.compute.manager [req-f9f8cbf5-6208-4dca-aca6-48dee87f38fa - - - - > -] [instance: 25c8d676-e20a-4238-a45c-d51daa62b941] During sync_power_state > the instance has a pending task (image_pending_upload). Skip. > 2022-06-12 16:26:18.539 7 DEBUG nova.compute.manager > [req-2ecf34c3-72e7-4f33-89cb-9b250cd6d223 - - - - -] Triggering sync for > uuid 25c8d676-e20a-4238-a45c-d51daa62b941 _sync_power_states > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:9693 > 2022-06-12 16:26:18.565 7 DEBUG oslo_concurrency.lockutils [-] Lock > "25c8d676-e20a-4238 > -a45c-d51daa62b941" acquired by > "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" > :: waited 0.000s inner > /var/lib/kolla/venv/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:359 > 2022-06-12 16:26:18.566 7 INFO nova.compute.manager [-] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] During sync_power_state the instance > has a pending task (image_pending_upload). Skip. > 2022-06-12 16:26:18.566 7 DEBUG oslo_concurrency.lockutils [-] Lock > "25c8d676-e20a-4238-a45c-d51daa62b941" released by > "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" > :: held 0.001s inner > /var/lib/kolla/venv/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:371 > 2022-06-12 16:26:25.769 7 DEBUG oslo_concurrency.processutils > [req-5ecfdf74-7cf3-481a-aa12-140deae202f7 4dbffaa9c14e401c8c210e23ebe0ab7b > ef940663426b4c87a751afaf13b758e0 - default default] CMD "qemu-img convert > -t none -O raw -f raw > rbd:vms/25c8d676-e20a-4238-a45c-d51daa6b941_disk:id=cinder:conf=/etc/ceph/ceph.conf > /var/lib/nova/instances/snapshots/tmpv21b_i59/8717dec4c99c4ef7bac752e2a48690ad" > returned: 0 in 23.730s execute > /var/lib/kolla/venv/lib/python3.6/site-packages/oslo_concurrency/processutils.py:423 > default default] [instance: 25c8d676-e20a-4238-a45c-d51daa62b941] Snapshot > extracted, beginning image upload > 2022-06-12 16:26:27.981 7 DEBUG nova.virt.driver > [req-40444d74-f2fa-4569-87dd-375139938e81 - - - - -] Emitting event > <LifecycleEvent: 1655034987.9807608, 25c8d676-e20a-4238-a45c-d51daa62b941 > => Started> emit_event > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/driver.py:1704 > 2022-06-12 16:26:27.983 7 INFO nova.compute.manager > [req-40444d74-f2fa-4569-87dd-375139938e81 - - - - -] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] VM Started (Lifecycle Event) > [instance: 25c8d676-e20a-4238-a45c-d51daa62b941] Checking state > _get_power_state > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:1569 > 25c8d676-e20a-4238-a45c-d51daa62b941] Synchronizing instance power state > after lifecycle event "Started"; current vm_state: active, current > task_state: image_pending_upload, current DB power_state: 1, VM > power_state: 1 handle_lifecycle_event > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:1299 > 2022-06-12 16:26:28.173 7 INFO nova.compute.manager > [req-40444d74-f2fa-4569-87dd-375139938e81 - - - - -] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] VM Resumed (Lifecycle Event > 2022-06-12 16:29:00.859 7 DEBUG oslo_concurrency.lockutils > [req-2ecf34c3-72e7-4f33-89cb-9b250cd6d223 - - - - -] Acquired lock > "refresh_cache-25c8d676-e20a-4238-a45c-d51daa62b941" lock > /var/lib/kolla/venv/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:266 > 25c8d676-e20a-4238-a45c-d51daa62b941] Forcefully refreshing network info > cache for instance _get_instance_nw_info > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/network/neutron.py:1833 > 2022-06-12 16:29:03.278 7 DEBUG nova.network.neutron > [req-2ecf34c3-72e7-4f33-89cb-9b250cd6d223 - - - - -] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] Updating instance_info_cache with > network_info: [{"id": "aa2fdd7d-ad18-4890-ad57-14bf9888d2c1", "address": > "fa:16:3e:ca:00:d9", "network": {"id": > "b86c8304-a9bd-4b39-b7fc-f70ffe76f2a8", "bridge": "br-int", "label": > "External_Network", "subnets": [{"cidr": "141.11.42.0/24", "dns": > [{"address": "8.8.8.8", "type": "dns", "version": 4, "meta": {}}, > {"address": "217.218.127.127", "type": "dns", "version": 4, "meta": {}}], > "gateway": {"address": "141.11.42.1", "type": "gateway", "version": 4, > "meta": {}}, "ips": [{"address": "141.11.42.37", "type": "fixed", > "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, > "meta": {}}], "meta": {"injected": true, "tenant_id": > "ef940663426b4c87a751afaf13b758e0", "mtu": 1500, "physical_network": > "physnet1", "tunneled": false}}, "type": "ovs", "details": {"connectivity": > "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": > "system", "bridge_name": "br-int"}, "devname": "tapaa2fdd7d-ad", > "ovs_interfaceid": "aa2fdd7d-ad18-4890-ad57-14bf9888d2c1", "qbh_params": > null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": > {}, "preserve_on_delete": false, "meta": {}}] > update_instance_cache_with_nw_info > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/network/neutron.py:117 > nstance 25c8d676-e20a-4238-a45c-d51daa62b941 actively managed on this > compute host and has allocations in placement: {'resources': {'VCPU': 1, > 'MEMORY_MB': 1024, 'DISK_GB': 20}}. _remove_deleted_instances_allocations > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/resource_tracker.py:1539 > 2022-06-12 16:33:37.595 7 INFO nova.compute.manager > [req-5ecfdf74-7cf3-481a-aa12-140deae202f7 4dbffaa9c14e401c8c210e23ebe0ab7b > ef940663426b4c87a751afaf13b758e0 - default default] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] Took 461.98 seconds to snapshot the > instance on the hypervisor. > 2022-06-12 16:36:16.459 7 DEBUG nova.compute.manager > [req-2ecf34c3-72e7-4f33-89cb-9b250cd6d223 - - - - -] Triggering sync for > uuid 25c8d676-e20a-4238-a45c-d51daa62b941 _sync_power_states > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py:9693 > Lock "25c8d676-e20a-4238-a45c-d51daa62b941" acquired by > "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" > :: waited 0.000s inner > /var/lib/kolla/venv/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:359 > 2022-06-12 16:37:05.365 7 DEBUG nova.compute.resource_tracker > [req-2ecf34c3-72e7-4f33-89cb-9b250cd6d223 - - - - -] Instance > 25c8d676-e20a-4238-a45c-d51daa62b941 actively managed on this compute host > and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': > 1024, 'DISK_GB': 20}}. _remove_deleted_instances_allocations > /var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/resource_tracker.py:1539 > 2022-06-12 09:42:32.687 7 INFO nova.compute.manager > [req-e79e4177-4712-4795-91da-853bc524fac0 93fb420b3c604d4fae408b81135b58e9 > ef940663426b4c87a751afaf13b758e0 - default default] [instance: > 25c8d676-e20a-4238-a45c-d51daa62b941] instance snapshotting > > On Sun, Jun 12, 2022 at 3:36 PM Eugen Block <eblock(a)nde.ag> wrote: > >> Have you tried with debug logs? Has it worked with live snapshots >> before for other instances or did it never work and all snapshots were >> "cold"? >> >> Zitat von Parsa Aminian <p.aminian.server(a)gmail.com>: >> >> > Hi >> > kolla-ansible victoria version with ceph backend without volume >> > >> > On Sun, Jun 12, 2022 at 12:45 PM Eugen Block <eblock(a)nde.ag> wrote: >> > >> >> Hi, >> >> >> >> can you share more details about your environment? Which openstack >> >> version is it? What is the storage backend? In earlier releases there >> >> was an option: >> >> >> >> #disable_libvirt_livesnapshot = false >> >> >> >> but this option has been deprecated. But if you're on an older version >> >> that could explain it. >> >> >> >> Zitat von Parsa Aminian <p.aminian.server(a)gmail.com>: >> >> >> >> > When I snapshot from the instance , server will gone away and its not >> >> > reachable until the snapshot is complete here is the logs : >> >> > 25c8d676-e20a-4238-a45c-d51daa62b941] instance snapshotting >> >> > 2022-06-12 09:42:34.755 7 INFO nova.compute.manager >> >> > [req-786946b1-3d22-489c-bf4d-8b1375b09ecb - - - - -] [instance: >> >> > 25c8d676-e20a-4238-a45c-d51daa62b941] VM Paused (Lifecycle Event) >> >> > 2022-06-12 09:42:34.995 7 INFO nova.compute.manager >> >> > [req-786946b1-3d22-489c-bf4d-8b1375b09ecb - - - - -] [instance: >> >> > 25c8d676-e20a-4238-a45c-d51daa62b941] During sync_power_state the >> >> instance >> >> > has a pending task (image_pending_upload). Skip. >> >> > 2022-06-12 09:42:57.749 7 INFO nova.compute.manager [-] [instance: >> >> > 25c8d676-e20a-4238-a45c-d51daa62b941] VM Stopped (Lifecycle Event) >> >> > 2022-06-12 09:43:06.102 7 INFO nova.virt.libvirt.driver >> >> > [req-e79e4177-4712-4795-91da-853bc524fac0 >> >> 93fb420b3c604d4fae408b81135b58e9 >> >> > ef940663426b4c87a751afaf13b758e0 - default default] [instance: >> >> > 25c8d676-e20a-4238-a45c-d51daa62b941] Snapshot extracted, beginning >> image >> >> > upload >> >> > 2022-06-12 09:43:08.778 7 INFO nova.compute.manager >> >> > [req-786946b1-3d22-489c-bf4d-8b1375b09ecb - - - - -] [instance: >> >> > 25c8d676-e20a-4238-a45c-d51daa62b941] VM Started (Lifecycle Event) >> >> >> >> >> >> >> >> >> >> >> >> >> >> >>

2 8

[VICTORIA][IRONIC] - Can inspect but not deploy
by Gaël THEROND 14 Jun '22

14 Jun '22

Hi everyone! I'm dealing with a strange issue today, we deployed IRONIC on a VICTORIA platform, we activated the dnsmasq pxe filtering option at the inspector level, it works great as only IRONIC listed hosts are then served by the dnsmasq DHCP as those hosts are allowed using the dhcp hosts dir. BUT, I'm having a weird issue now. All my nodes are able to get an IP from the DHCP at the INSPECTION step, however, as soon as the inspection step is finished, the mac related file is once again filled with "<mac>,ignore" which prohibits further operations. This means as soon as I put that node as available and try to deploy an "instance" on it (provision the host), it doesn't work as dnsmasq reject the host boot DHCP requests. So, is there a way to instruct the ironic-conductor to edit/allow the host the way the inspector is able to manipulate this file? Did I missed something? Thanks a lot!

3 6

[Nova] Hardware Architecture Emulation - Summit forum - Emulation beyond just Local QEMU -outcomes
by Race, Jonathan 14 Jun '22

14 Jun '22

Great to see everyone at the summit! For those not in attendance and interested, see the below etherpad that is being used to collect input and requirements as our team moves forward with work. I have also included the outcomes that I have identified. https://etherpad.opendev.org/p/Emulation_going_beyond_local_QEMU Berlin Forum Outcomes I appreciate all the feedback during the forum session, and it was great to have active participation on how to grow and shape this unique feature. We discussed the feature, what it allows, how to actually leverage it, and discussed about further refining the applicable use cases so that operators and users can effectively use it and to help drive interest. A prime example was of a company wanting to shift their infra from x86_64 to arm for the sake of power consumption, and whether this feature could lend its hand to perform some initial fact finding and testing. The answer is yes, you can spin up some of the infra (in your desired arch) on top of your existing deployment and perform your tests and validations. One of the great items that came out of the discussion was that this can not only be to support education, research, and training but it can act as a great 1st step within planning. Meaning when you are going from the drawing board to implementation, you can now model and design your network environments within the cloud for IT and OT systems. This is where refining the use cases really came to light, as our organization leverages OpenStack as a private cloud for hosting extremely customizable network environments (i.e. enterprise iT, IOT, Critical infrastructure, medical devices, etc.) While the feature itself is overall in the experimental phase, it is a great start. This etherpad will remain available and feel free to add to it, as we leverage this year to fact find and identify all further requirements going into the AA release cycle. A snapshot of the discussion points can be found below, and ill be posting the recorded session within the week. * Most operators and providers are running a few releases behind so getting accurate feedback at this time is still ongoing due to this feature only being available in yoga and newer. * Pursuit of additional architectures to be supported (riscv, etc.) * This will require custom firmware support * evaluate current AMI/AKI/ARI functionalities (add ability for leveraging glance if able, and add additional security) * Adding capability for trusted signers of OOVMF file descriptors * evaluating current work related to edk2 oovmf file descriptors * https://github.com/riscv-admin/riscv-uefi-edk2-docs * Expansion and documentation of a valid support matrix * something similar to: (arch x | feat 1 | supported | temptest test 1) * Evaluate requirements for leveraging virtio in relation to scsi/sata devices similar to pci passthrough capabilities Jonathan Race Cyber Range Engineer | Georgia Cyber Range GEORGIA CYBER CENTER 100 Grace Hopper Lane | Augusta, Georgia | 30901 (c) 762-716-7733 www.gacyberrange.org<http://www.gacybercenter.org/> [cid:image001.png@01D87FD1.CF558390]

1 0

[neutron] bug deputy (week of Jun 6)
by Akihiro Motoki 14 Jun '22

14 Jun '22

Hi, I was a bug deputy in neutron. Here is a summary. ## Untriaged * https://bugs.launchpad.net/neutron/+bug/1978088 After ovs-agent restart, table=21 and table=22 on br-tun openflow table is missing This happens when a large number of agents are restarted, but it looks like deeper investigations are needed to understand the situation. (liuyolong and ralonsoh already helped) ## In Progress * https://bugs.launchpad.net/neutron/+bug/1977819 [OVS][QoS] "delete_minimum_bandwidth_queue" uses the incorrect Port UUID High, In Progress * https://bugs.launchpad.net/neutron/+bug/1978519 Create auto allocated topology encounter error when enable ndp_proxy service plugin ## RFE * https://bugs.launchpad.net/neutron/+bug/1978039 [ovn] Floating IP adds distributed attributes ## Fix Released * https://bugs.launchpad.net/neutron/+bug/1977752 [OVS][QoS] Minimum bandwidth backend enforcement does not provide max-rate values * https://bugs.launchpad.net/neutron/+bug/1977969 [OVN] DB sync tool: local variable 'members_to_verify' referenced before assignment" * https://bugs.launchpad.net/neutron/+bug/1978035 remove unused updated_at parameter for AgentCache.update * https://bugs.launchpad.net/neutron/+bug/1978389 Basic networking in Neutron - max VLAN should be 4094, not 4095 * https://bugs.launchpad.net/neutron/+bug/1977831 Response time increasing on new subnets over same network Thanks, Akihiro Motoki (amotoki)

1 0

simple build fails to allocate network interface
by tim+openstack.org＠coote.org 14 Jun '22

14 Jun '22

Hullo I’m trying to spin up a simple OS environment in a single vm and think that I’m making some silly mistake, but cannot spot it. Any hints would be greatly expected. I’ve tried this on a couple of laptops, with the same result, so I suspect that it’s something to do with how I’ve set up my vm, but I cannot identify it. (I think that there may be a few other devstack issues, but I’ve got to get it working to log any bugs). I’m using a vagrant box and VirtualBox on x86 Macs (Monterey), and the devstack install/build process. Everything seems to install, but when I try: `openstack server create --flavor 42 --image cirros-0.5.2-x86_64-disk --nic net-id=2a1a4a3a-a47b-48bd-a7df-c90fc75a1c63 --security-group default wibble` The network id is identified from this: “”" [vagrant@localhost devstack]$ openstack network list +--------------------------------------+---------+----------------------------------------------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+----------------------------------------------------------------------------+ | 205fa7d7-7067-4f63-b3d9-6a9b37b4f11f | public | 1bbbfa3c-8e0a-483f-a084-4e38241b3315, eecfc603-c057-4b28-90bd-950a47345410 | | 2a1a4a3a-a47b-48bd-a7df-c90fc75a1c63 | private | e7377bed-3e22-4e8d-9c2d-ea7ba740fcfd, f915b88c-9988-4e1f-9060-a6295465699a | | fab3fb15-cbd2-45fe-8451-3f0063d59454 | shared | 97e6d8e6-0f57-48bc-8f1d-e30587086153 | +--------------------------------------+---------+——————————————————————————————————————+ “”” Using a public network fails with an error that this isn’t allowed. With the private network above, the failure throws out the following errors. “”" [vagrant@localhost devstack]$ sudo journalctl -f |grep ERROR Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [None req-01294678-b54a-4e40-964c-488ccf03d66c demo demo] [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Instance failed to spawn: nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last): Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7510, in _create_guest_with_network Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] guest = self._create_guest( Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__ Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] next(self.gen) Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 556, in wait_for_instance_event Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] self._wait_for_instance_events( Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 468, in _wait_for_instance_events Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] actual_event = event.wait() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 433, in wait Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] instance_event = self.event.wait() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/usr/local/lib/python3.9/site-packages/eventlet/event.py", line 125, in wait Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] result = hub.switch() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/usr/local/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] return self.greenlet.switch() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] eventlet.timeout.Timeout: 300 seconds Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] During handling of the above exception, another exception occurred: Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last): Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 2728, in _build_resources Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] yield resources Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 2487, in _build_and_run_instance Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] self.driver.spawn(context, instance, image_meta, Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4344, in spawn Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] self._create_guest_with_network( Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7528, in _create_guest_with_network Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] raise exception.VirtualInterfaceCreateException() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [None req-01294678-b54a-4e40-964c-488ccf03d66c demo demo] [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Failed to allocate network(s): nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last): Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7510, in _create_guest_with_network Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] guest = self._create_guest( Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__ Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] next(self.gen) Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 556, in wait_for_instance_event Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] self._wait_for_instance_events( Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 468, in _wait_for_instance_events Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] actual_event = event.wait() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 433, in wait Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] instance_event = self.event.wait() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/usr/local/lib/python3.9/site-packages/eventlet/event.py", line 125, in wait Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] result = hub.switch() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/usr/local/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] return self.greenlet.switch() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] eventlet.timeout.Timeout: 300 seconds Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] During handling of the above exception, another exception occurred: Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Traceback (most recent call last): Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/compute/manager.py", line 2487, in _build_and_run_instance Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] self.driver.spawn(context, instance, image_meta, Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4344, in spawn Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] self._create_guest_with_network( Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7528, in _create_guest_with_network Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] raise exception.VirtualInterfaceCreateException() Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Jun 08 15:33:52 localhost.localdomain nova-compute[87555]: ERROR nova.compute.manager [None req-01294678-b54a-4e40-964c-488ccf03d66c demo demo] [instance: 20e1b5bf-130a-48f9-af4e-9b4c7a475315] Build of instance 20e1b5bf-130a-48f9-af4e-9b4c7a475315 aborted: Failed to allocate the network(s), not rescheduling.: nova.exception.BuildAbortException: Build of instance 20e1b5bf-130a-48f9-af4e-9b4c7a475315 aborted: Failed to allocate the network(s), not rescheduling. “”" The Vagrantfile (commented out lines relate to trying this with Ubunutu, which failed the same way, and attempts to use multiple vms): “”" # -*- mode: ruby -*- # vi: set ft=ruby : $script = <<-SHELL dnf update -y #apt update #apt upgrade echo "updated" systemctl disable firewalld systemctl stop firewalld systemctl disable NetworkManager systemctl stop NetworkManager systemctl enable network systemctl start network #dnf config-manager --enable powertools #dnf install -y centos-release-openstack-yoga dnf update -y dnf install -y git python3-pip #dnf install -y openstack-packstack #packstack --provision-demo=n --os-neutron-ml2-type-drivers=vxlan,flat,vlan --gen-answer-file=packstack-answers.txt #sed -i -e 's:10.0.2.15:10.1.0.10:' packstack-answers.txt # not for centos 9 #dnf install -y network-scripts dnf install -y net-tools #cat /vagrant/answers.addon >> packstack-answers.txt # don't want this, but httpd won't start without it setenforce 0 pip3 install invoke #packstack --allinone cd /vagrant # permissions all wrong: ./go.sh # need su - vagrant cd /vagrant && ./go.sh (?) # cd devstack # not working: wrong user ./stack.sh SHELL Vagrant.configure(2) do |config| config.vm.box = "eurolinux-vagrant/centos-stream-9" #config.vm.box = "hashicorp/bionic64" # machines = { # 'node1.example.dd' #'node1.example.dd' => { :ip => '10.1.0.10'}, # 'node2.example.dd' => { :ip =>'10.1.0.12'}, # } config.hostmanager.enabled = true config.hostmanager.manage_host = true config.hostmanager.manage_guest = true config.hostmanager.ignore_private_ip = false config.hostmanager.include_offline = true config.ssh.pty = true config.vm.provision "shell", inline: $script config.vm.network "forwarded_port", guest: 80, host: 8080 # machines.each do | hostname, attrs| # config.vm.define hostname do |machine| # machine.vm.hostname = hostname # machine.vm.network :private_network, :ip => attrs[:ip] # machine.vm.provider "virtualbox" do | v | config.vm.provider "virtualbox" do | v | #v.memory = "4096" #v.memory = "8192" v.memory = "9216" v.cpus = "2" end #end # end end “”” I think that the vm has enough RAM, although there is minimal swap being used, but I think that this is not significant as there is much more RAM used for caching files. Any obvious hints as to why the spin up fails to create the NIC - or somewhere to look for further and better details? Tim

4 6