December 2021 - openstack-discuss

[nova][placement] Cancelling Dec 21st and Dec 28th IRC meetings
by Sylvain Bauza 08 Dec '21

08 Dec '21

As we agreed on yesterday's meeting [1] we are about to cancel Dec 21st and Dec 28th meetings as we won't have a quorum for contributors during those weeks :-) -Sylvain [1] https://meetings.opendev.org/meetings/nova/2021/nova.2021-12-07-16.00.html

1 0

[Triple0] [Undercloud] Overcloud deployment getting failed at Introspection
by Lokendra Rathour 08 Dec '21

08 Dec '21

Hi Team, we are trying to deploy the triple0 Stein release on Centos 7. Undercloud is getting deployed successfully but the introspection of the overcloud node is getting failed with the reason as below: *on the DNS podman logs:* ()[root@undercloud dhcp-hostsdir]# tail -f /var/log/ironic-inspector/dnsmasq.log Dec 7 11:21:08 dnsmasq-dhcp[8]: DHCPDISCOVER(br-ctlplane) f8:f2:1e:9e:82:51 ignored Dec 7 11:21:08 dnsmasq-dhcp[8]: DHCPDISCOVER(br-ctlplane) f8:f2:1e:9e:82:50 ignored Dec 7 11:21:12 dnsmasq-dhcp[8]: DHCPDISCOVER(br-ctlplane) f8:f2:1e:9e:82:51 ignored *Checking the TCPDUMP at the same time gives:* 11:38:38.308660 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from f8:f2:1e:9e:82:51 (oui Unknown), length 300 11:38:38.435173 IP6 fe80::f53a:6448:4a29:e051 > ff02::16: HBH ICMP6, multicast listener report v2, 1 group record(s), length 28 11:38:38.435184 IP6 fe80::f53a:6448:4a29:e051 > ff02::16: HBH ICMP6, multicast listener report v2, 1 group record(s), length 28 11:38:41.155784 IP6 fe80::322d:3253:e3b2:316e > ff02::2: ICMP6, router solicitation, length 8 11:38:41.394304 IP6 fe80::f53a:6448:4a29:e051 > ff02::2: ICMP6, router solicitation, length 8 11:38:42.563182 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from f8:f2:1e:9e:82:50 (oui Unknown), length 300 11:38:42.611973 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from f8:f2:1e:9e:82:51 (oui Unknown), length 300 *We observed that DHCP Server is not offering the IP to the baremetal. * *DHCP discovery comes at br-ctlplane but no ip is offered.* Any input would be really helpful. Best Regards, Lokendra

2 3

[cinder] Bug deputy report for week of 12-08-2021
by Sofia Enriquez 08 Dec '21

08 Dec '21

This is a bug report from 11-24-2021 to 12-08-2021. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Medium - https://bugs.launchpad.net/cinder/+bug/1953168 ``Argument error in log message capacity filter". Assigned to caiquemello and Fix proposed. - https://bugs.launchpad.net/cinder/+bug/1952804 "cinder schedules backups on disabled backup services". Unassigned. - https://bugs.launchpad.net/cinder/+bug/1953185 "[IBM Storwize] Restore VM snapshot issue with replication volumes". Unassigned. - https://bugs.launchpad.net/cinder/+bug/1952927 "HPE 3PAR: migrating the vm attached with volume has been retyped will cause old volume to attach back again". Unassigned. - https://bugs.launchpad.net/cinder/+bug/1952805 "[posix] cinder schedules incremental backups on the wrong node". Unassigned. - https://bugs.launchpad.net/cinder/+bug/1952355 "[powerflex] Allocated capacity calculation doesn't work with powerflex driver". Unassigned. Low - https://bugs.launchpad.net/cinder/+bug/1953050 "A service should use a service specific control exchange for rpc". Fix proposed on master. *Quotas and more:* - https://bugs.launchpad.net/cinder/+bug/1952420 "Quota shows warnings on backup creation". Assigned to Gorka and Fix proposed. - https://bugs.launchpad.net/cinder/+bug/1952635 "When changing no_snapshot_gb_quota the gigabytes are wrong". Assigned to Gorka and Fix proposed. - https://bugs.launchpad.net/cinder/+bug/1952463 " Quota defaults and limits are not deleted when a volume type is deleted". Assigned to Gorka and Fix proposed. - https://bugs.launchpad.net/cinder/+bug/1952443 "Slow listings with many projects and deleted resources". Assigned to Gorka and Fix proposed. - https://bugs.launchpad.net/cinder/+bug/1952456 " Incorrect limit for private type volumes". Assigned to Gorka and Fix proposed. - https://bugs.launchpad.net/cinder/+bug/1952683 "Documentation typos". Fix proposed on master. Incomplete - https://bugs.launchpad.net/cinder/+bug/1952998 "[Ceph] Volume backup created with multiple snapshots preventing removal". Unassigned. Cheers -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

[ironic] [ops] RFC: deprecating instance network boot in Ironic
by Dmitry Tantsur 08 Dec '21

08 Dec '21

Hi folks, As discussed at the PTG, I'd like to collect thoughts about this proposal. I would like to deprecate support for network-booting **normal instances**. This does not concern the deployment process, ramdisk deploy or booting from volume! Historically, Ironic has been able to boot the final instances from network (or ISO in case of virtual media). This is no longer the recommended mode, except for the ramdisk deploy or boot-from-volume. It adds quite a bit of complexity to deploy interfaces and has one serious security implication: there is no way to update kernel/ramdisk once the instance is deployed (without rebuilding it). For this reason, I don't think anybody should use instance network booting in production. I would like to announce the deprecation in the Yoga cycle with the intention of removing the feature in Z. Then we can also get rid of the boot_option capability (which is not really a capability). Am I missing something? Any objections? Dmitry -- Red Hat GmbH, https://de.redhat.com/ , Registered seat: Grasbrunn, Commercial register: Amtsgericht Muenchen, HRB 153243, Managing Directors: Charles Cachera, Brian Klemm, Laurie Krebs, Michael O'Neill

1 0

How to config vGPU in cyborg
by norman.kern 08 Dec '21

08 Dec '21

Hi guys, I want to config cyborg with kolla in openstack wallaby cluster, but I found that few docs can be found to config vGPU, Where can I find the details in configuration from openstack website? And I found another question, Cyborg can not config different types of vGPU for a pGPU. Waiting for you replies. Thanks.

1 0

[horizon] No Weekly meeting today
by vishal manchanda 08 Dec '21

08 Dec '21

Hello Team, Since there are no agenda items [1] to discuss for today's horizon weekly meeting. So let's cancel today's weekly meeting. Next weekly meeting will be on 15 December. Thanks & Regards, Vishal Manchanda [1] https://etherpad.opendev.org/p/horizon-release-priorities

1 0

[all][ptl][tc] Updates on Community wide goal: Current Active goals
by Ghanshyam Mann 08 Dec '21

08 Dec '21

Hello Everyone, You might know, TC has de-coupled the community-wide goals from the release cycle[1]. As per the new structure, community-wide goals are tied or have to be finished within the release cycle. Instead, it can have target dates which can be a particular cycle release date or multi-cycle or even in between a release cycle. Target dates will be selected by considering the amount of work needed and the community bandwidth. This will help to make sure the goal is ready to start and also continue working on the goal until work is completed. 'Secure RBAC' goal is one example of a new structure that has different milestones targeting the different set of work[2]. I think this will be helpful for PTLs and project teams to plan the active goals for their project. Current Selected (Active) Goals: ------------------------------------- We have two Selected/Active goals. The project team can start/continue working on: 1. Migrate from oslo.rootwrap to oslo.privsep [3]. This is contouring from the previous cycle. 2. Consistent and Secure Default RBAC [4]. New design/implementation details are finalized now, please read those and for any queries, plan to attend the policy popup team biweekly meeting[5]. [1] https://review.opendev.org/c/openstack/governance/+/816387 [2] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rb… [3] https://governance.openstack.org/tc/goals/selected/migrate-to-privsep.html [4] https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rb… [5] https://wiki.openstack.org/wiki/Consistent_and_Secure_Default_Policies_Popu… -gmann

1 0

Glance review party - 2021-12-10T14:00:00Z
by Cyril Roelandt 07 Dec '21

07 Dec '21

Hello, On Friday (2021-12-10), at 14:00 UTC, we will have a "review party" for Glance. The party should last 2 to 3 hours, and the goal will be to clean the backlogs of glance_store and glanceclient, and try to work on the glance backlog as well if there is enough time. If some of your patches are currently in "merge conflict", please rebase them and make sure the tests pass, which will allow us to review them. If you think some of your *Glance* patches are a top priority for the project, please answer this email with a link to them, and we will try to make time to review them on Friday. We will be using https://bluejeans.com/u/croeland to coordinate. Happy Hacking! Cyril Roelandt

1 0

[neutron] Instances can't get IP from the DHCP server in OpenStack
by 韩光宇 07 Dec '21

07 Dec '21

Hi, I'm trying to create instance in OpenStack Victoria. But, I am facing a issues about dhcp of neutron. I have OpenStack Victoria running in one baremetl server with uniontech os(a downstream of centos 8). I have a Flat network created in the range of 10.12.21.190-10.12.21.195. I selected to have a DHCP. The instance ran, and neutron-dhcp-agent.service had allocated a IP to it.  # openstack server list +--------------------------------------+-------+--------+-----------------------+----------------+--------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-------+--------+-----------------------+----------------+--------+ | 4ccae37e-fbfe-4acb-a109-e1bc9175c2e0 | inst1 | ACTIVE | provider=10.12.21.192 | centos8-server | h2 | +--------------------------------------+-------+--------+-----------------------+----------------+--------+ But the instance can't get a response from DHCP.  No any error in log. And if I setup the ip manually in the instance I can get access to the gateway, dhcp port and external network. I can catpure the DHCP request in any network device in the server, include dhcp port(10.12.21.190). But no response.  Dnsmasq process was running and had  # openstack port list +--------------------------------------+------+-------------------+-----------------------------------------------------------------------------+--------+ | ID | Name | MAC Address | Fixed IP Addresses | Status | +--------------------------------------+------+-------------------+-----------------------------------------------------------------------------+--------+ | 5ab32ca8-2d1d-47cf-9a62-7c01d21abaf0 | | fa:16:3e:1d:48:45 | ip_address='10.12.21.192', subnet_id='3daf5a55-e76a-4093-8533-78d9464b1beb' | ACTIVE | | 63fb2306-7759-4933-8d93-590e3a56f315 | | fa:16:3e:c5:59:9a | ip_address='10.12.21.190', subnet_id='3daf5a55-e76a-4093-8533-78d9464b1beb' | ACTIVE | +--------------------------------------+------+-------------------+-----------------------------------------------------------------------------+--------+ # ip netns qdhcp-ec2c4d9d-888b-4312-b0af-ab2127b76e0e (id: 0) # sudo ip netns exec qdhcp-ec2c4d9d-888b-4312-b0af-ab2127b76e0e sudo tcpdump -n -S -i tap63fb2306-77|grep DHCP ## notes: fa:16:3e:1d:48:45 is the mac of nic of inst1 dropped privs to tcpdump tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on tap63fb2306-77, link-type EN10MB (Ethernet), capture size 262144 bytes 16:47:18.194028 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from fa:16:3e:1d:48:45, length 276 16:47:21.146736 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from fa:16:3e:1d:48:45, length 276 16:47:25.226387 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from fa:16:3e:1d:48:45, length 276 more detail informations: # ps -ef|grep dnsmasq dnsmasq 7441 1 0 12月03 ? 00:00:00 dnsmasq --no-hosts --no-resolv --pid-file=/var/lib/neutron/dhcp/ec2c4d9d-888b-4312-b0af-ab2127b76e0e/pid --dhcp-hostsfile=/var/lib/neutron/dhcp/ec2c4d9d-888b-4312-b0af-ab2127b76e0e/host --addn-hosts=/var/lib/neutron/dhcp/ec2c4d9d-888b-4312-b0af-ab2127b76e0e/addn_hosts --dhcp-optsfile=/var/lib/neutron/dhcp/ec2c4d9d-888b-4312-b0af-ab2127b76e0e/opts --dhcp-leasefile=/var/lib/neutron/dhcp/ec2c4d9d-888b-4312-b0af-ab2127b76e0e/leases --dhcp-match=set:ipxe,175 --dhcp-userclass=set:ipxe6,iPXE --local-service --bind-dynamic --dhcp-range=set:subnet-3daf5a55-e76a-4093-8533-78d9464b1beb,10.12.21.0,static,255.255.255.0,86400s --dhcp-option-force=option:mtu,1500 --dhcp-lease-max=256 --conf-file= --domain=openstacklocal dnsmasq 317868 1 0 14:33 ? 00:00:00 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper root 317869 317868 0 14:33 ? 00:00:00 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper root 340315 317310 0 18:43 pts/2 00:00:00 grep --color=auto dnsmasq [root@a16 ~]# cat /var/lib/neutron/dhcp/ec2c4d9d-888b-4312-b0af-ab2127b76e0e/host fa:16:3e:c5:59:9a,host-10-12-21-190.openstacklocal,10.12.21.190 fa:16:3e:1d:48:45,host-10-12-21-192.openstacklocal,10.12.21.192 # ovs-vsctl show adbd4b0c-cb78-4b8f-b8a6-197c5948312c Manager "ptcp:6640:127.0.0.1" is_connected: true Bridge br0 Controller "tcp:127.0.0.1:6633" is_connected: true fail_mode: secure datapath_type: system Port enp5s0 Interface enp5s0 Port phy-br0 Interface phy-br0 type: patch options: {peer=int-br0} Port br0 Interface br0 type: internal Bridge br-tun Controller "tcp:127.0.0.1:6633" is_connected: true fail_mode: secure datapath_type: system Port br-tun Interface br-tun type: internal Port patch-int Interface patch-int type: patch options: {peer=patch-tun} Bridge br-int Controller "tcp:127.0.0.1:6633" is_connected: true fail_mode: secure datapath_type: system Port int-br0 Interface int-br0 type: patch options: {peer=phy-br0} Port br-int Interface br-int type: internal Port tap63fb2306-77 tag: 1 Interface tap63fb2306-77 type: internal Port patch-tun Interface patch-tun type: patch options: {peer=patch-int} Port qvo5ab32ca8-2d tag: 1 Interface qvo5ab32ca8-2d ovs_version: "2.13.0". # ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp5s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master ovs-system state UP group default qlen 1000 link/ether 1c:69:7a:92:be:30 brd ff:ff:ff:ff:ff:ff 3: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether ea:f5:ce:24:93:12 brd ff:ff:ff:ff:ff:ff 4: br0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether 1c:69:7a:92:be:30 brd ff:ff:ff:ff:ff:ff inet 10.12.21.142/24 scope global br0 valid_lft forever preferred_lft forever inet6 fe80::1e69:7aff:fe92:be30/64 scope link valid_lft forever preferred_lft forever 5: br-int: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether ba:5d:16:cf:89:40 brd ff:ff:ff:ff:ff:ff inet6 fe80::b85d:16ff:fecf:8940/64 scope link valid_lft forever preferred_lft forever 9: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 86:bb:24:69:7e:43 brd ff:ff:ff:ff:ff:ff 11: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000 link/ether 52:54:00:4d:96:e4 brd ff:ff:ff:ff:ff:ff inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0 valid_lft forever preferred_lft forever 12: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel master virbr0 state DOWN group default qlen 1000 link/ether 52:54:00:4d:96:e4 brd ff:ff:ff:ff:ff:ff 13: qbr5ab32ca8-2d: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 76:0e:be:40:a6:ee brd ff:ff:ff:ff:ff:ff 14: qvo5ab32ca8-2d@qvb5ab32ca8-2d: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000 link/ether 12:90:d5:07:2a:a2 brd ff:ff:ff:ff:ff:ff inet6 fe80::1090:d5ff:fe07:2aa2/64 scope link valid_lft forever preferred_lft forever 15: qvb5ab32ca8-2d@qvo5ab32ca8-2d: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master qbr5ab32ca8-2d state UP group default qlen 1000 link/ether 76:0e:be:40:a6:ee brd ff:ff:ff:ff:ff:ff inet6 fe80::740e:beff:fe40:a6ee/64 scope link valid_lft forever preferred_lft forever 16: tap5ab32ca8-2d: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master qbr5ab32ca8-2d state UNKNOWN group default qlen 1000 link/ether fe:16:3e:1d:48:45 brd ff:ff:ff:ff:ff:ff inet6 fe80::fc16:3eff:fe1d:4845/64 scope link valid_lft forever preferred_lft forever # cat /etc/neutron/plugins/ml2/openvswitch_agent.ini [ovs] local_ip = 10.12.21.142 datapath_type = system bridge_mappings = provider:br0 [vxlan] enable_vxlan = true local_ip = 10.12.21.142 l2_population = true prevent_arp_spoofing = True [securitygroup] enable_security_group = True firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver # cat /etc/neutron/dhcp_agent.ini [DEFAULT] interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver dhcp_driver = neutron.agent.linux.dhcp.Dnsmasq enable_isolated_metadata = true     I would very very appreciate any kind of guidance or help. Thanks, Han Guangyu

2 4

[neutron][CI] How to reduce number of rechecks - brainstorming
by Slawek Kaplonski 07 Dec '21

07 Dec '21

Hi, Recently I spent some time to check how many rechecks we need in Neutron to get patch merged and I compared it to some other OpenStack projects (see [1] for details). TL;DR - results aren't good for us and I think we really need to do something with that. Of course "easiest" thing to say is that we should fix issues which we are hitting in the CI to make jobs more stable. But it's not that easy. We are struggling with those jobs for very long time. We have CI related meeting every week and we are fixing what we can there. Unfortunately there is still bunch of issues which we can't fix so far because they are intermittent and hard to reproduce locally or in some cases the issues aren't realy related to the Neutron or there are new bugs which we need to investigate and fix :) So this is never ending battle for us. The problem is that we have to test various backends, drivers, etc. so as a result we have many jobs running on each patch - excluding UT, pep8 and docs jobs we have around 19 jobs in check and 14 jobs in gate queue. In the past we made a lot of improvements, like e.g. we improved irrelevant files lists for jobs to run less jobs on some of the patches, together with QA team we did "integrated-networking" template to run only Neutron and Nova related scenario tests in the Neutron queues, we removed and consolidated some of the jobs (there is still one patch in progress for that but it should just remove around 2 jobs from the check queue). All of that are good improvements but still not enough to make our CI really stable :/ Because of all of that, I would like to ask community about any other ideas how we can improve that. If You have any ideas, please send it in this email thread or reach out to me directly on irc. We want to discuss about them in the next video CI meeting which will be on November 30th. If You would have any idea and would like to join that discussion, You are more than welcome in that meeting of course :) [1] http://lists.openstack.org/pipermail/openstack-discuss/2021-November/ 025759.html -- Slawek Kaplonski Principal Software Engineer Red Hat

11 19