September 2020 - openstack-discuss

[Neutron] Bug Deputy Report (Sep 14 - Sep 19)
by Hongbin Lu 19 Sep '20

19 Sep '20

Hi all, Below is the bug deputy report: High: * https://bugs.launchpad.net/neutron/+bug/1895671 [OVN] test_add_interface_in_use fail with OVN Midium: * https://bugs.launchpad.net/neutron/+bug/1895933 Admin user can do anything without the control of policy.json * https://bugs.launchpad.net/neutron/+bug/1895950 keepalived can't perform failover if the l3 agent is down * https://bugs.launchpad.net/neutron/+bug/1895972 IPv6 prefix delegation for OVN routers Low: * https://bugs.launchpad.net/neutron/+bug/1896217 [OVS] When "explicitly_egress_direct" is enabled, egress flows are not deleted when the port is removed Undecided: * https://bugs.launchpad.net/neutron/+bug/1895677 [OVS][FW] In some cases, OVS FW tries to set a OF rule when ofport = -1 * https://bugs.launchpad.net/neutron/+bug/1896203 TypeError: Cannot look up record by empty string in check_for_igmp_snoop_support task * https://bugs.launchpad.net/neutron/+bug/1896205 AttributeError: 'NoneType' object has no attribute 'db_find_rows' during neutron-server startup * https://bugs.launchpad.net/neutron/+bug/1896226 The vnics are disappearing in the vm Invalid: * https://bugs.launchpad.net/neutron/+bug/1895636 'NoneType' object has no attribute 'address_scope_id'

1 0

[rpm-packaging][packaging][sigs] Moving to a packaging SIG
by Jean-Philippe Evrard 18 Sep '20

18 Sep '20

Hello folks, It's maybe a little late, as the elections process already have started, but I think it's worth re-opening the conversation about migrating the rpm-packaging project to a SIG. Last time we tried this, we were stopped by bureaucracy and technical details (IIRC?) which shouldn't be there anymore. I don't see a reason why this team couldn't move to a SIG now, which would be a lightweight governance model for you. You would keep your repos, and can still propose releases (if I am not mistaken). Things shouldn't change much. You can decide to change/add chair people when you want, and don't have to sign off a PTL for 6 months at elections, which was the most concerning matter for your projects IIRC (which lead to missed elections deadlines in the past). I hope that this SIG can evolve in the future, to group not only RPM packaging, but also other packaging mechanism that want to follow under that new banner. That's why I proposed the SIG to be named "Packaging" instead. It's up to the community now to gather around the same banner :) So if you're interested with this change, please vote on here: [1] [2]. Regards, Jean-Philippe Evrard (evrardjp) [1]: https://review.opendev.org/752659 [2]: https://review.opendev.org/752661

4 9

[tripleo] patch abandonment, cleaning up gerrit
by Wesley Hayutin 18 Sep '20

18 Sep '20

Greetings, FYI folks I'm going to tear through our projects today and abandon patches older than 365 days. Please read through our policy [1] if you have any questions or concerns. It will be nice to have a little clean up before the next release and PTL take over :) Thanks [1] https://specs.openstack.org/openstack/tripleo-specs/specs/policy/patch-aban…

1 1

[TC][nova] Failing device detachments on Focal
by Balázs Gibizer 18 Sep '20

18 Sep '20

Hi, I want to raise a potential conflict between the fact that OpenStack Victoria officially supports Ubuntu Focal[3] and a high severity regression in Nova [1] caused by a qemu bug [2] in the qemu version that is shipped with Focal. The Nova team documented[4] it as a limitation without a known workaround in Nova. Also as far as I know Canonical does not support downgrading the qemu version so I don't see a viable workaround on Focal side either. Is the Nova reno[4] enough from the TC perspective to go forward with the switch to Focal and with the Victoria release? cheers, gibi [1] https://bugs.launchpad.net/nova/+bug/1882521 [2] https://bugs.launchpad.net/qemu/+bug/1894804 [3] https://governance.openstack.org/tc/reference/runtimes/victoria.html [4] https://review.opendev.org/#/c/752654

5 6

[manila] Bug squash event coming up next Monday (September 21st)
by Victoria Martínez de la Cruz 18 Sep '20

18 Sep '20

Hi all, After the success of our doc-a-thon last month (details to come soon in the original thread) we decided to repeat the experience, this time, with code bugs. We are organizing a bugs squash next Monday, September 21st, with the main goal of closing several bugs in preparation for the RC (that we are cutting next week). We will gather on our Freenode channel #openstack-manila at 3pm UTC and we will use this Jitsi bridge [0] to go over a curated list (thanks Vida!) of opened bugs we have here [1] *Your* participation is truly valued, being you an already Manila contributor or if you are interested in contributing and you didn't know how, so looking forward to seeing you there :) Cheers, Victoria [0] https://meetpad.opendev.org/ManilaV-ReleaseBugSquashRC [1] http://ethercalc.openstack.org/26utlmzuk6cc

1 0

[all][qa][ci][kuryr] Default swap size of gate VMs is 1 GB now
by Michał Dulko 18 Sep '20

18 Sep '20

Hi, Last Friday Kuryr team noticed elevated rate of failures of the kuryr- kubernetes gate jobs. Later on we've tracked it down to oom-killer slaying our Amphora instances. We couldn't find a reason why that only started to happen on Friday, until now. So commit [1] reduced default swap size to 1 GB. If your jobs need more memory - you can try overwriting that in your job configs like we do in [2]. I'm posting this to save people from a week of debugging as it wasn't a fun activity. ;) Thanks, Michał [1] https://opendev.org/openstack/openstack-zuul-jobs/commit/45f555fdf036de786b… [2] https://review.opendev.org/#/c/752233/4/.zuul.d/base.yaml@35

1 0

[neutron][ovn] Logical flow scaling (flow explosion in lr_in_arp_resolve)
by Krzysztof Klimonda 18 Sep '20

18 Sep '20

Hi, We're running some tests of ussuri deployment with ovn ML2 driver and seeing some worrying numbers of logical flows generated for our test deployment. As a test, we create 400 routes, 400 private networks and connect each network to its own routers. We also connect each router to an external network. After doing that a dump of logical flows shows almost 800k logical flows, most of them in lr_in_arp_resolve table: --8<--8<--8<-- # cat lflows.txt |grep -v Datapath |cut -d'(' -f 2 | cut -d ')' -f1 |sort | uniq -c |sort -n | tail -10 3264 lr_in_learn_neighbor 3386 ls_out_port_sec_l2 4112 lr_in_admission 4202 ls_in_port_sec_l2 4898 lr_in_lookup_neighbor 4900 lr_in_ip_routing 9144 ls_in_l2_lkup 9160 ls_in_arp_rsp 22136 lr_in_ip_input 671656 lr_in_arp_resolve # --8<--8<--8<-- ovn: 20.06.2 + patch for SNAT IP ARP reply issue openvswitch: 2.13.0 neutron: 16.1.0 I've seen some discussion about similar issue at OVS mailing lists: https://www.mail-archive.com/ovs-discuss@openvswitch.org/msg07014.html - is this relevant to neutron, and not just kubernetes? -- Krzysztof Klimonda kklimonda(a)syntaxhighlighted.com

3 5

[tripleo][ci] collectd-mysql
by Wesley Hayutin 18 Sep '20

18 Sep '20

Greetings, More fun as usual. Error: Problem: cannot install the best candidate for the job - nothing provides libmysqlclient.so.21()(64bit) needed by collectd-mysql-5.11.0-2.el8.x86_64 - nothing provides libmysqlclient.so.21(libmysqlclient_21.0)(64bit) needed by collectd-mysql-5.11.0-2.el8.x86_64 (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) https://bugs.launchpad.net/tripleo/+bug/1896178 https://review.rdoproject.org/r/#/c/29472/ 0/

2 1

[release] Release countdown for week R-3 Sept 21 - 25
by Sean McGinnis 18 Sep '20

18 Sep '20

Development Focus ----------------- The Release Candidate (RC) deadline is next Thursday, September 24. Work should be focused on fixing any release-critical bugs. General Information ------------------- All deliverables released under a cycle-with-rc model should have a first release candidate by the end of the week, from which a stable/victoria branch will be cut. This branch will track the victoria release. Once stable/victoria has been created, master will be ready to switch to wallaby development. While master will no longer be feature-frozen, please prioritize any work necessary for completing victoria plans. Release-critical bugfixes will need to be merged in the master branch first, then backported to the stable/victoria branch before a new release candidate can be proposed. Actions ------- Early in the week, the release team will be proposing RC1 patches for all cycle-with-rc projects, using the latest commit from master. If your team is ready to go for cutting RC1, please let us know by leaving a +1 on these patches. If there are still a few more patches needed before RC1, you can -1 the patch and update it later in the week with the new commit hash you would like to use. Remember, stable/victoria branches will be created with this, so you will want to make sure you have what you need included to avoid needing to backport changes from master (which will technically then be wallaby) to this stable branch for any additional RCs before the final release. The release team will also be proposing releases for any deliverable following a cycle-with-intermediary model that has not produced any victoria release so far. Finally, if you haven't submitted any yet, now is a good time to finalize release highlights. Release highlights help shape the messaging around the release and make sure that your work is properly represented. Upcoming Deadlines & Dates -------------------------- RC1 deadline: September 24 (R-3) Final Victoria release: October 14 Open Infra Summit: October 19-23 Wallaby PTG: October 26-30

1 0

[all][goals] Switch legacy Zuul jobs to native - update #4
by Luigi Toscano 17 Sep '20

17 Sep '20

Hi, another round of updates. The list of the remaining legacy jobs is shortening but the Victoria branching will happen next week, so we need to speed up a bit. Status ====== As usual, the etherpad [3] lists the full status and the links to the patches. Here is a more detailed report for each remaining project. cinder ------ The only legacy job left is a bit unusual, but there is a WIP review now. It needs some more work to fix the reporting. designate --------- The patch for only legacy job has been approved, but there is an unrelated issue which requires input from the designate team. heat ------ Only one legacy job left, the heat cores are aware of it. infra ----- Only one devstack-gate job in the os-loganalyze repository, which should be probably retired. There are 2 other legacy jobs, but not devstack-gate, so less urgent. ironic ------ The port of the remaining legacy job is going to be merged soon (even though it's failing, but the legacy job is failing as well). manila ------ There is only one legacy-base job (not devstack-gate), so less urgent, but there is a patch for it. monasca ------- The monasca-transform contains a devstack-gate legacy job, but the repository is almost retired. There are 3 legacy (non devstack-gate) jobs in other repositories. murano ------ There are two legacy jobs left (murano-apps-refstackclient-unittest and murano-dashboard-sanity-check) which require some input from the team. neutron ------- Only two legacy grenade jobs are left and they are being worked on. nova ---- The work is ongoing on the remaining legacy jobs (a new job which will replace a legacy one, and a grenade job)). zaqar ----- Mostly done, it only requires a python-zaqarclient backport to be merged in Victoria. References ========== [1] the goal: https://governance.openstack.org/tc/goals/selected/victoria/native-zuulv3-j… [2] the up-to-date Zuul v3 porting guide: https://docs.openstack.org/project-team-guide/zuulv3.html [3] the etherpad which tracks the current status: https://etherpad.opendev.org/p/goal-victoria-native-zuulv3-migration [4] the previous reports: http://lists.openstack.org/pipermail/openstack-discuss/2020-July/016058.html http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016561.h… http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016892.h… Ciao -- Luigi

1 0