January 2023 - openstack-discuss - lists.openstack.org

Issue resizing volumes attached to running volume backed instances
by Jérôme BECOT 12 Jan '23

12 Jan '23

Hello Openstack, We have Ussuri deployed on a few clouds, and they're all plugged to PureStorage Arrays. We allow users to only use volumes for their servers. It means that each server disk is a LUN attached over ISCSI (with multipath) on the compute node hosting the server. Everything works quite fine, but we have a weird issue when extending volumes attached to running instances. The guests notice the new disk size .. of the last extent. Say I have a server with a 10gb disk. I add 5gb. On the guest, still 10gb. I add another 5gb, and on the guest I get 15, and so on. I've turned the debug mode on and I could see no error in the log. Looking closer at the log I could catch the culprit: 2022-12-08 17:35:13.998 46195 DEBUG os_brick.initiator.linuxscsi [] Starting size: *76235669504* 2022-12-08 17:35:14.028 46195 DEBUG os_brick.initiator.linuxscsi [] volume size after scsi device rescan *80530636800* extend_volume 2022-12-08 17:35:14.035 46195 DEBUG os_brick.initiator.linuxscsi [] Volume device info = {'device': '/dev/disk/by-path/ip-1...1:3260-iscsi-iqn.2010-06.com.purestorage:flasharray.x-lun-10', 'host': '5', 'channel': '0', 'id': '0', 'lun': '10'} extend_volume 2022-12-08 17:35:14.348 46195 INFO os_brick.initiator.linuxscsi [] Find Multipath device file for volume WWN 3624... 2022-12-08 17:35:14.349 46195 DEBUG os_brick.initiator.linuxscsi [] Checking to see if /dev/disk/by-id/dm-uuid-mpath-3624.. exists yet. wait_for_path 2022-12-08 17:35:14.349 46195 DEBUG os_brick.initiator.linuxscsi [] /dev/disk/by-id/dm-uuid-mpath-3624... has shown up. wait_for_path 2022-12-08 17:35:14.382 46195 INFO os_brick.initiator.linuxscsi [] mpath(/dev/disk/by-id/dm-uuid-mpath-3624) *current size 76235669504* 2022-12-08 17:35:14.412 46195 INFO os_brick.initiator.linuxscsi [] mpath(/dev/disk/by-id/dm-uuid-mpath-3624) *new size 76235669504* 2022-12-08 17:35:14.413 46195 DEBUG oslo_concurrency.lockutils [] Lock "extend_volume" released by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 2.062s inner 2022-12-08 17:35:14.459 46195 DEBUG os_brick.initiator.connectors.iscsi [] <== extend_volume: return (2217ms) *76235669504* trace_logging_wrapper 2022-12-08 17:35:14.461 46195 DEBUG nova.virt.libvirt.volume.iscsi [] Extend iSCSI Volume /dev/dm-28; new_size=*76235669504* extend_volume 2022-12-08 17:35:14.462 46195 DEBUG nova.virt.libvirt.driver [] Resizing target device /dev/dm-28 to *76235669504* _resize_attached_volume The logs clearly shows that the rescan confirm the new size but when interrogating multipath, it does not. But requesting multipath few seconds after on the command line shows the new size as well. It explains the behaviour. I'm running Ubuntu 18.04 with multipath 0.7.4-2ubuntu3.2. The os-brick code for multipath is far more basic than the one in master branch. Maybe the multipath version installed is too recent for os-brick. Thanks for the help Jerome

2 2

[CI][Tempest] Broken tempest-full-multinode-py3 job
by Lukas Piwowarski 12 Jan '23

12 Jan '23

Hi, I've got stuck trying to figure out why one of our tempest jobs is failing. I will be grateful for any kind of input regarding potential solutions. I did a little investigation of the failing job (tempest-multinode-full-py3 [1][2]) and this is what I found: - The failure is mostly caused by scenario tests. There was one occurrence of failure outside of the scenario tests ( test_create_servers_on_different_hosts_with_list_of_servers) - The failure is always connected to the creation of a VM. The reasons for the failure differ but most of the time it looks like the VM gets created but tempest is not able to access it ("Authentication (publickey) failed.") or the created instance can not be found ("Instance f4e582fe-52e6-40e3-b366-2b11ed589089 could not be found.") - The failure is not connected to one specific test. I am wondering why only the multinode job is failing as in other jobs the scenario tests are passing fine. Thanks for any kind of help Lukáš Piwowarsk [1] https://ca077a96786c794b51b6-8aab0ff599dd9fcfda722d0dee6871dd.ssl.cf5.rackc… [2] https://review.opendev.org/c/openstack/tempest/+/866692

1 0

[openstack][nova][kvm] numa
by Ignazio Cassano 11 Jan '23

11 Jan '23

Hello All, I would like to know if with numa in kvm hypervisor I must disable merge across nodes ? If yes, is there any metadata to do it ? Ignazio

2 2

[largescale-sig] Next meeting: Jan 11, 15utc
by Thierry Carrez 11 Jan '23

11 Jan '23

Hi everyone, The Large Scale SIG will be meeting this Wednesday in #openstack-operators on OFTC IRC, at 15UTC. You can doublecheck how that UTC time translates locally at: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20230111T15 Feel free to add topics to the agenda: https://etherpad.opendev.org/p/large-scale-sig-meeting Regards, -- Thierry Carrez

1 1

[neutron] PTG flavour: virtual or in person
by Rodolfo Alonso Hernandez 11 Jan '23

11 Jan '23

Hello Neutrinos: I'm reaching you today to ask you about the PTG. Please first read [1] to have a bit of context. Due to the requests from the contributors to bring back the in person events, there will be a PTG along with the OpenInfra Summit in Vancouver. The virtual PTGs will remain and the first one will be in March. My main questions here are: 1) What do you prefer: virtual or in-person? 2) For this year, will you attend the virtual PTG only? Or will you attend the Vancouver one too? In the second question I'm implying that the virtual ones are "mandatory". At least this year those events will be needed to define the roadmap of the next releases, same as the previous virtual PTGs we had (please don't forget to order your ticket [2]). Regards. [1] https://lists.openstack.org/pipermail/openstack-discuss/2023-January/031645… [2]https://openinfra-ptg.eventbrite.com

4 3

[cinder] Bug Report from 01-11-2023
by Sofia Enriquez 11 Jan '23

11 Jan '23

This is a bug report from 01-04-2022 to 01-11-2023. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Medium - https://bugs.launchpad.net/cinder/+bug/2001619 "svf : if pool attribute is specified in volume type during retype along with --migration-policy defaults to cinder generic migration." Assigned to Sathyanarayana R. Cheers, -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

[all][tc] Technical Committee next weekly meeting on 2023 Jan 11 at 1600 UTC
by Ghanshyam Mann 10 Jan '23

10 Jan '23

Hello Everyone, The technical Committee's next weekly meeting is scheduled for 2023 Jan 11, at 1600 UTC. If you would like to add topics for discussion, please add them to the below wiki page by Tuesday, Jan 10 at 2100 UTC. https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting -gmann

1 1

[openstack-helm] Stability of Openstack Helm for large Ironic (baremetal) clouds with Openstack Yoga
by Farhad Sunavala 10 Jan '23

10 Jan '23

Hi, We're currently running Openstack services on baremetal.Time to upgrade has come and it is a nightmare.We are evaluating containerizing the services with Openstack Helm. Our cloud:We are essentially a large Openstack Ironic (Baremetal) cloud with 5000-8000 baremetal nodes in different DCs.We are thinking of upgrading from Queens to Yoga. Any feedback on stability of Openstack Helm for such installations? Any pointers on what to expect, gotchas, etc. Thanks,Fred..

2 1

nova api error
by Parsa Aminian 10 Jan '23

10 Jan '23

hello On nova api I have this error : OSError: Apache/mod_wsgi request data read error: Partial results are valid but processing is incomplete and I have Unknown Error (HTTP 504) error on every nova request .

1 0

The OpenInfra Summit CFP is closing soon!
by Helena Spease 10 Jan '23

10 Jan '23

Hi Everyone! The CFP for the 2023 OpenInfra Summit (June 13-15, 2023) is closing in just a few days[1]! Check out the full list of tracks and submit a talk on your topic of expertise [2]. The CFP closes January 10, 2023, at 11:59 p.m. PT. See what that is in your timezone [3] We are also now accepting submissions for Forum sessions [4]! Looking for other resources? Find information on registration, sponsorships, travel support and visa requests at https://openinfra.dev/summit/ <https://openinfra.dev/summit/vancouver-2023> If you have any questions feel free to reach out :) Cheers, Helena [1] https://cfp.openinfra.dev/app/vancouver-2023/19/presentations <https://cfp.openinfra.dev/app/vancouver-2023/19/presentations> [2] https://openinfra.dev/summit/vancouver-2023/summit-tracks/ <https://openinfra.dev/summit/vancouver-2023/summit-tracks/> [3] https://www.timeanddate.com/worldclock/fixedtime.html?msg=2023+OpenInfra+Su… <https://www.timeanddate.com/worldclock/fixedtime.html?msg=2023+OpenInfra+Su…> [4] https://cfp.openinfra.dev/app/vancouver-2023/20/ <https://cfp.openinfra.dev/app/vancouver-2023/20/>

3 4