August 2023 - openstack-discuss - lists.openstack.org

[nova] Slow nvme performance for local storage instances
by Jan Wasilewski 22 Aug '23

22 Aug '23

Hi, I am reaching out to inquire about the performance of our local storage setup. Currently, I am conducting tests using NVMe disks; however, the results appear to be underwhelming. In terms of my setup, I have recently incorporated two NVMe disks into my compute node. These disks have been configured as RAID1 under md127 and subsequently mounted at /var/lib/nova/instances [1]. During benchmarking using the fio tool within this directory, I am achieving approximately 160,000 IOPS [2]. This figure serves as a satisfactory baseline and reference point for upcoming VM tests. As the next phase, I have established a flavor that employs a root disk for my virtual machine [3]. Regrettably, the resulting performance yields around 18,000 IOPS, which is nearly ten times poorer than the compute node results [4]. While I expected some degradation, a tenfold decrease seems excessive. Realistically, I anticipated no more than a twofold reduction compared to the compute node's performance. Hence, I am led to ask: what should be configured to enhance performance? I have already experimented with the settings recommended on the Ceph page for image properties [5]; however, these changes did not yield the desired improvements. In addition, I attempted to modify the CPU architecture within the nova.conf file, switching to Cascade Lake architecture, yet this endeavor also proved ineffective. For your convenience, I have included a link to my current dumpxml results [6]. Your insights and guidance would be greatly appreciated. I am confident that there is a solution to this performance disparity that I may have overlooked. Thank you in advance for your help. /Jan Wasilewski *References:* *[1] nvme allocation and raid configuration: https://paste.openstack.org/show/bMMgGqu5I6LWuoQWV7TV/ <https://paste.openstack.org/show/bMMgGqu5I6LWuoQWV7TV/>* *[2] fio performance inside compute node: https://paste.openstack.org/show/bcMi4zG7QZwuJZX8nyct/ <https://paste.openstack.org/show/bcMi4zG7QZwuJZX8nyct/>* *[3] Flavor configuration: https://paste.openstack.org/show/b7o9hCKilmJI3qyXsP5u/ <https://paste.openstack.org/show/b7o9hCKilmJI3qyXsP5u/>* *[4] fio performance inside VM: https://paste.openstack.org/show/bUjqxfU4nEtSFqTlU8oH/ <https://paste.openstack.org/show/bUjqxfU4nEtSFqTlU8oH/>* *[5] image properties: https://docs.ceph.com/en/pacific/rbd/rbd-openstack/#image-properties <https://docs.ceph.com/en/pacific/rbd/rbd-openstack/#image-properties>* *[6] dumpxml of vm: https://paste.openstack.org/show/bRECcaSMqa8TlrPp0xrT/ <https://paste.openstack.org/show/bRECcaSMqa8TlrPp0xrT/>*

5 18

[sunbeam] Juju 3.2 stable release break
by James Page 22 Aug '23

22 Aug '23

Morning The Juju project popped a new stable release of the 3.2 series we currently use for Sunbeam; this has created a problem with the mysql-k8s charm that we rely on for Sunbeam deployment and as such any new deployments will fail. The team is focussed on resolving this ASAP as this is breaking all of our check/gates right now as well. Regards James

1 0

[elections][tc] Self-nominate for Technical Committee
by Dmitriy Rabotyagov 22 Aug '23

22 Aug '23

Hello everyone! I want to nominate myself for the second term on a Technical Committee. During the first term, I actively participated in various TC activities, including a change of the platform for PTI, better defining expectations on projects for removing support for older Python versions, and others. While it took me time to get up to speed and understand better how things are done, I feel being efficient since then as well as bringing value to the table during discussions. Apart from TC activities, I am currently a Core Reviewer and Project Team Leader of OpenStack-Ansible and Vitrage projects. I am a strong advocate for diversity and inclusion, which now is even more important than ever before when corporations are diverting from their commitments to open-source software. I believe that diverse and community-driven projects better represent the real needs of end users and operators. Throughout my career, I have been dealing mostly with Public Clouds, which have a way wider variety of use cases and perspectives than any single corporate solution can have. With that in mind, I want to continue supporting an inclusive environment for all community members as well as connecting operators and developers worlds during the next term of the Technical Committee member. Thanks for your consideration!

3 2

swift_objects are not getting saved in container
by Gaurav Oberai 22 Aug '23

22 Aug '23

Hi Team, We have a setup running with OpenStack Swift setup and a proxy server. We have also used s3api middleware in proxy-server configuration to store objects like AWS s3. Now we are facing issues like objects are not getting stored inside the container instead we are able to store the objects on storage nodes successfully and get a successful response for every request. We have verified the same by listing the objects using the aws-s3 command line utility. However, when tried with OpenStack swift command buckets and objects are not visible inside the container. My concern is how objects are saved if the container is not saving them and how can we fix this issue to store all objects inside the container? Could you please help me with this? Thanks & Regards, Gaurav

2 1

[openstack][kolla-ansible]about group node config overwrite
by Nguyễn Hữu Khôi 22 Aug '23

22 Aug '23

Hello Koller. I want to ask if we can overwrite config for a group of nodes. For example, compute01 >> compute10 will have the same nova configuration compute11 >> compute20 will have the same nova configuration. It will be very nice if we support this way. Thank you. Regards Nguyen Huu Khoi

4 6

[barbican][cinder][cloudkitty][freezer][heat][ironic][keystone][mistral][monasca][murano][nova][OpenStackSDK][oslo][sahara][Telemetry][zaqar][zun] broken gate on master branch
by Elõd Illés 21 Aug '23

21 Aug '23

Hi $teams_in_subject, I've generated test patches to see gate health (to projects' for cycle-with-intermediary deliverables, that have not merged any patches recently) and the patches show [1] that you have broken CI jobs on your gate. Could the teams please check what the issue / issues are and fix as soon as possible? Thanks in advance! (Note: multiple times I see that the failure in docs job is: Handler <function html_page_context at 0x7f86178f55a0> for event 'html-page-context' threw an exception (exception: object of type 'PosixPath' has no len()) so several gates can be fixed with a fix to this issue) [1] https://review.opendev.org/q/topic:release-health-check-cwi-bobcat+is:open Thanks, Előd Illés irc: elodilles @ #openstack-release

3 3

Re: Kayobe VLAN & bond configuration
by Stefan Pinter 21 Aug '23

21 Aug '23

Hi again! After rebooting the server an cleaning up everything in /etc/systemd/network/ it does work again (kayobe overcloud host configure) but I am afraid to run “kayobe overcloud service deploy”. Can anyone confirm that the configuration might be correct or has an idea about what happened in the network there? Multicast storm? Broadcast storm? Troubles with STP? Thank you and best wishes Stefan ________________________________ BearingPoint GmbH Sitz: Wien Firmenbuchgericht: Handelsgericht Wien Firmenbuchnummer: FN 175524z The information in this email is confidential and may be legally privileged. If you are not the intended recipient of this message, any review, disclosure, copying, distribution, retention, or any action taken or omitted to be taken in reliance on it is prohibited and may be unlawful. If you are not the intended recipient, please reply to or forward a copy of this message to the sender and delete the message, any attachments, and any copies thereof from your system.

3 4

[nova-api] Inject public key without create key pair in nova ?
by Pureewat Kaewpoi 21 Aug '23

21 Aug '23

Hi OpenStack Community We have some requirements that need to create instance via API. However nova-api is accept only key_name of key pair created earlier. Can we create instance by passing only public key data without creating a key pair in nova ? Thank you.

4 6

[glance][kolla] importing images on filesystem without copy?
by Rob Jefferson 21 Aug '23

21 Aug '23

Folks, I'm trying to wrap my brain around whether this is possible. Suppose I've configured Glance to use a filesystem backend. Would I be able to point Glance at a directory of existing images, and have it import the images into OpenStack (thus populating the database) without having to copy them? It seems fairly redundant to have the images on the filesystem, and to make copies as part of the creation process. Looking around in the documentation, it seems that this may not be possible, but I'm not sure if there's an alternate path or if what I'm asking is ill-posed. Any advice would be useful. Thanks, Rob

3 2

[charms] Nominate Martin Kalcok for charms-core
by Frode Nordahl 21 Aug '23

21 Aug '23

Hello all, I would like to nominate Martin Kalcok for charms-core. He has been part of the extended charms teams for some time now, and has provided many contributions to OpenStack, Ceph and OVN charms [0]. He is diligent and thorough in his contributions, and has recently become a full time member of the focused OVN team. 0: https://review.opendev.org/q/owner:martin.kalcok%2540canonical.com -- Frode Nordahl

5 4