November 2021 - openstack-discuss

[cinder] Bug deputy report for week of 11-03-2021
by Sofia Enriquez 03 Nov '21

03 Nov '21

This is a bug report from 10-27-2021-15-09 to 11-03-2021. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Medium - https://bugs.launchpad.net/cinder/+bug/1949313 'Cinder backup tries to restore to the wrong host'. Assigned to Sam Morrison. - https://bugs.launchpad.net/cinder/+bug/1949189 'NfsDriver' object has no attribute 'manage_existing_get_size'. Unassigned. - https://bugs.launchpad.net/cinder/+bug/1946483 'Error when deleting encrypted volume backup from another project'. Assigned to Pavlo Shchelokovskyy. - https://bugs.launchpad.net/cinder/+bug/1948962 'Quotas: Some operations fail with a 255 volume type name'. Assigned to Gorka. - https://bugs.launchpad.net/cinder/+bug/1949061 '[Storwize] Retype of a non-rep mirror volume to mirror- volume-type with different mirror_pool is failing'. Assigned to Mounika Sreeram. Low - https://bugs.launchpad.net/cinder/+bug/1798589 'No available space check for image_conversion_dir in cinder-volume on upload-to-image'. Unassigned. Cheers -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

[monasca][kolla-ansible] HTTPUnprocessableEntity: Dimension value must be 255 characters or less
by Adam Tomas 03 Nov '21

03 Nov '21

Hi, in my test deployment I get following error messages for each metric at each metric collection (every 60s in my case). Of course whole URL (i.e. /v2.0/metrics/statistics?name=transfer.region2.size&merge_metrics=True&dimensions=project_id%3Afcfaxxxxx&start_time=2021-10-31+02%3A55%3A00%2B02%3A00&end_time=2021-10-31+02%3A00%3A00%2B01%3A00&period=-3300&statistics=avg&group_by=project_id&group_by=resource_id) is longer than 255 characters, but shouldn’t this URL be processed in smaller chunks? As I see the validation is done by monasca_api, so in case it fails no data is processed by monasca_log_transformer, right? Limiting metric name lenght won’t change this situation (in this example metric name is 22 characters long, while the whole URL is 285 characters long, so 285-22 is still > 255). How can I avoid this error? Best regards Adam Tomas 2021-11-02 14:19:44.935 693 ERROR monasca_api.v2.common.bulk_processor [req-a251xxxx 60bexxxx 27bexxxxx - default default] Log transformation failed, rejecting log: monasca_api.api.core.log.exceptions.HTTPUnprocessableEntity: Dimension value /v2.0/metrics/statistics?name=transfer.region2.size&merge_metrics=True&dimensions=project_id%3Afcfaxxxxx&start_time=2021-10-31+02%3A55%3A00%2B02%3A00&end_time=2021-10-31+02%3A00%3A00%2B01%3A00&period=-3300&statistics=avg&group_by=project_id&group_by=resource_id must be 255 characters or less 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor [req-a251xxxx 60bexxxx 27bexxxx - default default] Dimension value /v2.0/metrics/statistics?name=transfer.region2.size&merge_metrics=True&dimensions=project_id%3Afcfaxxx&start_time=2021-10-31+02%3A55%3A00%2B02%3A00&end_time=2021-10-31+02%3A00%3A00%2B01%3A00&period=-3300&statistics=avg&group_by=project_id&group_by=resource_id must be 255 characters or less: monasca_api.api.core.log.exceptions.HTTPUnprocessableEntity: Dimension value /v2.0/metrics/statistics?name=transfer.region2.size&merge_metrics=True&dimensions=project_id%3Afcfaxxxx&start_time=2021-10-31+02%3A55%3A00%2B02%3A00&end_time=2021-10-31+02%3A00%3A00%2B01%3A00&period=-3300&statistics=avg&group_by=project_id&group_by=resource_id must be 255 characters or less 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor Traceback (most recent call last): 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor File "/var/lib/kolla/venv/lib/python3.8/site-packages/monasca_api/v2/common/bulk_processor.py", line 81, in _transform_message 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor dimensions=self._get_dimensions(log_element, 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor File "/var/lib/kolla/venv/lib/python3.8/site-packages/monasca_api/v2/common/bulk_processor.py", line 129, in _get_dimensions 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor validation.validate_dimensions(local_dims) 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor File "/var/lib/kolla/venv/lib/python3.8/site-packages/monasca_api/api/core/log/validation.py", line 138, in validate_dimensions 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor _validate_dimension_value(dim_value) 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor File "/var/lib/kolla/venv/lib/python3.8/site-packages/monasca_api/api/core/log/validation.py", line 114, in _validate_dimension_value 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor raise exceptions.HTTPUnprocessableEntity( 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor monasca_api.api.core.log.exceptions.HTTPUnprocessableEntity: Dimension value /v2.0/metrics/statistics?name=transfer.region2.size&merge_metrics=True&dimensions=project_id%3Afcfaxxxx&start_time=2021-10-31+02%3A55%3A00%2B02%3A00&end_time=2021-10-31+02%3A00%3A00%2B01%3A00&period=-3300&statistics=avg&group_by=project_id&group_by=resource_id must be 255 characters or less 2021-11-02 14:19:44.936 693 ERROR monasca_api.v2.common.bulk_processor

1 1

[neutron][ovs] Different Cookie with Remote Security group
by Mohan Kumar 03 Nov '21

03 Nov '21

Team, I've created a security group with a remote security group attached to it. openstack security group rule create --ethertype=IPv4 --protocol tcp > --remote-group server-grp --ingress --dst-port=22 application-grp when I create VM with server-grp , I can see two cookies in br-int ovs bridge, one with default cookie and another new cookie with conjunction flows, is it expected behavior? ubuntu@req-generic-65-d012-mn:~$ sudo ovs-ofctl dump-flows br-int | awk '{print $1}' | sort -n | uniq cookie=0x12b7adbe73614620, cookie=0x207d02d6bbcf499e, NXST_FLOW ubuntu@req-generic-65-d012-mn:~$ sudo ovs-ofctl dump-flows br-int | grep "0x207d02d6bbcf499e" cookie=0x207d02d6bbcf499e, duration=335.421s, table=82, n_packets=0, n_bytes=0, idle_age=335, priority=70,ct_state=+est-rel-rpl,ipv6,reg6=0x1,ipv6_src=fdd8:a3ce:31ae:0:f816:3eff:fe8a:f751 actions=conjunction(8,1/2) cookie=0x207d02d6bbcf499e, duration=335.420s, table=82, n_packets=0, n_bytes=0, idle_age=335, priority=70,ct_state=+new-est,ipv6,reg6=0x1,ipv6_src=fdd8:a3ce:31ae:0:f816:3eff:fe8a:f751 actions=conjunction(9,1/2) cookie=0x207d02d6bbcf499e, duration=335.420s, table=82, n_packets=0, n_bytes=0, idle_age=335, priority=70,ct_state=+est-rel-rpl,ip,reg6=0x1,nw_src=10.0.0.38 actions=conjunction(16,1/2) cookie=0x207d02d6bbcf499e, duration=335.420s, table=82, n_packets=0, n_bytes=0, idle_age=335, priority=70,ct_state=+new-est,ip,reg6=0x1,nw_src=10.0.0.38 actions=conjunction(17,1/2)

2 2

[Openstack-victoria] [Openstack-queens] migration of VM from openstack queens to victoria
by Swogat Pradhan 03 Nov '21

03 Nov '21

Hi, I have 2 openstack setups Setup1. Openstack queens + ceph nautilaus Setup2. Openstack victoria + ceph octopus So, I am trying to migrate some VM's (windows and linux) from Setup1 to Setup2. For migrating the VM's i am using rbd export on setup1 and then rbd import on setup2. I have successfully migrated 21 VM's. i am now facing an issue in the 22nd vm which, after migrating the VM the vm is stuck in the windows logo screen and not moving forward, and i can't seem to understand how to approach it. Attached the instance.xml files of both queens and victoria setup's of the same VM. With regards, Swogat pradhan

2 3

Accessing Openstack using v3 API
by open infra 02 Nov '21

02 Nov '21

Hi, I was trying to use the openstack environment using the v3 client API as mentioned in [2] documentation but ended up with an error as mentioned in [1]. I can access the same environment v3 API using curl. Am I missing something? [1] https://paste.opendev.org/show/810336/ [2] https://docs.openstack.org/python-keystoneclient/latest/using-api-v3.html Regards, Danishka

2 2

[neutron][ovn] Stateless Security Group
by Ammad Syed 02 Nov '21

02 Nov '21

Hi, I have upgraded my lab to latest xena release and ovn 21.09 and ovs 2.16. I am trying to create stateless security group. But its getting failed with below error message. # openstack security group create --stateless sec02-stateless Error while executing command: BadRequestException: 400, Unrecognized attribute(s) 'stateful' I see below logs in neutron server logs. 2021-11-02 12:47:41.921 1346 DEBUG neutron.wsgi [-] (1346) accepted ('172.16.40.45', 41272) server /usr/lib/python3/dist-packages/eventlet/wsgi.py:992 2021-11-02 12:47:42.166 1346 DEBUG neutron.api.v2.base [req-b6a37fff-090f-4754-9df7-6e4314ed9481 19844bf62a7b498eb443508ef150e9b8 98687873a146418eaeeb54a01693669f - default default] Request body: {'security_group': {'name': 'sec02-stateless', 'stateful': False, 'description': 'sec02-stateless'}} prepare_request_body /usr/lib/python3/dist-packages/neutron/api/v2/base.py:729 2021-11-02 12:47:42.167 1346 WARNING neutron.api.v2.base [req-b6a37fff-090f-4754-9df7-6e4314ed9481 19844bf62a7b498eb443508ef150e9b8 98687873a146418eaeeb54a01693669f - default default] An exception happened while processing the request body. The exception message is [Unrecognized attribute(s) 'stateful'].: webob.exc.HTTPBadRequest: Unrecognized attribute(s) 'stateful' 2021-11-02 12:47:42.167 1346 INFO neutron.api.v2.resource [req-b6a37fff-090f-4754-9df7-6e4314ed9481 19844bf62a7b498eb443508ef150e9b8 98687873a146418eaeeb54a01693669f - default default] create failed (client error): Unrecognized attribute(s) 'stateful' 2021-11-02 12:47:42.168 1346 INFO neutron.wsgi [req-b6a37fff-090f-4754-9df7-6e4314ed9481 19844bf62a7b498eb443508ef150e9b8 98687873a146418eaeeb54a01693669f - default default] 172.16.40.45 "POST /v2.0/security-groups HTTP/1.1" status: 400 len: 317 time: 0.2455938 Any advice on how to fix it ? Ammad

3 10

[neutron] CI meeting - Tuesday 02.11.2021
by Slawek Kaplonski 02 Nov '21

02 Nov '21

Hi, As we discussed during the PTG and in the last week's CI meeting, this week's meeting will be a video call. Please join https://meetpad.opendev.org/neutron-ci-meetings at 300pm UTC if You are interested in the Neutron CI. We will also keep meeting opened in the #openstack-neutron irc channel in case if anyone would like to participate that way. Agenda for the meeting is at https://etherpad.opendev.org/p/neutron-ci-meetings -- Slawek Kaplonski Principal Software Engineer Red Hat

1 0

[neutron] Bug Deputy Report Oct 25 - 31
by Oleg Bondarev 02 Nov '21

02 Nov '21

Hi everyone, Please find Bug Deputy report for the week Oct 25 - 31st below. 1 Critical bug in stable/train already in progress; 1 High bug looks for an assignee. Several OVN bug needs some triage from OVN folks + assignees. Critical - https://bugs.launchpad.net/neutron/+bug/1948804 - [stable/train] neutron-tempest-plugin scenario jobs fail "sudo: guestmount: command not found" o In Progress: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815518 o Assigned to bcafarel High - https://bugs.launchpad.net/neutron/+bug/1948832 - "_disable_ipv6_addressing_on_interface" can't find the interface o Confirmed o Unassigned Medium - https://bugs.launchpad.net/neutron/+bug/1948676 - rpc response timeout for agent report_state is not possible Edit o Fix released: https://review.opendev.org/c/openstack/neutron/+/815310 o Fixed by Tobias Urdin - https://bugs.launchpad.net/bugs/1948642 - Configuration of the ovs controller by neutron-ovs-agent isn't idempotent Edit o In progress: https://review.opendev.org/c/openstack/neutron/+/815255 o Assigned to slaweq - https://bugs.launchpad.net/neutron/+bug/1948891 - [ovn] Using ovsdb-client for MAC_Binding could theoretically block indefinitely o Confirmed o Unassigned - https://bugs.launchpad.net/neutron/+bug/1949059 - ovn-octavia-provider: incorrect router association in NB when network is linked to more than 1 router o Confirmed o Unassigned - https://bugs.launchpad.net/neutron/+bug/1949081 - [OVN] check_for_mcast_flood_reports maintenance task not accounting for localnet "mcast_flood" changes o Confirmed o Assigned to lucasgomes Undecided - https://bugs.launchpad.net/neutron/+bug/1949097 - Cloud-Init cannot contact Meta-Data-Service on Xena with OVN o New o Unassigned - https://bugs.launchpad.net/neutron/+bug/1949202 - ovn-controllers are listed as agents but cannot be disabled o New o Unassigned - https://bugs.launchpad.net/neutron/+bug/1949230 - OVN Octavia provider driver should implement allowed_cidrs to enforce security groups on LB ports o New o Unassigned Invalid - https://bugs.launchpad.net/neutron/+bug/1948656 - toggling explicitly_egress_direct from true to false does not clean flows Thanks, Oleg --- Advanced Software Technology Lab Huawei

1 0

[horizon] Skip tomorrow Weekly IRC Meeting
by vishal manchanda 02 Nov '21

02 Nov '21

Hi all, As discussed, during the last weekly meeting[1], there will be no horizon weekly meeting tomorrow. See you next week! Thanks & regards, Vishal Manchanda [1] https://meetings.opendev.org/meetings/horizon/2021/horizon.2021-10-27-15.00…

1 0

[tacker][ptg] Yoga PTG summary
by yasufum 01 Nov '21

01 Nov '21

Hi everyone, Thank you for participating in the Yoga PTG sessions. We discussed 17 items totally, including 13 specs, and agreed all to implement the proposed features. We also decided to set the spec freeze on 31th Dec. The etherpad of our PTG is at https://etherpad.opendev.org/p/tacker-yoga-ptg Here is a summary of the PTG sessions. *Day 1 1. Introduce for Tacker installer * To reduce uinteresting steps of setting up tacker, we introduce a dedicated installer for developers. * For beginners, we should minimize difficulties of deploying and make them focusing on their usecases. 2. Prometheus monitoring and AutoHeal support for Kubernetes Cluster VNF via FM Interface * Add fault management interface support applied with ETSI SOL003 standards including polling mode and notify mode. * Polling mode responds to resources that is named "Alarms" and "Individual alarm". On the other hand, notify mode responds to resources that is named "Subscriptions" and "Notification endpoint" 3. Support VNF update operations reflecting changes to VNF instances using MgmtDriver * Add update APIs for container VNF instances by using ConfigMap and Secret of k8s. 4. Support CentOS stream * Revise our current incomplete CentOS support for the latest 'stream'. * We will provide some functional tests for the update, but non-voting for a while. 5. Add VNF Package sample for practical use cases * Provide more practical examples of usecase of tacker for users because current usecases in documentation are simple and not enough so much for actual cases. * There are three examples supposed in the proposal, "use multiple deployment flavours", "deploy VNF connected to external network" and "deploy VNF as HA cluster". *Day 2 6. Support handling large query results by ETSI NFV * Introduce an extended feature for reducing a large amount of result for some queries defined in ETSI standards. * The idea is simply dividing the results in several pieces with paging. 7. Support FT of Multi tenant * There are two problems in multi-tenancy case, (1) No restriction in assigning a tenant,(2) Notifying events on different tenants. * The policy of assigning a tenant should be clarified and also Notification process under multi-tenancy should be changed. * We need to clear the policy of RBAC (Is it allowed to make admin user can access all resources?) 8. Sample Ansible Driver * There are no management drivers enable VNF Configuration using Ansible. So, add the scripts as samples and docs. * Revise the name of directories for considering conventioins in takcer repo is necessary. * This can be used for 'Add VNF Package sample for practical use cases' proposal. We wii support the sample development. 9. Support Robot Framework API * Currently Tacker functional tests mainly focus on checking various VNF patterns such as a simple VNF, multi VDU, volume attach and affinity set. Tacker community is advancing ETSI NFV standard compliance, and coverage of compliant API testing becomes important. * The proposal is to use Robot Framework to achieve automated API testing and in the first step, we adopt API test code released by ETSI NFV-TST010. 10. Add Tacker-horizon Unit Test Cases * `tacker-horizon` which provides very limited features, such as showing a list of registered VIMs, VNFDs or so. We don't use this feature so much without checking instances of Tacker quickly via intuitive Web GUI way. So, we have not maintained tacker-horizon so actively * One of the reasons why bugs in tacker-horizon have not fixed is that we have no unittests in. Although we can find a bug coincidentally while using the features, but should implement unittests because bugs in horizon are some contextual and not so easy to find by hand. *Day 3 11. Report for ETSI NFV API Conformance Test Results * Share the result of Remote NFV&MEC API Plugtest 2021, Totally 136 API Conformance test sessions were executed for [NFV-SOL003] were executed as well as for NFV-SOL005. * https://hackmd.io/q4DzQ6_2Q0e-TdmtBikVlQ?view 12. Reduce code clone from sol-kubernetes job of FT * There are much similar files can be reduced for functional tests. It makes maintenance more complicated and difficult. The goal is to reduce it to less than 20%. * In particular, since sol_kubernetes's code clone rate is up to 40% , we think it will be better to refactor to make future maintenance easier. * other details: https://hackmd.io/Wo8cBIH_RPe6ll1hNwmx1w?view 13. Reduce unnecessary test codes * It's similar as above item. We have very similar YAML files for definitions and useless template files for tests can be reduced. 14. Enhance NFV SOL_v3 LCM operation * Introduce the latest V2 APIs for LCM operation as below. * Scale VNF (POST /vnf_instances/{vnfInstanceId}/scale) * Heal VNF (POST /vnf_instances/{vnfInstanceId}/heal) * Modify VNF Information (PATCH /vnf_instances/{vnfInstanceId}) * Change External VNF Connectivity (POST /vnf_instances/{vnfInstanceId}/change_ext_conn) 15. Support ETSI NFV-SOL_v3 based error-handling operation * Introduce the latest V2 APIs for error handling operation as below. * Retry operation (POST /vnf_lcm_op_occs/{vnfLcmOpOccId}/retry) * Fail operation (POST /vnf_lcm_op_occs/{vnfLcmOpOccId}/fail) * Rollback operation (POST /vnf_lcm_op_occs/{vnfLcmOpOccId}/rollback) * Test scenario needs to include raising an error, becoming FAILD_TEMP, and executing the ErrorHandling API. * Timer adjusting and using inapporpriate vnf package can cause error. 16. Support ChangeCurrentVNFPackage * Add API for ChangeCurrentVNFPackage by which blue-green deployment and rolling update are supported. * Both of VIMs, OpenStack and Kubernetes, are covered. 17. Support heal and scale method in lcm_user_data * Enable to customize stack parameters for heal and scale operations in user script, `user_lcm_data.py` more specifically. * Call the proposed methods if it's existing in the script for the operations. Thanks, Yasufumi

1 0