June 2022 - openstack-discuss - lists.openstack.org

Re: [kolla-ansible][xena] Facing network issue when providing SR-IOV support
by Rodolfo Alonso Hernandez 23 Jun '22

23 Jun '22

Hello Harshit: You need first to fix your underlying network configuration. If the interfaces created on "sriovnet1" can't talk to each other this is because your network is blocking this traffic. Check your TOR switches to enable/allow this VLAN range. Regards. On Thu, Jun 23, 2022 at 9:42 AM Harshit Mishra <harshit(a)voereir.com> wrote: > Hello Rodolfo, > > Thanks for your support. > > If the VMs are spawned without any issue, that could be a problem in the > underlying network deployment. When sending traffic from a VM with an > SR-IOV port, try to capture the traffic in the physical function. Please > check the physical network connected to the SR-IOV network cards allow VLAN > traffic in 1000:1009 (according to your configuration). > > Network I have configured of VLAN type in a given range. > > openstack network show 4cacd198-29c3-47b3-bf77-39f1d01c9a22 -c > provider:network_type -c provider:physical_network -c > provider:segmentation_id > +---------------------------+-----------+ > | Field | Value | > +---------------------------+-----------+ > | provider:network_type | vlan | > | provider:physical_network | sriovnet1 | > | provider:segmentation_id | 1002 | > +---------------------------+-----------+ > > > Note: I forget to add that Intra-communication between the VM's working > fine deployed on same HOST but inter-communication not working. > One more thing IP address is not assigning to interfaces of VM. We have to > configure static IP address manually. > > Please find below incoming traffic flow on PF. > > > # tcpdump -i enp8s0f1 > tcpdump: verbose output suppressed, use -v or -vv for full protocol decode > listening on enp8s0f1, link-type EN10MB (Ethernet), capture size 262144 > bytes > 12:39:28.584000 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from fa:16:3e:88:f5:3e (oui Unknown), length 285 > 12:39:39.183491 IP6 fe80::a236:9fff:fe24:803a > ip6-allrouters: ICMP6, > router solicitation, length 16 > 12:39:49.660269 IP6 fe80::a236:9fff:fe53:e598.5240 > ff02::15a.5240: UDP, > length 221 > 12:39:49.660897 IP6 fe80::a236:9fff:fe53:e59a.5240 > ff02::15a.5240: UDP, > length 221 > 12:39:54.105381 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from a0:36:9f:d8:0d:a8 (oui Unknown), length 293 > 12:39:54.897051 LLDP, length 46 > 12:39:56.281671 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from 3c:fd:fe:cd:06:71 (oui Unknown), length 293 > 12:40:06.286310 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from a0:36:9f:d8:0d:aa (oui Unknown), length 293 > 12:40:15.039416 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from 3c:fd:fe:cd:06:70 (oui Unknown), length 293 > 12:40:19.675902 IP6 fe80::a236:9fff:fe53:e598.5240 > ff02::15a.5240: UDP, > length 221 > 12:40:19.676390 IP6 fe80::a236:9fff:fe53:e59a.5240 > ff02::15a.5240: UDP, > length 221 > 12:40:25.708972 LLDP, length 46 > 12:40:29.288242 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from fa:16:3e:c4:3f:4f (oui Unknown), length 285 > 12:40:33.008653 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from fa:16:3e:88:f5:3e (oui Unknown), length 285 > > > > Another question: do the VMs with SR-IOV port receive the DHCP reply? If > so, at least you know the compute to controller communication is working > (assuming the DHCP agent is on the controller). > > No, VMs not receiving DHCP reply, you can refer above logs. Yes, DHCP > agent is on controller. > > Kindly let me know anything else is required. > > Thanks! > > Regards, > Harshit Mishra > > ------------------------------ > *From:* Rodolfo Alonso Hernandez <ralonsoh(a)redhat.com> > *Sent:* Wednesday, June 22, 2022 6:46 PM > *To:* Harshit Mishra <harshit(a)voereir.com> > *Subject:* Re: [kolla-ansible][xena] Facing network issue when providing > SR-IOV support > > Hello Harshit: > > If the VMs are spawned without any issue, that could be a problem in the > underlying network deployment. When sending traffic from a VM with an > SR-IOV port, try to capture the traffic in the physical function. Please > check the physical network connected to the SR-IOV network cards allow VLAN > traffic in 1000:1009 (according to your configuration). > > Another question: do the VMs with SR-IOV port receive the DHCP reply? If > so, at least you know the compute to controller communication is working > (assuming the DHCP agent is on the controller). > > Regards. > > On Wed, Jun 22, 2022 at 2:17 PM Harshit Mishra <harshit(a)voereir.com> > wrote: > > Hi! > > > I have deployed Openstack Xena using kolla-ansible (v13.0.1) on a > multi-node setup (1 controller+network, multiple computes). > > > > On this cluster I would like to have support for normal, as well as direct > (SR-IOV) vNIC types. > > > > I have done all the pre-requirement like configure VF on SR-IOV network > interface. > > > > In the current deployment, I have created two physnets, one for flat > network (called physnet1 on br-ex), and one for SR-IOV (called sriovnet1 on > Intel 10G 2P X520 card). I am creating one network of VXLAN type for normal > vNIC, and one of VLAN type on sriovnet1 (called sriov_network) for direct > vNIC. > > > > Mapping of PF with provider in sriov-agent.ini: > > > > # cat /etc/kolla/neutron-sriov-agent/sriov_agent.ini > > [sriov_nic] > > physical_device_mappings = sriovnet1:enp8s0f1 > > exclude_devices = > > > > [securitygroup] > > firewall_driver = neutron.agent.firewall.NoopFirewallDriver > > > > ---------------------------------------------- > > ml2_conf.ini on controller node: > > > > # cat /etc/kolla/neutron-server/ml2_conf.ini > > [ml2] > > type_drivers = flat,vlan,vxlan > > tenant_network_types = vxlan,vlan,flat > > mechanism_drivers = openvswitch,l2population,sriovnicswitch > > extension_drivers = port_security > > > > [ml2_type_vlan] > > network_vlan_ranges = physnet1,sriovnet1:1000:1009 > > > > [ml2_type_flat] > > flat_networks = physnet1,sriovnet1 > > > > [ml2_sriov] > > agent_required = False > > supported_pci_vendor_devs = 8086:10ed > > > > [ml2_type_vxlan] > > vni_ranges = 1:1000 > > > > ---------------------------------------------- > > > > # grep -nr enabled_filters /etc/kolla/nova-scheduler/ > > /etc/kolla/nova-scheduler/nova.conf:13:enabled_filters = > ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter,SameHostFilter,DifferentHostFilter,AggregateInstanceExtraSpecsFilter,PciPassthroughFilter > > > > ---------------------------------------------- > > > > # grep passthrough /etc/kolla/nova-compute/nova.conf > > passthrough_whitelist = [{"physical_network": "sriovnet1", "devname": > "enp8s0f1"}] > > > > > > The interfaces on VMs from normal vNICs are able to communicate > inter-compute. The same is not working for the direct vNICs belonging to > the sriov_network. I have tried multiple config changes, but none seem to > work. > > > > Please help in solving this issue, or suggest a different way of achieving > this if this is wrong or not optimal. > > > > Thanks! > > Regards, > Harshit Mishra > >

1 0

Re: 504 Gateway time out error while loading OpenStack Projects
by Eugen Block 23 Jun '22

23 Jun '22

Please keep the responses in the list so others can see your responses, too, and chime in with their comments. How is your dashboard configured regarding cache? This is our config (/srv/www/openstack-dashboard/openstack_dashboard/local/local_settings.d/_100_local_settings.py): CACHES = { 'default': { 'BACKEND': 'django.core.cache.backends.memcached.MemcachedCache', 'LOCATION': [ '<IP1>:11211', '<IP2>:11211', ] } } Our memcached config has both localhost and its management IP: MEMCACHED_PARAMS="-U 0 -m 64 -l 127.0.0.1,<IP1> -p 11211 -c 4096" The reason for that is we noticed performance improvements when we replaced the list of control nodes for all the services and point to localhost instead: # before #memcached_servers = controller01:11211,controller02:11211 # after memcached_servers = localhost:11211 Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: > Hello, > > My setting in memcache looks like this, because it is default taken by > ansible > > -d > -v > -U 0 > -m 1024 > -p 11211 > -u memcache > -l 172.29.x.X > -c 4096 > -t 4 > > So should i change the time out perimeter to something else > > Regards > Adivya Singh > > On Wed, Jun 15, 2022 at 8:53 PM Maysa De Macedo Souza <mdemaced(a)redhat.com> > wrote: > >> Hello, >> >> Maybe increasing the value of a setting like >> memcache_pool_conn_get_timeout can help? >> >> Cheers, >> Maysa. >> >> On Wed, Jun 15, 2022 at 2:05 PM Eugen Block <eblock(a)nde.ag> wrote: >> >>> Hi, >>> >>> I remember having a similar issue a few years back in an older >>> openstack release, probably Ocata. We had difficulties loading *all* >>> instances in the admin tab in Horizon dashboard. It turned out to be a >>> memcached misconfiguration. I don't recall the details, unfortunately. >>> But I'd start with memcached. >>> >>> >>> Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: >>> >>> > hi Team, >>> > >>> > We have Xena release installed on Ubuntu Openstack, Lately we are >>> getting >>> > "504 Gateway Timeout error ", As the we moved from 1 node to 3 node Open >>> > Stack >>> > i do not see any error in haproxy , neither there is a time out when i >>> ping >>> > external-VIP-IP configured. >>> > >>> > Apache 2 are also loaded, tried to delete the Horizon Container and >>> created >>> > it again, but no errors, Still the same errors. >>> > >>> > Any guesses on that >>> > >>> > Regards >>> > Adivya Singh >>> >>> >>> >>> >>>

1 0

Neutron/OVN + IPv6
by Tiago Pires 23 Jun '22

23 Jun '22

Hi all, I am trying to figure out how to enable workloads on overlay to use IPv6 addresses and communicate with external networks. I have to use Neutron ML2/OVN in my scenario and I have doubts regarding how the external networks(Internet) can know how to reach the VMs using IPv6 address behind a regular neutron router. I was checking this link https://cloudbau.github.io/openstack/neutron/networking/2016/05/17/neutron-… that uses the BGP speaker on neutron in order to advertise the /64 subnets to a border router, that option should work fine but Neutron/BGP Speaker is not supported with OVN as I could check on the documentation. How are you using IPv6 integration (Neutron/OVN) to advertise the /64 subnets? Tiago Pires

4 4

R: R: R: [Devstack][Gnocchi][Ceilometer] Not able to retrieve metrics using ceilometer and gnocchi
by Molka Gharbaoui 22 Jun '22

22 Jun '22

3 4

[largescale-sig] Next meeting: June 22nd, 15utc
by Thierry Carrez 22 Jun '22

22 Jun '22

Hi everyone, The Large Scale SIG will be meeting this Wednesday in #openstack-operators on OFTC IRC, at 15UTC. You can check how that time translates locally at: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20220622T15 Feel free to add topics to the agenda: https://etherpad.openstack.org/p/large-scale-sig-meeting Regards, -- Thierry Carrez

1 1

[cinder] Bug deputy report for week of 06-22-2022
by Sofia Enriquez 22 Jun '22

22 Jun '22

This is a bug report from 06-15-2022 to 06-22-2022. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Low - https://bugs.launchpad.net/cinder/+bug/1978825 "StorPool: really detach volumes and snapshots after copying to/from an image." Fix proposed to master. Cheers, Sofia -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

add gpu as flavor option
by A Monster 22 Jun '22

22 Jun '22

After deploying openstack and configuring gpu passthrough, I want to be able to see gpus as an option directly from the flavor table not added as a metadata, as shown in the attached table image, how can I achieve this? Screenshot from 2022-06-22 10-06-58.png <https://drive.google.com/file/d/1A1tn1S8JwgOdL0bcjBSaNYq5QSWpjyN4/view?usp=…>

2 1

[Tripleo] Gate blocker - Standalone 9 failing
by Arx Cruz 22 Jun '22

22 Jun '22

Hello, We have another gate blocker on standalone centos 9 job: https://bugs.launchpad.net/tripleo/+bug/1979300 Kind regards, -- Arx Cruz Software Engineer Red Hat EMEA <https://www.redhat.com> arxcruz(a)redhat.com @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 1

Few Open Questions: Openstack vs Proprietary cloud stacks
by KK CHN 22 Jun '22

22 Jun '22

List, Very recently I came across a discussion with a banking corporation who are heavy users of VMware in all their Data Centre operations .. They asked me a lot of questions in comparison with openstack vs other proprietary vendors (such as VMware. ). As I am promoting OpenStack I need to clarify these questions raised by the organization. I request your inputs for these queries . 1. Does OpenStack support Hyper Converged Infrastructure ? Or any HCI vendors already with OpenStack solutions? Please share the URL/link of case studies of OpenStack HCI. Any documentation/Reference to install openstack as HCI solution with supported H/W OEM details . I can try out ... 2. Is there any performance benchmark for openstack to compare with other such cloud stacks ( URL/reference links kindly share ) 3. What is the market share of OpenStack all over the world ? ( If any statistics kindly share.) Any survey reports available how many large and medium organizations are using Openstack distributions for private/public cloud use in production ? 4. Does OpenStack new versions support VDI(Virtual Desktop Infrastructure) solutions out of the box.? pls give a reference link / url for the same. 5. What is the alternative for VROPS and VRA (including self service capabilities, Blueprint/Template based deployment) in OpenStack and any comparative study on the capabilities available. ( Please share inputs if any to refer. ) 6. What is the alternative of VMWARE Network Insights and VMWARE CodeStream and Vrealize Loginsights in OpenStack ? 7. Any major capability available in VMware cloud stack for which alternative is not available in OpenStack out of the box ? 8. Tools to maintain multiple OpenStack Cluster, any concept of Supervisory cluster available 9. Who all are the large organizations who deployed OpenStack as their alternative over proprietary solutions(eg: VMware cloud and virtualization products ..) 10. Does OpenInfra Foundation also provide direct support For OpenStack Deployment ? If yes Kindly share the link / url where to contact /approach for paid support ? in case the clients need paid support ? 11. Regarding security of cloud environments /infrastructure, what are the USPs of OpenStack cloud security over other competing cloud middleware providers ? and the vulnerability handling model/mechanism in production ? Thanks in advance for your invaluable inputs. Each and every input from each member is valuable for me to showcase as solid proofs to defend and promote the openstack over proprietary market leaders. Krish

4 5

[kolla-ansible][xena] Facing network issue when providing SR-IOV support
by Harshit Mishra 22 Jun '22

22 Jun '22

Hi! I have deployed Openstack Xena using kolla-ansible (v13.0.1) on a multi-node setup (1 controller+network, multiple computes). On this cluster I would like to have support for normal, as well as direct (SR-IOV) vNIC types. I have done all the pre-requirement like configure VF on SR-IOV network interface. In the current deployment, I have created two physnets, one for flat network (called physnet1 on br-ex), and one for SR-IOV (called sriovnet1 on Intel 10G 2P X520 card). I am creating one network of VXLAN type for normal vNIC, and one of VLAN type on sriovnet1 (called sriov_network) for direct vNIC. Mapping of PF with provider in sriov-agent.ini: # cat /etc/kolla/neutron-sriov-agent/sriov_agent.ini [sriov_nic] physical_device_mappings = sriovnet1:enp8s0f1 exclude_devices = [securitygroup] firewall_driver = neutron.agent.firewall.NoopFirewallDriver ---------------------------------------------- ml2_conf.ini on controller node: # cat /etc/kolla/neutron-server/ml2_conf.ini [ml2] type_drivers = flat,vlan,vxlan tenant_network_types = vxlan,vlan,flat mechanism_drivers = openvswitch,l2population,sriovnicswitch extension_drivers = port_security [ml2_type_vlan] network_vlan_ranges = physnet1,sriovnet1:1000:1009 [ml2_type_flat] flat_networks = physnet1,sriovnet1 [ml2_sriov] agent_required = False supported_pci_vendor_devs = 8086:10ed [ml2_type_vxlan] vni_ranges = 1:1000 ---------------------------------------------- # grep -nr enabled_filters /etc/kolla/nova-scheduler/ /etc/kolla/nova-scheduler/nova.conf:13:enabled_filters = ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter,SameHostFilter,DifferentHostFilter,AggregateInstanceExtraSpecsFilter,PciPassthroughFilter ---------------------------------------------- # grep passthrough /etc/kolla/nova-compute/nova.conf passthrough_whitelist = [{"physical_network": "sriovnet1", "devname": "enp8s0f1"}] The interfaces on VMs from normal vNICs are able to communicate inter-compute. The same is not working for the direct vNICs belonging to the sriov_network. I have tried multiple config changes, but none seem to work. Please help in solving this issue, or suggest a different way of achieving this if this is wrong or not optimal. Thanks! Regards, Harshit Mishra

1 0