July 2020 - openstack-discuss - lists.openstack.org

[octavia] Replace broken amphoras
by Fabian Zimmermann 14 Jul '20

14 Jul '20

Hi, we had some network issues and now have amphoras which are marked in ERROR state. What we already tried: - failover the amphora - failover the loadbalancer both did not work, got "unable to attach port to (new) amphora". Then we removed the vrrp_port, set the vrrp_port_id to NULL and repeated the amphora failover Reverting Err: "PortID: Null" Then we created a new vrrp_port as described [1] and added the port-id to the vrrp_port_id and the a suitable vrrp_ip field to our ERRORed amphora entry. Restarted failover -> without luck. Currently we have an single STANDALONE amphora configured. Is there a way to trigger octavia to create new "clean" amphoras for MASTER/BACKUP? Thanks, Fabian [1] http://eavesdrop.openstack.org/irclogs/%23openstack-lbaas/%23openstack-lbaa…

2 3

Cloud Computing Resource
by supriya katal 14 Jul '20

14 Jul '20

Hello Team I have checked your sites. https://github.com/openstacknetsdk/openstack.net/wiki/Getting-Started-With-… For using this sdk, one needs to create an account for *RECKSPACE *open cloud. I have an account in STACKPATH https://control.stackpath.com/ Can I use a stackpath storage object for uploading and accessing the files? I have tried to use your api for uploading and accessing files of STACKPATH object storage. https://docs.openstack.org/api-ref/object-store/index.html?expanded=create-… but I got an error of Access Denied.

2 1

[security] Security SIG meeting July 16th 2020 canceled
by Gage Hugo 14 Jul '20

14 Jul '20

Hello everyone, The security sig meeting this week will be cancelled due to the 10 years of openstack celebration happening at the same time. We will meet next week at the scheduled time.

1 0

[cinder] cinderlib reviews needed
by Brian Rosmaita 14 Jul '20

14 Jul '20

cinderlib is on a cycle-trailing release model and the Ussuri release is coming up soon. Because it's still a new project, I thought I'd send a reminder in case it fell off your radar. These patches need to merge before we cut the release: https://review.opendev.org/720553 https://review.opendev.org/738226 https://review.opendev.org/738473 https://review.opendev.org/739190 https://review.opendev.org/738230 https://review.opendev.org/738866 https://review.opendev.org/738472 https://review.opendev.org/738213 They each have a single +2 at the moment, and they are all short, focused patches. cheers, brian

2 1

[TripleO][CentOS8][Ussuri] overcloud-full image creation to add kernel options and proxy and others
by Ruslanas Gžibovskis 14 Jul '20

14 Jul '20

Hi all, Borry to keep spamming you all the time. But could you help me to find a correct place to "modify" image content (packages installed and not installed) and files and services configured in an "adjusted" way so I would have for example: - tuned ssh - automatically generated root pass to the one I need - Also added proxy config to /etc/yum.conf to certain computes, and other would be used without proxy (maybe extraconfig option?) - set up kernel parameters, so I would have console output duplicated to serial connection and to iDRAC serial, so I could see login screen over idrac ssh. - and so on. I believe many of those things can be done over extraconfig, I just do not know options to modify. maybe you can point me like a blind hen into a correct bowl? :))) Thank you in advance. -- Ruslanas Gžibovskis +370 6030 7030

2 6

[ceilometer][octavia] polling meters
by Ionut Biru 14 Jul '20

14 Jul '20

Hello guys, I was trying to add in polling.yaml and pipeline from ceilometer the following: - network.services.lb.active.connections - network.services.lb.health_monitor - network.services.lb.incoming.bytes - network.services.lb.listener - network.services.lb.loadbalancer - network.services.lb.member - network.services.lb.outgoing.bytes - network.services.lb.pool - network.services.lb.total.connections But it doesn't work, I think they are for the old lbs that were supported in neutron. I found https://docs.openstack.org/ceilometer/latest/admin/telemetry-dynamic-pollst… but this is not available in stein or train. I was wondering if there is a way to meter loadbalancers from octavia. I mostly want for start to just meter if a loadbalancer was deployed and has status active. -- Ionut Biru - https://fleio.com

3 17

[neutron] Bug deputy report for week of July 6th
by Brian Haley 13 Jul '20

13 Jul '20

Hi, I was Neutron bug deputy last week. Below is a short summary about reported bugs. -Brian Critical bugs ------------- * https://bugs.launchpad.net/neutron/+bug/1886807 - neutron-ovn-tempest-full-multinode-ovs-master job is failing 100% times - Gate failure High bugs --------- * https://bugs.launchpad.net/neutron/+bug/1886956 - Functional test test_restart_wsgi_on_sighup_multiple_workers is failing sometimes - https://review.opendev.org/#/c/740283/ * https://bugs.launchpad.net/neutron/+bug/1886969 - dhcp bulk reload fails with python3 - needs owner * https://bugs.launchpad.net/neutron/+bug/1887148 - Network loop between physical networks with DVR - https://review.opendev.org/#/c/740724/ proposed Medium bugs ----------- * https://bugs.launchpad.net/neutron/+bug/1886909 - selection_fields for udp and sctp case doesn't work correctly - This is actually a bug in core OVN, and fixed in v20.06.1, should bump to test with a later version - Also related to supporting SCTP w/Octavia and adding that support to the ovn-octavia-provider driver * https://bugs.launchpad.net/neutron/+bug/1886962 - [OVN][QOS] NBDB qos table entries still exist even after corresponding neutron ports are deleted - needs owner * https://bugs.launchpad.net/neutron/+bug/1887108 - wrong l2pop flows on vlan network - asked for more information on config - needs owner * https://bugs.launchpad.net/neutron/+bug/1887163 - Failed to create network or port with dns_domain parameter - possible config issue with two dns extensions loaded at same time Low bugs -------- * https://bugs.launchpad.net/neutron/+bug/1887147 - neutron-linuxbridge-agent looping same as dhcp - actually looks like a configuration issue in the deployment as privsep helper isn't able to start properly Wishlist bugs ------------- * https://bugs.launchpad.net/neutron/+bug/1886798 - [RFE] Port NUMA affinity policy - Port object update for Nova scheduling - Needs discussion in Drivers meeting Further triage required ----------------------- * https://bugs.launchpad.net/neutron/+bug/1886426 - Neutron sending response to rabbitmq exchange with event type "floatingip.update.end" without updating the status of Floating IP - Asked for more information * https://bugs.launchpad.net/neutron/+bug/1886949 - [RFE] Granular metering data in neutron-metering-agent - Update to metering agent - Asked Slawek to take a look as there was talk about deprecating the metering agent

1 0

[tripleo] TripleO CI Summary: Unified Sprint 29
by Rafael Folco 13 Jul '20

13 Jul '20

Greetings, The TripleO CI team has just completed **Unified Sprint 29** (June 18 thru July 08). The following is a summary of completed work during this sprint cycle [1]: - Continued building internal component and integration pipelines. - Designed new promoter tests to run on Python3 to reuse common code and adapt molecule scenarios to the new test sequence standard. Design doc can be found at https://hackmd.io/kJqHSTWWRMOIfIhvDMGFLg. - Important changes to the next-generation promoter have been submitted, e.g. QCOW2 promotions https://review.rdoproject.org/r/#/c/27626/. - CentOS8 component and integration pipelines are still in progress to be completed in the next sprint cycle. - Tempest skip list and ironic plugin general improvements. - Ruck/Rover recorded notes [2]. The planned work for the next sprint [3] extends the work started in the previous sprint and focuses on switching container build jobs to the new building system. The Ruck and Rover for this sprint are Sandeep Yadav (ysandeep), Sorin Sbarnea (zbr). Please direct questions or queries to them regarding CI status or issues in #tripleo, ideally to whomever has the ‘|ruck’ suffix on their nick. Ruck/rover notes to be tracked in etherpad [4]. Thanks, rfolco [1] https://tree.taiga.io/project/tripleo-ci-board/taskboard/unified-sprint-29 [2] https://hackmd.io/XcuH2OIVTMiuxyrqSF6ocw [3] https://tree.taiga.io/project/tripleo-ci-board/taskboard/unified-sprint-30 [4] https://hackmd.io/6Bx0FXwlRNCc75l39NSKvg -- Folco

1 0

[tc] weekly update
by Mohammed Naser 13 Jul '20

13 Jul '20

Hi everyone, Here’s an update for what happened in the OpenStack TC this week. You can get more information by checking for changes in openstack/governance repository. We've also included a few references to some important mailing list threads that you should check out. # Patches ## Open Reviews - [manila] assert:supports-accessible-upgrade https://review.opendev.org/740509 - Add legacy repository validation https://review.opendev.org/737559 - Cleanup the remaining osf repos and their data https://review.opendev.org/739291 - [draft] Add assert:supports-standalone https://review.opendev.org/722399 ## General Changes - Create starter-kit:kubernetes-in-virt tag https://review.opendev.org/736369 - Update goal selection docs to clarify the goal count https://review.opendev.org/739150 - Add "tc:approved-release" tag to manila https://review.opendev.org/738105 # Email Threads - New Office Hours: http://lists.openstack.org/pipermail/openstack-discuss/2020-July/015761.html - Summit CFP Open: http://lists.openstack.org/pipermail/openstack-discuss/2020-July/015730.html # Other Reminders - OpenStack's 10th anniversary community meeting should be happening July 16th: more info coming soon! - If you're an operator, make sure you fill out our user survey: https://www.openstack.org/user-survey/survey-2020/ - Milestone 2 coming at the end of the month Thanks for reading! Mohammed & Kendall -- Mohammed Naser VEXXHOST, Inc.

1 0

[magnum] failed to launch Kubernetes cluster
by Tony Pearce 13 Jul '20

13 Jul '20

Hi team, I hope you are all keeping safe and well at the moment. I am trying to use magnum to launch a kubernetes cluster. I have tried different images but currently using Fedora-Atomic 27. The cluster deployment from the cluster template is failing and I am here to ask if you could please point me in the right direction? I have become stuck and I am uncertain how to further troubleshoot this. The cluster seems to fail a few minutes after booting up the master node because after I see the logs ([1],[2]), I do not see any progress in terms of new (different) logs or load on the master. Then the 60-minute timeout is reached and fails the cluster. I deployed this openstack stack using kayobe (kolla-ansible) and this is version Train. This is deployed on CentOS 7 within docker containers. Kayobe manages this deployment through the ansible playbooks. This was previously working some months back although I think I may have used coreos image at that time, and that is also not working today. The deployment would have been back around February 2020. I then deleted that deployment and re-deployed. The only change being the hostname for controller node as updated in the inventory file for the kayobe. Since then which was a month or so back I've been unable to successfully deploy a kubernetes cluster. I've tried other fedora-atomic images as well as coreos without success. When using the coreos image and when tagging the image with the coreos tag as per the magnum docs, the instance fails to boot and goes to the rescue shell. However if I manually launch the coreos image then it does successfully boot and get configured via cloud-init. All of the deployment attempts stop at the same place when using fedora image and I have a different experience if I disable TLS: TLS enabled: master launched, no nodes. Fails when running /usr/lib/python2.7/site-packages/magnum/drivers/k8s_fedora_atomic_v1/templates/kubemaster.yaml TLS disabled: master and nodes launched but later fails. I didnt investigate this very much. When looking for help around the web, I found this which looks to be the same issue that I have at the moment (although he's deployed slightly differently, using centos8 and mentions magnum 10): https://ask.openstack.org/en/question/128391/magnum-ussuri-container-not-bo… I have the same log messages on the master node within heat. When going through the troubleshooting guide I see that etcd is running and no errors however I dont see any flannel service at all. But I also don't know if this has simply failed before getting to deploy flannel or whether flannel is the reason. I did try to deploy using a cluster template that is using calico as a test but the same result from the logs. When looking at the stack via cli to see the failed stacks this is what I see there: http://paste.openstack.org/show/795736/ I'm using master node flavour with 4cpu and 4GB memory. Node with 2cpu and 2GB memory. Storage is only via cinder as I am using iscsi storage with a cinder driver. I dont have any other storage. On the master, after the failure the heat log repeats these logs: ++ curl --silent http://127.0.0.1:8080/healthz + '[' ok = ok ']' + kubectl patch node k8s-cluster-onvaoh2zxotf-master-0 --patch '{"metadata": {"labels": {"node-role.kubernetes.io/master": ""}}}' error: no configuration has been provided, try setting KUBERNETES_MASTER environment variable Trying to label master node with node-role.kubernetes.io/master="" + echo 'Trying to label master node with node-role.kubernetes.io/master=""' + sleep 5s [1]Here's the cloud-init.log: http://paste.openstack.org/show/795737/ [2]and cloud-init-output.log: http://paste.openstack.org/show/795738/ May I ask if anyone has a recent deployment of Magnum and a working deployment of kubernetes that could share with me the relevant details like the image you have used so that I can try and replicate? To create the cluster template I have been using: openstack coe cluster template create k8s-cluster-template \ --image Fedora-Atomic-27 \ --keypair testpair \ --external-network physnet2vlan20 \ --dns-nameserver 192.168.7.233 \ --flavor 2GB-2vCPU \ --docker-volume-size 15 \ --network-driver flannel \ --coe kubernetes If I have missed anything, I am happy to provide it. Many thanks in advance for any help or pointers on this. Regards, Tony Pearce

2 4