From cboylan at sapwetik.org Mon Mar 4 19:08:27 2019 From: cboylan at sapwetik.org (Clark Boylan) Date: Mon, 04 Mar 2019 14:08:27 -0500 Subject: [OpenStack-Infra] OpenStack Infra Meeting Agenda for March 5, 2019 Message-ID: * Announcements ** TC election ends March 5 (today) at 23:45UTC ** Train release signing key is up and available for [https://docs.openstack.org/infra/system-config/signing.html#attestation signing] ** Summit Forum sessions can now be [https://www.openstack.org/summit/denver-2019/call-for-presentations proposed] * Actions from last meeting * Specs approval * Priority Efforts (Standing meeting agenda items. Please expand if you have subtopics.) ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/task-tracker.html A Task Tracker for OpenStack] ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/update-config-management.html Update Config Management] *** topic:puppet-4 and topic:update-cfg-mgmt *** Zuul as CD engine ** OpenDev *** https://storyboard.openstack.org/#!/story/2004627 * General topics ** Trusty server upgrade progress (clarkb 20190305) *** https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup ** backups space (ianw 20190305) *** backup01.ord.rax.ci.openstack.org backup volume full *** 3tb in old volumes; to be kept "a few months" in 2017-11 from http://eavesdrop.openstack.org/meetings/infra/2017/infra.2017-10-31-19.01.log.html#l-189 **** propose re-purpose to main active volume **** prune backups? (scary IMO) *** graphite.opendev.org : do we want to backup stats? * Open discussion From cboylan at sapwetik.org Thu Mar 7 23:11:56 2019 From: cboylan at sapwetik.org (Clark Boylan) Date: Thu, 07 Mar 2019 18:11:56 -0500 Subject: [OpenStack-Infra] Virtual Sprint for Server Upgrades In-Reply-To: <396313f6-1bf3-4c69-a428-cc6a52b02c41@www.fastmail.com> References: <396313f6-1bf3-4c69-a428-cc6a52b02c41@www.fastmail.com> Message-ID: <8db66f12-387b-49e3-acdc-04fadc346966@www.fastmail.com> On Tue, Feb 26, 2019, at 4:08 PM, Clark Boylan wrote: > Hello everyone, > > As mentioned in today's meeting I would propose some days for a sprint > to update some of the last remaining Trusty servers we've got that need > host upgrades. I've talked to the OpenStack release team and their > opinion was that potentially impactful upgrades prior to RC1 would be > better than after RC1. > > Given that feedback I think either March 11 and 12 or March 14 and 15 > are going to be our best bets. Maybe March 7 and 8, but that set of > days is much closer to the present than the other two sets. > > Do we have a preference for any of these groups of days? I think if I > had my pick I would go for the 11th and 12th simply because it gives us > a slightly bigger buffer to the RC1 week (the week after). Just to quickly follow up on this. I've not heard any responses so I'm going to pick the two days that work best for me then focus on this activity on those two days and others can join me. For me the best two days are March 11 and 12. I've got afs01.ord ready for upgrading so I expect I'll start there then try to get through the other two AFS file servers as well. Details can be found via links on our top level upgrade etherpad [0]. [0] https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup Thanks, Clark From cboylan at sapwetik.org Mon Mar 11 17:46:06 2019 From: cboylan at sapwetik.org (Clark Boylan) Date: Mon, 11 Mar 2019 13:46:06 -0400 Subject: [OpenStack-Infra] OpenStack Infra Team Meeting Agenda for March 12, 2019 Message-ID: == Agenda for next meeting == * Announcements ** PTL Candidate nominations close today (March 12) at 23:45UTC. *** Clarkb has submitted his candidacy for Infra PTL. ** Summit Forum sessions can now be [https://www.openstack.org/summit/denver-2019/call-for-presentations proposed] * Actions from last meeting * Specs approval * Priority Efforts (Standing meeting agenda items. Please expand if you have subtopics.) ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/task-tracker.html A Task Tracker for OpenStack] ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/update-config-management.html Update Config Management] *** topic:puppet-4 and topic:update-cfg-mgmt *** Zuul as CD engine ** OpenDev *** https://storyboard.openstack.org/#!/story/2004627 * General topics ** Trusty server upgrade progress (clarkb 20190312) *** https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup *** AFS fileserver upgrades started March 11 (hopefully that is in the future still) * Open discussion From aj at suse.com Fri Mar 15 10:01:44 2019 From: aj at suse.com (Andreas Jaeger) Date: Fri, 15 Mar 2019 11:01:44 +0100 Subject: [OpenStack-Infra] Zanata broken on Bionic Message-ID: <2f1d4457-284b-8378-d05a-3de74f6d2e85@suse.com> All translation jobs are failing since zanata-cli fails, looking at the error it looks like Java11 is too new for zanata-cli. I tested the most recent zanata-cli package 4.6.2 (from last year), and it failed as well. Logs: http://logs.openstack.org/periodic/git.openstack.org/openstack/python-keystoneclient/master/propose-translation-update/8c7d3e8/job-output.txt.gz#_2019-03-15_07_56_38_362424 I see two options: 1) Downgrading java to openjdk8 in the used bionic image 2) Going back to Xenial for the job Alex Eng is not working on Zanata anymore and was our contact in the past - I remember another person involved but forgot his name ;( Anybody remembers or can reach out to Zanata folks for help on fixing this for good, please? I've pushed https://review.openstack.org/643539 for going back to Xenial as temporary workaround. But we should figure out the real fix, Andreas -- Andreas Jaeger aj@{suse.com,opensuse.org} Twitter: jaegerandi SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nürnberg) GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126 From ianyrchoi at gmail.com Fri Mar 15 12:29:54 2019 From: ianyrchoi at gmail.com (Ian Y. Choi) Date: Fri, 15 Mar 2019 21:29:54 +0900 Subject: [OpenStack-Infra] Zanata broken on Bionic In-Reply-To: <2f1d4457-284b-8378-d05a-3de74f6d2e85@suse.com> References: <2f1d4457-284b-8378-d05a-3de74f6d2e85@suse.com> Message-ID: Hello Carlos, I am not sure which team you are working currently, but heard that you are working in a tooling team a few months ago - would u help to resolve this? I can’t forget your name - we met on Tokyo Summit in 2015, and many OpenStack team members appreciate your lots of effort on Zanata + OpenStack. Andreas, is it the same person as who I ask to? :) Hopefully it isn’t wrong. With many thanks, /Ian On Friday, March 15, 2019, Andreas Jaeger wrote: > All translation jobs are failing since zanata-cli fails, looking at the > error it looks like Java11 is too new for zanata-cli. > > I tested the most recent zanata-cli package 4.6.2 (from last year), and > it failed as well. > > Logs: > http://logs.openstack.org/periodic/git.openstack.org/openstack/python- > keystoneclient/master/propose-translation-update/8c7d3e8/ > job-output.txt.gz#_2019-03-15_07_56_38_362424 > > I see two options: > 1) Downgrading java to openjdk8 in the used bionic image > 2) Going back to Xenial for the job > > Alex Eng is not working on Zanata anymore and was our contact in the > past - I remember another person involved but forgot his name ;( Anybody > remembers or can reach out to Zanata folks for help on fixing this for > good, please? > > I've pushed https://review.openstack.org/643539 for going back to > Xenial as temporary workaround. But we should figure out the real fix, > > Andreas > -- > Andreas Jaeger aj@{suse.com,opensuse.org} Twitter: jaegerandi > SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany > GF: Felix Imendörffer, Jane Smithard, Graham Norton, > HRB 21284 (AG Nürnberg) > GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126 > > > _______________________________________________ > OpenStack-Infra mailing list > OpenStack-Infra at lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra -------------- next part -------------- An HTML attachment was scrubbed... URL: From cboylan at sapwetik.org Mon Mar 18 19:27:40 2019 From: cboylan at sapwetik.org (Clark Boylan) Date: Mon, 18 Mar 2019 15:27:40 -0400 Subject: [OpenStack-Infra] Meeting agenda for March 19, 2019 Message-ID: == Agenda for next meeting == * Announcements ** Clarkb on vacation March 25-28 * Actions from last meeting * Specs approval * Priority Efforts (Standing meeting agenda items. Please expand if you have subtopics.) ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/task-tracker.html A Task Tracker for OpenStack] ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/update-config-management.html Update Config Management] *** topic:puppet-4 and topic:update-cfg-mgmt *** Zuul as CD engine ** OpenDev *** https://storyboard.openstack.org/#!/story/2004627 *** git:// to https:// translation (ianw 20190312 clarkb 20190319) **** Clarkb wanted to followup on this and make sure we aren't stuck or confused about what the path forward is. * General topics ** Trusty server upgrade progress (clarkb 20190319) *** https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup *** AFS upgrades complete. Still a few more services remaining. Please grab them on the etherpad if you can do the upgrade. ** PTG planning (clarkb 20190319) *** https://etherpad.openstack.org/2019-denver-ptg-infra-planning *** [https://www.openstack.org/ptg#tab_schedule Draft schedule] We have Friday and Saturday in a shared room with the QA team. * Open discussion From iwienand at redhat.com Mon Mar 25 22:14:02 2019 From: iwienand at redhat.com (Ian Wienand) Date: Tue, 26 Mar 2019 09:14:02 +1100 Subject: [OpenStack-Infra] Zanata broken on Bionic In-Reply-To: <2f1d4457-284b-8378-d05a-3de74f6d2e85@suse.com> References: <2f1d4457-284b-8378-d05a-3de74f6d2e85@suse.com> Message-ID: <20190325221402.GD1161@fedora19.localdomain> On Fri, Mar 15, 2019 at 11:01:44AM +0100, Andreas Jaeger wrote: > Anybody remembers or can reach out to Zanata folks for help on > fixing this for good, please? >From internal communication with people previously involved with Zanata, it seems the team has disabanded and there is no current support or, at this time, planned future development. So unfortunately it seems there are no "Zanata folks" at this point :( It's a shame considering there has been significant work integrating it into workflows, but I think we have to work under the assumption upstream will remain inactive. Falling back to "if it ain't broke" we can just continue with the status quo with the proposal job running on Xenial and its java versions for the forseeable future. Should we reach a point post-Xenial support lifespan, we could even consider a more limited deployment of both the proposal job and server using containers etc. Yes, this is how corporations end up in 2019 with RHEL5 servers running Python 2.4 :) Ultimately though, it's probably something the I18n team needs to discuss and infra can help with any decisions made. -i [1] https://review.openstack.org/#/q/topic:zanata/translations From iwienand at redhat.com Mon Mar 25 22:26:31 2019 From: iwienand at redhat.com (Ian Wienand) Date: Tue, 26 Mar 2019 09:26:31 +1100 Subject: [OpenStack-Infra] Meeting agenda for March 26, 2019 Message-ID: <20190325222631.GF1161@fedora19.localdomain> == Agenda for next meeting == * Announcements ** Clarkb remains on vacation March 25-28 * Actions from last meeting * Specs approval * Priority Efforts (Standing meeting agenda items. Please expand if you have subtopics.) ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/task-tracker.html A Task Tracker for OpenStack] ** [http://specs.openstack.org/openstack-infra/infra-specs/specs/update-config-management.html Update Config Management] *** topic:puppet-4 and topic:update-cfg-mgmt *** Zuul as CD engine ** OpenDev *** https://storyboard.openstack.org/#!/story/2004627 * General topics ** PTG planning (clarkb 20190319 / ianw 20190326) *** https://etherpad.openstack.org/2019-denver-ptg-infra-planning * Open discussion