[kolla] State of ppc64le support
About 2.5 years ago I added AArch64 (64-bit ARM) architecture support to Kolla project. Side effect of that work was adding ppc64le (64-bit Power, Little Endian) support.
Time passed, from time to time someone jumped to the irc channel and said that they use it. No one in core team spent much time on supporting it as it was outside of our interest.
From time to time I was reserving Power machine in Red Hat to do build
and check how we are with ppc64le support. This week I did that again.
From 3 distributions we target only Debian/source combo was buildable.
CentOS builds lack 'rabbitmq' 3.7.10 (we use external repo) and 'gnocchi' binary images are not buildable due to lack of some packages (issue already reported to CentOS by TripleO team).
Ubuntu builds lack MariaDB 10.3 because upstream repo is broken. Packages index is provided for 'ppc64le' but no packages so we get 404 errors.
Due to all those issues and fact that there are no users of ppc64le Kolla containers I want to drop support for it in this cycle. Any objections?
On Sat, Sep 14, 2019 at 10:51 AM Marcin Juszkiewicz < marcin.juszkiewicz@linaro.org> wrote:
About 2.5 years ago I added AArch64 (64-bit ARM) architecture support to Kolla project. Side effect of that work was adding ppc64le (64-bit Power, Little Endian) support.
Time passed, from time to time someone jumped to the irc channel and said that they use it. No one in core team spent much time on supporting it as it was outside of our interest.
From time to time I was reserving Power machine in Red Hat to do build and check how we are with ppc64le support. This week I did that again.
From 3 distributions we target only Debian/source combo was buildable.
CentOS builds lack 'rabbitmq' 3.7.10 (we use external repo) and 'gnocchi' binary images are not buildable due to lack of some packages (issue already reported to CentOS by TripleO team).
Ubuntu builds lack MariaDB 10.3 because upstream repo is broken. Packages index is provided for 'ppc64le' but no packages so we get 404 errors.
Due to all those issues and fact that there are no users of ppc64le Kolla containers I want to drop support for it in this cycle. Any objections?
I think TripleO uses the ppc64le containers. I'm unsure if we're relying on anything special to build them however. I know there's been some effort to get a pp64le upstream build system going. ccing Wes as he might have the status on this.
On Mon, Sep 16, 2019 at 7:36 AM Alex Schultz aschultz@redhat.com wrote:
On Sat, Sep 14, 2019 at 10:51 AM Marcin Juszkiewicz < marcin.juszkiewicz@linaro.org> wrote:
About 2.5 years ago I added AArch64 (64-bit ARM) architecture support to Kolla project. Side effect of that work was adding ppc64le (64-bit Power, Little Endian) support.
Time passed, from time to time someone jumped to the irc channel and said that they use it. No one in core team spent much time on supporting it as it was outside of our interest.
From time to time I was reserving Power machine in Red Hat to do build and check how we are with ppc64le support. This week I did that again.
From 3 distributions we target only Debian/source combo was buildable.
CentOS builds lack 'rabbitmq' 3.7.10 (we use external repo) and 'gnocchi' binary images are not buildable due to lack of some packages (issue already reported to CentOS by TripleO team).
Ubuntu builds lack MariaDB 10.3 because upstream repo is broken. Packages index is provided for 'ppc64le' but no packages so we get 404 errors.
Due to all those issues and fact that there are no users of ppc64le Kolla containers I want to drop support for it in this cycle. Any objections?
I think TripleO uses the ppc64le containers. I'm unsure if we're relying on anything special to build them however. I know there's been some effort to get a pp64le upstream build system going. ccing Wes as he might have the status on this.
The TripleO team is working on ppc64le right now and should be uploading ppc64le containers to docker.io in a few weeks. I'm pretty sure the ppc team is using kolla to build the containers, but I'm not 100% sure as the ppc64le container build jobs are in a 3rd party ci system.
I'm checking with some folks to get the details that would be helpful here.
Thanks.
Hey all,
We do use kolla. Let me see if I can shed some light here.
On 9/16/19 11:54 AM, Wesley Hayutin wrote:
On Mon, Sep 16, 2019 at 7:36 AM Alex Schultz <aschultz@redhat.com mailto:aschultz@redhat.com> wrote:
On Sat, Sep 14, 2019 at 10:51 AM Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org <mailto:marcin.juszkiewicz@linaro.org>> wrote: About 2.5 years ago I added AArch64 (64-bit ARM) architecture support to Kolla project. Side effect of that work was adding ppc64le (64-bit Power, Little Endian) support. Time passed, from time to time someone jumped to the irc channel and said that they use it. No one in core team spent much time on supporting it as it was outside of our interest. From time to time I was reserving Power machine in Red Hat to do build and check how we are with ppc64le support. This week I did that again. From 3 distributions we target only Debian/source combo was buildable. CentOS builds lack 'rabbitmq' 3.7.10 (we use external repo) and 'gnocchi' binary images are not buildable due to lack of some packages (issue already reported to CentOS by TripleO team).
We should be getting the gnocchi issue fixed. See this thread https://lists.centos.org/pipermail/centos-devel/2019-September/017721.html The rabbitmq issue is confusing me. The version provided for x86_64 seems to be the same one provided for ppc64le, but maybe I'm missing something. If there's a package we need to get published, I can investigate.
Ubuntu builds lack MariaDB 10.3 because upstream repo is broken. Packages index is provided for 'ppc64le' but no packages so we get 404 errors.
Unfortunately I'm not well versed on the gaps in Ubuntu.
Due to all those issues and fact that there are no users of ppc64le Kolla containers I want to drop support for it in this cycle. Any objections? I think TripleO uses the ppc64le containers. I'm unsure if we're relying on anything special to build them however. I know there's been some effort to get a pp64le upstream build system going. ccing Wes as he might have the status on this.The TripleO team is working on ppc64le right now and should be uploading ppc64le containers to docker.io http://docker.io in a few weeks. I'm pretty sure the ppc team is using kolla to build the containers, but I'm not 100% sure as the ppc64le container build jobs are in a 3rd party ci system.
Just to clarify, the builds happen here https://ci.centos.org/job/tripleo-upstream-containers-build-master-ppc64le/ We are using kolla with buildah. The Dockerfiles are generated by kolla and then consumed by buildah.
Logs can be found here as well - https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-...
I'm checking with some folks to get the details that would be helpful here.
Thanks.
The question I have is, what do you need to maintain support? I can join this week's IRC meeting if that would be helpful.
Also, last week mnasiadka reached out to me asking if we might be able to turn on kolla jobs in pkvmci (our third party CI - https://wiki.openstack.org/wiki/ThirdPartySystems/IBMPowerKVMCI ). I plan to talk to our CI folks this week to see if we have capacity for this.
Thanks, Mike Turek <mjturek>
W dniu 16.09.2019 o 18:45, Michael Turek pisze:
Hey all,
We do use kolla. Let me see if I can shed some light here.
I have to admit that I wanted to check is there anyone using Kolla on ppc64le. Thanks for replies.
CentOS builds lack 'rabbitmq' 3.7.10 (we use external repo) and 'gnocchi' binary images are not buildable due to lack of some packages (issue already reported to CentOS by TripleO team).
We should be getting the gnocchi issue fixed. See this thread https://lists.centos.org/pipermail/centos-devel/2019-September/017721.html
I am in that thread ;)
The rabbitmq issue is confusing me. The version provided for x86_64 seems to be the same one provided for ppc64le, but maybe I'm missing something. If there's a package we need to get published, I can investigate.
External repo is used and we install "rabbitmq-3.7.10". One 'if ppc64le' check and will work by using in-centos-repo version.
Ubuntu builds lack MariaDB 10.3 because upstream repo is broken. Packages index is provided for 'ppc64le' but no packages so we get 404 errors.
Unfortunately I'm not well versed on the gaps in Ubuntu.
I am fine with it. No one noticed == no one uses.
The question I have is, what do you need to maintain support? I can join this week's IRC meeting if that would be helpful.
For me a knowledge that someone is using is enough to keep it available. Would not call it 'maintaining support' as I do builds on ppc64le once per cycle (if at all per cycle).
Also, last week mnasiadka reached out to me asking if we might be able to turn on kolla jobs in pkvmci (our third party CI - https://wiki.openstack.org/wiki/ThirdPartySystems/IBMPowerKVMCI ). I plan to talk to our CI folks this week to see if we have capacity for this.
Some kind of CI job would be great. Even simple 'centos/source' combo.
I have two patches adding AArch64 CI but we (Linaro) have to fix our OpenStack cluster first. All Ceph nodes use hard drives only and probably not configured optimally. As a result we are unable to fit in three hours required by Zuul.
On 9/16/19 6:07 PM, Marcin Juszkiewicz wrote:
W dniu 16.09.2019 o 18:45, Michael Turek pisze:
Hey all,
We do use kolla. Let me see if I can shed some light here.
I have to admit that I wanted to check is there anyone using Kolla on ppc64le. Thanks for replies.
CentOS builds lack 'rabbitmq' 3.7.10 (we use external repo) and 'gnocchi' binary images are not buildable due to lack of some packages (issue already reported to CentOS by TripleO team).
We should be getting the gnocchi issue fixed. See this thread https://lists.centos.org/pipermail/centos-devel/2019-September/017721.html
I am in that thread ;)
Indeed you are! Thanks for the reply :)
The rabbitmq issue is confusing me. The version provided for x86_64 seems to be the same one provided for ppc64le, but maybe I'm missing something. If there's a package we need to get published, I can investigate.
External repo is used and we install "rabbitmq-3.7.10". One 'if ppc64le' check and will work by using in-centos-repo version.
Thank you for the patch here!
Ubuntu builds lack MariaDB 10.3 because upstream repo is broken. Packages index is provided for 'ppc64le' but no packages so we get 404 errors.
Unfortunately I'm not well versed on the gaps in Ubuntu.
I am fine with it. No one noticed == no one uses.
The question I have is, what do you need to maintain support? I can join this week's IRC meeting if that would be helpful.
For me a knowledge that someone is using is enough to keep it available. Would not call it 'maintaining support' as I do builds on ppc64le once per cycle (if at all per cycle).
Understood!
Also, last week mnasiadka reached out to me asking if we might be able to turn on kolla jobs in pkvmci (our third party CI - https://wiki.openstack.org/wiki/ThirdPartySystems/IBMPowerKVMCI ). I plan to talk to our CI folks this week to see if we have capacity for this.
Some kind of CI job would be great. Even simple 'centos/source' combo.
Sounds good, I'm talking with our CI folks and will keep kolla updated.
I have two patches adding AArch64 CI but we (Linaro) have to fix our OpenStack cluster first. All Ceph nodes use hard drives only and probably not configured optimally. As a result we are unable to fit in three hours required by Zuul.
W dniu 14.09.2019 o 18:45, Marcin Juszkiewicz pisze:
From 3 distributions we target only Debian/source combo was buildable.
CentOS builds lack 'rabbitmq' 3.7.10 (we use external repo)
Sorted out in https://review.opendev.org/682618
participants (4)
-
Alex Schultz
-
Marcin Juszkiewicz
-
Michael Turek
-
Wesley Hayutin