Open Stack

On Sep 3, 2014, at 5:27 AM, Yuriy Taraday <yorik.sar at gmail.com> wrote:

> On Tue, Sep 2, 2014 at 11:17 PM, Clark Boylan <cboylan at sapwetik.org> wrote:
> On Tue, Sep 2, 2014, at 11:30 AM, Yuriy Taraday wrote:
> > Hello.
> >
> > Currently for alpha releases of oslo libraries we generate either
> > universal
> > or Python 2.x-only wheels. This presents a problem: we can't adopt alpha
> > releases in projects where Python 3.x is supported and verified in the
> > gate. I've ran into this in change request [1] generated after
> > global-requirements change [2]. There we have oslotest library that can't
> > be built as a universal wheel because of different requirements (mox vs
> > mox3 as I understand is the main difference). Because of that py33 job in
> > [1] failed and we can't bump oslotest version in requirements.
> >
> > I propose to change infra scripts that generate and upload wheels to
> > create
> > py3 wheels as well as py2 wheels for projects that support Python 3.x (we
> > can use setup.cfg classifiers to find that out) but don't support
> > universal
> > wheels. What do you think about that?
> >
> > [1] https://review.openstack.org/117940
> > [2] https://review.openstack.org/115643
> >
> > --
> >
> > Kind regards, Yuriy.
> > _______________________________________________
> > OpenStack-dev mailing list
> > OpenStack-dev at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
> We may find that we will need to have py3k wheels in addition to the
> existing wheels at some point, but I don't think this use case requires
> it. If oslo.test needs to support python2 and python3 it should use mox3
> in both cases which claims to support python2.6, 2.7 and 3.2. Then you
> can ship a universal wheel. This should solve the immediate problem.
> 
> Yes, I think, it's the way to go with oslotest specifically. Created a change request for this: https://review.openstack.org/118551
> 
> It has been pointed out to me that one case where it won't be so easy is
> oslo.messaging and its use of eventlet under python2. Messaging will
> almost certainly need python 2 and python 3 wheels to be separate. I
> think we should continue to use universal wheels where possible and only
> build python2 and python3 wheels in the special cases where necessary.
> 
> We can make eventlet an optional dependency of oslo.messaging (through setuptools' extras). In fact I don't quite understand the need for eventlet as direct dependency there since we can just write code that uses threading library and it'll get monkeypatched if consumer app wants to use eventlet.

There is code in the messaging library that makes calls directly into eventlet now, IIRC. It sounds like that could be changed, but that’s something to consider for a future version.

The last time I looked at setuptools extras they were a documented but unimplemented specification. Has that changed?

> 
> The setup.cfg classifiers should be able to do that for us, though PBR
> may need updating?
> 
> I don't think so - it loads all classifiers from setup.cfg, they should be available through some distutils machinery.
> 
> We will also need to learn to upload potentially >1
> wheel in our wheel jobs. That bit is likely straight foward. The last
> thing that we need to make sure we do is that we have some testing in
> place for the special wheels. We currently have the requirements
> integration test which runs under python2 checking that we can actually
> install all the things together. This ends up exercising our wheels and
> checking that they actually work. We don't have a python3 equivalent for
> that job. It may be better to work out some explicit checking of the
> wheels we produce that applies to both versions of python. I am not
> quite sure how we should approach that yet.
> 
> I guess we can just repeat that check with Python 3.x. If I see it right, all we need is to repeat loop in pbr/tools/integration.sh with different Python version. The problem might occur that we'll be running this test with Python 3.4 that is default on trusty but all our unittests jobs run on 3.3 instead. May be we should drop 3.3 already?
> 
> -- 
> 
> Kind regards, Yuriy.
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140903/9f3eeca7/attachment.html>