[openstack-dev] OpenStack + PyPy: Status and goals

Roman Podolyaka rpodolyaka at mirantis.com
Tue Sep 10 05:15:25 UTC 2013


Hi Alex,

That's really cool! I believe, performance is not the only benefit we can
get from running OpenStack projects on PyPy. We  can also improve the
overall "correctness" of our code (as PyPy behaves differently with
non-closed files, etc), just like compiling of your C/C++ app using
different compilers can show hidden errors.

And what about eventlet? Does it work well on PyPy? (as it is used in Nova,
Neutron, etc)

Thanks,
Roman


On Tue, Sep 10, 2013 at 12:28 AM, Alex Gaynor <alex.gaynor at gmail.com> wrote:

> Hi all,
>
> Many of you have probably seen me send review requests in the last few
> weeks
> about adding PyPy support to various OpenStack projects. A few people were
> confused by these, so I wanted to fill everyone in on what I'm up to :)
>
> First, for those who aren't familiar with what PyPy is: PyPy is an
> implementation of the Python language which includes a high performance
> tracing
> just-in-time compiler and which is faster than CPython (the reference, and
> most
> widely deployed, implementation) on almost all workloads.
>
> The current status is:
>
> Two major projects work, both Marconi and Swift, Marconi is gating against
> PyPy
> already, Swift isn't yet since I needed to fix a few small PyPy bugs and
> those
> aren't in a release yet, expect it soon :)
>
> In terms of results, I've observed 30% performance improvements on GET
> workloads for Swift under PyPy vs. CPython (other workloads haven't been
> benchmarked tet). I believe the Marconi folks have also observed some
> performance wins, but I'll let them speak to that, I don't have the full
> details.
>
> Many python-clients projects are also working out of the box and gating:
> including novaclient, swiftclient, marconiclient, ceilometerclient,
> heatclient,
> and ironicclient!
>
> There's a few outstanding reviews to add PyPy gating for cinderclient,
> troveclient, and glanceclient.
>
> In terms of future direction:
>
> I'm going to continue to work on getting more projects running and gating
> against PyPy.
>
> Right now I'm focusing a lot of my attention on improving Swift
> performance,
> particularly under PyPy, but also under CPython.
>
> I'm hoping some day PyPy will be the default way to deploy OpenStack!
>
>
> If you're interested in getting your project running on PyPy, or looking at
> performance under it, please let me know, I'm always interested in helping!
>
> Thanks,
> Alex
>
> --
> "I disapprove of what you say, but I will defend to the death your right
> to say it." -- Evelyn Beatrice Hall (summarizing Voltaire)
> "The people's good is the highest law." -- Cicero
> GPG Key fingerprint: 125F 5C67 DFE9 4084
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20130910/53812f3c/attachment.html>


More information about the OpenStack-dev mailing list