Open Stack

On Tue, Feb 19, 2013 at 10:31:36AM -0800, Monty Taylor wrote:
> On 02/19/2013 08:22 AM, Daniel P. Berrange wrote:
> > If anyone has any info on how this is done, I'd be interested to know
> > what approach OpenStack CI is using for this. I'd like to figure out
> > how I can get something similar for personal developer infrastructure
> > environments avoid them hitting pypi too.
> 
> We have plenty of info on how it's done! We have a couple of scripts in
> the jeepyb project (which is pip installable, but also can be found at
> https://github.com/openstack-infra/jeepyb) One of them clones all of the
> projects that are listed in a file, looks in all of their branches for
> requirements.txt or tools/pip-requires or tools/test-requires, and then
> runs a pip download on those to populate a pip download cache.
> 
> Then we have different script that can turn a pip download cache into a
> pypi structure, which we serve as static files via apache.
> 
> Once that's there, we configure ~/.pip/pip.conf to point to the static
> partial pypi.
> 
> The above (and everything else we do) is all in:
> 
> https://github.com/openstack-infra/config/
> 
> and a decent amount of it is documented at http://ci.openstack.org
> 
> Specifically, for this, you'd be interested in:
> 
> https://github.com/openstack-infra/config/tree/master/modules/pypimirror
> 
> We're still working on a good fix for the underlying problem, which is
> that the design of pypi index lookups is TERRIBLE.

Thanks for the all the links - this is useful info

Regards,
Daniel
-- 
|: http://berrange.com      -o-    http://www.flickr.com/photos/dberrange/ :|
|: http://libvirt.org              -o-             http://virt-manager.org :|
|: http://autobuild.org       -o-         http://search.cpan.org/~danberr/ :|
|: http://entangle-photo.org       -o-       http://live.gnome.org/gtk-vnc :|