Open Stack

----- Forwarded by Bob Hansen/Endicott/IBM on 05/11/2016 05:33 PM -----

From:	Bob Hansen/Endicott/IBM
To:	Jeremy Stanley <fungi at yuggoth.org>
Date:	05/11/2016 05:18 PM
Subject:	Re: [OpenStack-Infra] Correct URL to synch local pypi mirror
            from


Jeremy Stanley <fungi at yuggoth.org> wrote on 05/11/2016 04:46:10 PM:

Thanks Jeremy,

> From: Jeremy Stanley <fungi at yuggoth.org>
> To: Bob Hansen/Endicott/IBM at IBMUS
> Cc: openstack-infra at lists.openstack.org
> Date: 05/11/2016 04:46 PM
> Subject: Re: [OpenStack-Infra] Correct URL to synch local pypi mirror
from
>
> On 2016-05-11 16:31:48 -0400 (-0400), Bob Hansen wrote:
> [...]
> > I have a bandersnatch mirror, that mirrors from pypi.python.org
> > every few hours, but during a run it can't find packages that have
> > been updated in various requirements.txt files and not on
> > pypi.python.org.
> [...]
>
> Update latency could be one possible issue. We update our mirrors
> every 5 minutes, so it's possible you're seeing constraints updates
> landing and specifying versions of things which are not yet in your
> mirror.

ok, I've been doing it every hour.

>
> > Recently there was a change made to the oslo.config and
oslo.concurrency
> > versions that are not on my mirror and are not on pypi.python.org.
> [...]
> > A check on pypi (and my mirror) shows the most recent version is
> > oslo.config 3.4.0
>
> I wonder why you think 3.4.0 is the latest version... at
> https://pypi.python.org/simple/oslo.config/ I see both
> oslo.config-3.9.0.tar.gz and oslo.config-3.9.0-py2.py3-none-any.whl
> linked.

Looked at your link, I was using the search box on pypi. Not sure why
search doesn't return all the versions which is a bit concerning, but I'll
ignore that.

If I do a pip search using my mirror I get 3.4.0, if I poke around
in .../simple/oslo.config on my mirror I see the 3.9.0 tar file. I guess my
mirror is messed up, not sure why as it's been running for several months
now with only a few burps.

I'm going to rebuild the entire mirror again, and see if that fixes it up.

>
> > Questions:
> > 1.What is the proper URL to synch my mirror from?
>
> We use mirror.master=https://pypi.python.org in our bandersnatch
> configuration, as indicated here:
> <URL: http://git.openstack.org/cgit/openstack-infra/puppet-
> bandersnatch/tree/templates/bandersnatch.conf.erb#n8 >
>
> > 2.See many references to per-reqion openstack pypi mirrors, should I be
> > using them? If so, what are the URLs, or where can I find them?

Seems I was on the correct path with pypi.python anyway. Based on your
response this option should be discarded.

>
> No, those are local mirrors in our various CI environments. We don't
> recommend their use outside our upstream CI jobs/workers for a
> variety of reasons (they're unofficial/non-canonical, we frequently
> rename or reorganize them in opaque and disruptive ways, may have
> them down for unannounced maintenance, et cetera).
> --
> Jeremy Stanley
>
Bob Hansen
z/VM OpenStack Enablement
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-infra/attachments/20160511/68f07e63/attachment.html>