<html><body><p><font size="2" color="#800080">----- Forwarded by Bob Hansen/Endicott/IBM on 05/11/2016 05:33 PM -----</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">Bob Hansen/Endicott/IBM</font><br><font size="2" color="#5F5F5F">To: </font><font size="2">Jeremy Stanley <fungi@yuggoth.org></font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">05/11/2016 05:18 PM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">Re: [OpenStack-Infra] Correct URL to synch local pypi mirror from</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><tt>Jeremy Stanley <fungi@yuggoth.org> wrote on 05/11/2016 04:46:10 PM:<br></tt><br><tt>Thanks Jeremy,</tt><br><tt><br>> From: Jeremy Stanley <fungi@yuggoth.org></tt><br><tt>> To: Bob Hansen/Endicott/IBM@IBMUS</tt><br><tt>> Cc: openstack-infra@lists.openstack.org</tt><br><tt>> Date: 05/11/2016 04:46 PM</tt><br><tt>> Subject: Re: [OpenStack-Infra] Correct URL to synch local pypi mirror from</tt><br><tt>> <br>> On 2016-05-11 16:31:48 -0400 (-0400), Bob Hansen wrote:<br>> [...]<br>> > I have a bandersnatch mirror, that mirrors from pypi.python.org<br>> > every few hours, but during a run it can't find packages that have<br>> > been updated in various requirements.txt files and not on<br>> > pypi.python.org.<br>> [...]<br>> <br>> Update latency could be one possible issue. We update our mirrors<br>> every 5 minutes, so it's possible you're seeing constraints updates<br>> landing and specifying versions of things which are not yet in your<br>> mirror.</tt><br><br><tt>ok, I've been doing it every hour.</tt><br><tt><br>> <br>> > Recently there was a change made to the oslo.config and oslo.concurrency<br>> > versions that are not on my mirror and are not on pypi.python.org.<br>> [...]<br>> > A check on pypi (and my mirror) shows the most recent version is<br>> > oslo.config 3.4.0<br>> <br>> I wonder why you think 3.4.0 is the latest version... at<br>> </tt><tt><a href="https://pypi.python.org/simple/oslo.config/">https://pypi.python.org/simple/oslo.config/</a></tt><tt> I see both<br>> oslo.config-3.9.0.tar.gz and oslo.config-3.9.0-py2.py3-none-any.whl<br>> linked.</tt><br><br><tt>Looked at your link, I was using the search box on pypi. Not sure why search doesn't return all the versions which is a bit concerning, but I'll ignore that.</tt><br><br><tt>If I do a pip search using my mirror I get 3.4.0, if I poke around in .../simple/oslo.config on my mirror I see the 3.9.0 tar file. I guess my mirror is messed up, not sure why as it's been running for several months now with only a few burps.</tt><br><br><tt>I'm going to rebuild the entire mirror again, and see if that fixes it up.</tt><br><tt><br>> <br>> > Questions:<br>> > 1.What is the proper URL to synch my mirror from?<br>> <br>> We use mirror.master=https://pypi.python.org in our bandersnatch<br>> configuration, as indicated here:<br>> <URL: </tt><tt><a href="http://git.openstack.org/cgit/openstack-infra/puppet-">http://git.openstack.org/cgit/openstack-infra/puppet-</a></tt><tt><br>> bandersnatch/tree/templates/bandersnatch.conf.erb#n8 ><br>> <br>> > 2.See many references to per-reqion openstack pypi mirrors, should I be<br>> > using them? If so, what are the URLs, or where can I find them?</tt><br><br><tt>Seems I was on the correct path with pypi.python anyway. Based on your response this option should be discarded.</tt><br><tt><br>> <br>> No, those are local mirrors in our various CI environments. We don't<br>> recommend their use outside our upstream CI jobs/workers for a<br>> variety of reasons (they're unofficial/non-canonical, we frequently<br>> rename or reorganize them in opaque and disruptive ways, may have<br>> them down for unannounced maintenance, et cetera).<br>> -- <br>> Jeremy Stanley<br>> <br>Bob Hansen</tt><br><tt>z/VM OpenStack Enablement</tt><BR>
</body></html>