Open Stack

On Fri, Oct 20, 2017, at 11:17 AM, Clark Boylan wrote:
> On Fri, Oct 20, 2017, at 07:23 AM, Doug Hellmann wrote:
> > It sounds like the PyPI/PyPA folks are planning some major changes to
> > pip internals, soon.
> > 
> > I know pbr uses setuptools, and I don't think it uses pip, but if
> > someone has time to verify that it would be helpful.
> > 
> > We'll also want to watch out for breakage in normal use of pip 10. If
> > they're making changes this big, they may miss something in their own
> > test coverage that affects our jobs.
> > 
> 
> After a quick skim of PBR I don't think we use pip internals anywhere.
> Its all executed via the command itself. That said we should test this
> so I've put up https://review.openstack.org/513825 (others should feel
> free to iterate on it if it doesn't work) to install latest pip master
> in a devstack run.

The current issue this change is facing can be seen at
http://logs.openstack.org/25/513825/4/check/legacy-tempest-dsvm-py35/c31deb2/logs/devstacklog.txt.gz#_2017-10-20_20_07_54_838.
The tl;dr is that for distutils installed packages (basically all the
distro installed python packges) pip refuses to uninstall them in order
to perform upgrades because it can't reliably determine where all the
files are. I think this is a new pip 10 behavior.

In the general case I think this means we can not rely on global pip
installs anymore. This may be a good thing to bring up with upstream
PyPA as I expect it will break a lot of people in a lot of places (it
will break infra for example too).

Clark