distutils.sysconfig.get_python_lib() does not respect sysconfig/distutils install schemes

[hroncok]

BPO	45460
Nosy	@jaraco, @vstinner, @merwok, @encukou, @dstufft, @hroncok, @frenzymadness, @FFY00

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2021-10-13.14:02:39.767>
labels = ['library', '3.11']
title = 'distutils.sysconfig.get_python_lib() does not respect sysconfig/distutils install schemes'
updated_at = <Date 2021-10-18.10:17:17.696>
user = 'https://github.com/hroncok'

bugs.python.org fields:

activity = <Date 2021-10-18.10:17:17.696>
actor = 'frenzy'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Distutils']
creation = <Date 2021-10-13.14:02:39.767>
creator = 'hroncok'
dependencies = []
files = []
hgrepos = []
issue_num = 45460
keywords = []
message_count = 2.0
messages = ['403834', '403836']
nosy_count = 8.0
nosy_names = ['jaraco', 'vstinner', 'eric.araujo', 'petr.viktorin', 'dstufft', 'hroncok', 'frenzy', 'FFY00']
pr_nums = []
priority = 'normal'
resolution = None
stage = None
status = 'open'
superseder = None
type = None
url = 'https://bugs.python.org/issue45460'
versions = ['Python 3.11']

[hroncok]

In #24549 (Load install schemes from sysconfig) we have assumed that distutils will simply read all information from sysconfig, so distributors could patch the install schemes in there and distutils (whether the one in the standard library or a third party fork).

However, in pypa/pip#10151 (comment) we have figured out that distutils.sysconfig.get_python_lib() does not respect the schemes from sysconfig at all, instead, it creates the paths from scratch.

This might be too late for Python 3.10, but in Python 3.11 I'd like distutils.sysconfig.get_python_lib() to return paths defined by sysconfig install schemes. That way, we can more easily move that from the standard library to a third-party project with an independent delivery mechanism.

[hroncok]

so distributors could patch the install schemes in there and distutils (whether the one in the standard library or a third party fork).

Somehow, this sentence is not finished properly.

...so distributors could patch the install schemes in there and distutils (whether the one in the standard library or a third party fork) would respect it.

[FFY00]

@hroncok is this still relevant? distutils will not be present in 3.12 anyway, so I think we should close this anyway.

[hroncok]

It's still buggy but too late to fix in 3.11 without breaking backwards compatability. Let's close as wontfix?

[FFY00]

Yeah. Realistically, I think as long as setuptools gets this right, it shouldn't be that big of a deal.