build mode which fails for build failures in extensions

[doko42]

BPO	4304
Nosy	@doko42, @bitdancer, @encukou

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2008-11-12.09:34:40.870>
labels = ['build']
title = 'build mode which fails for build failures in extensions'
updated_at = <Date 2021-10-19.14:42:42.116>
user = 'https://github.com/doko42'

bugs.python.org fields:

activity = <Date 2021-10-19.14:42:42.116>
actor = 'petr.viktorin'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Build']
creation = <Date 2008-11-12.09:34:40.870>
creator = 'doko'
dependencies = []
files = []
hgrepos = []
issue_num = 4304
keywords = ['buildbot']
message_count = 5.0
messages = ['75780', '109576', '109816', '189914', '404309']
nosy_count = 3.0
nosy_names = ['doko', 'r.david.murray', 'petr.viktorin']
pr_nums = []
priority = 'normal'
resolution = None
stage = None
status = 'open'
superseder = None
type = None
url = 'https://bugs.python.org/issue4304'
versions = []

[doko42]

as seen in bpo-4303, the buildbots don't complain about build failures
in extensions. it would be nice to have a mode, where the build fails
when an extension doesn't build, but is expected to build. exceptions to
this set of expected builds should be configurable.

[BreamoreBoy]

Would someone with knowledge of the buildbots like to comment please.

[bitdancer]

One reasonably easy possibility would be to add an option to regrtest to exit with a non-zero return code if there are unexpected skips. This might not cover 100% of Mathias's cases (but it might), and the configurability would be limited to changing the expected skip lists in regrtest. But it would be pretty easy to do, if all of the buildbots can be required to build all of the expected extensions. I'm not sure that this last requirement is currently met by all the buidbots.

[BreamoreBoy]

Can someone answer the question pointed to by msg109816 i.e. can all of the buildbots build all of the expected extensions?

[encukou]

This would be nice.
Too often when hacking on an extension, test pass just because I don't notice there was a compile error and so I'm testing an older version.

[iritkatriel]

See also #50980.

[merwok]

@tiran could you say if the new build system avoids this problem?