bpo-44331: Generate static PyCodeObjects for faster startup #26571
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This is based on 'frozen_modules' from Jeethu Rao
<jeethu@jeethurao.com>, via Larry Hastings. My starting point was:
git@github.com:larryhastings/cpython.git
not_another_use_of_the_word_frozen
Changes:
- Move static C code generation tool to Tools/freeze2
- Move _serializer to Modules
- Rebase on Python 3.10.0b1
- determine startup modules by running sys.executable
- use importlib.util.find_spec() to get code objects
- fix ref-counting when setting __path__
- put static frozen modules in frozen_code_objects dict
- reduce set of "bad" modules as it seems only _collections_abc needs
exclusion
- fix the is_frozen_package() and is_frozen() functions to find
static frozen code
Usage:
- Compile Python as normal
- Run "make regen-freeze-startup" to re-generate
Python/frozenmodules_code.c
- Compile Python a second time
|
This PR is stale because it has been open for 30 days with no activity. |
|
The associated issue is closed now. @nascheme Can we close it now? |
|
The deepfreeze work supersedes this. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Note: this is proof of concept and not ready to be merged as is.
Usage:
https://bugs.python.org/issue44331