gh-142476: fix memory leak when creating JIT executors#142492

ashm-dev

Issue: ASan memory leak in test_gc with --enable-experimental-jit (allocate_executor) #142476

ashm-dev

I believe a news entry is not required for this change.

Fidget-Spinner

Wow, great catch!

Could you please add a comment(review below) so that we know why this is needed?

Fidget-Spinner

The failing Windows test is likely because of https://github.com/python/cpython/pull/137016/files. Could you please try pulling in the changes from there?

ashm-dev

Yes, applying the changes from #137016 fixes the Windows crash.

Fidget-Spinner

We need this to be merged first https://github.com/python/cpython/pull/137016/files

sergey-miryanov

Also, I'm not sure I get why we DECREF executor in _Py_ExecutorDetach? It is called from executor_clear with self and it doesn't seem right to me.

Maybe @markshannon can shed a light to this, because of #118459

Fidget-Spinner

Also, I'm not sure I get why we DECREF executor in _Py_ExecutorDetach? It is called from executor_clear with self and it doesn't seem right to me.

Maybe @markshannon can shed a light to this, because of #118459

Detach is for removing the executor from a code object. The code object owns a strong reference to the executor so we must decref it.

sergey-miryanov

@Fidget-Spinner Thanks!

ashm-dev

The crashes were caused by a double untrack exposed by the fix.

The original fix correctly drops the reference.
If the executor is destroyed during a GC cycle (via tp_clear), the GC has already untracked the object.
uop_dealloc was blindly calling _PyObject_GC_UNTRACK again, causing assertion failures (Windows) and heap corruption (Linux/Mac).

The fix: Guard the untrack call with if (_PyObject_GC_IS_TRACKED(self)).

ashm-dev

@Fidget-Spinner I've added the news entry.

Fidget-Spinner

So I'm gonna leave this around for a few more days. However could you please add a code comment above the if that tp_traverse might untrack the onject once it breaks cycles, so we need to not double-untrack it please?

ashm-dev

Got it, sounds good — I’ll do that.

sergey-miryanov

@ashm-dev #142931 changed the schema of the executors management. Could you please re-apply your changes and retest?

ashm-dev

@sergey-miryanov The project doesn't even build right now, so I'm unable to verify it. I'm building Python from the main branch as follows: CC=clang-21 CXX=clang++-21 ./configure --with-pydebug --with-address-sanitizer --enable-experimental-jit=yes && make -j, and here is the result (I'm attaching the logs and ASan leaks below):

Build Logs

./_bootstrap_python ./Programs/_freeze_module.py abc ./Lib/abc.py Python/frozen_modules/abc.h
./_bootstrap_python ./Programs/_freeze_module.py codecs ./Lib/codecs.py Python/frozen_modules/codecs.h
./_bootstrap_python ./Programs/_freeze_module.py io ./Lib/io.py Python/frozen_modules/io.h
./_bootstrap_python ./Programs/_freeze_module.py _collections_abc ./Lib/_collections_abc.py Python/frozen_modules/_collections_abc.h
./_bootstrap_python ./Programs/_freeze_module.py _sitebuiltins ./Lib/_sitebuiltins.py Python/frozen_modules/_sitebuiltins.h
./_bootstrap_python ./Programs/_freeze_module.py genericpath ./Lib/genericpath.py Python/frozen_modules/genericpath.h
./_bootstrap_python ./Programs/_freeze_module.py ntpath ./Lib/ntpath.py Python/frozen_modules/ntpath.h
./_bootstrap_python ./Programs/_freeze_module.py posixpath ./Lib/posixpath.py Python/frozen_modules/posixpath.h
./_bootstrap_python ./Programs/_freeze_module.py os ./Lib/os.py Python/frozen_modules/os.h
./_bootstrap_python ./Programs/_freeze_module.py site ./Lib/site.py Python/frozen_modules/site.h
./_bootstrap_python ./Programs/_freeze_module.py stat ./Lib/stat.py Python/frozen_modules/stat.h
./_bootstrap_python ./Programs/_freeze_module.py importlib.util ./Lib/importlib/util.py Python/frozen_modules/importlib.util.h
./_bootstrap_python ./Programs/_freeze_module.py importlib.machinery ./Lib/importlib/machinery.py Python/frozen_modules/importlib.machinery.h
./_bootstrap_python ./Programs/_freeze_module.py runpy ./Lib/runpy.py Python/frozen_modules/runpy.h
./_bootstrap_python ./Programs/_freeze_module.py __hello__ ./Lib/__hello__.py Python/frozen_modules/__hello__.h
./_bootstrap_python ./Programs/_freeze_module.py __phello__ ./Lib/__phello__/__init__.py Python/frozen_modules/__phello__.h
./_bootstrap_python ./Programs/_freeze_module.py __phello__.ham ./Lib/__phello__/ham/__init__.py Python/frozen_modules/__phello__.ham.h
./_bootstrap_python ./Programs/_freeze_module.py __phello__.ham.eggs ./Lib/__phello__/ham/eggs.py Python/frozen_modules/__phello__.ham.eggs.h
./_bootstrap_python ./Programs/_freeze_module.py __phello__.spam ./Lib/__phello__/spam.py Python/frozen_modules/__phello__.spam.h
./_bootstrap_python ./Programs/_freeze_module.py frozen_only ./Tools/freeze/flag.py Python/frozen_modules/frozen_only.h

=================================================================
==19728==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x55dd003fbe05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55dd0077ff51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55dd0077ff51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55dd0077ff51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x55dd00aaec90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x55dd00aaec90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x55dd00aaec90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x55dd00ef7225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x55dd00ef7225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x55dd00ef7225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x55dd00ef7225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x55dd00a0e423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x55dd009ca41d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x55dd00676f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x55dd00676f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x55dd00671341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x55dd006b7288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55dd006ae7d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55dd006ae338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55dd006ae338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55dd006ae338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55dd005bf697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55dd005bfabb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x55dd0086a695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x55dd009e36b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x55dd009a7357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x55dd009a7357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x55dd009a6d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55dd00f8d77e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55dd00f8c92b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x55dd00f86e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x55dd00f849cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x55dd00f83d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x55dd010014da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x55dd010014da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x55dd00fff513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x55dd00fff513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55dd011a704b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7faa25627634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7faa256276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x55dd002f8314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).

=================================================================
==19724==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x55c8894f6e05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55c88987af51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55c88987af51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55c88987af51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x55c889ba9c90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x55c889ba9c90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x55c889ba9c90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x55c889ff2225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x55c889ff2225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x55c889ff2225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x55c889ff2225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x55c889b09423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x55c889ac541d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x55c889771f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x55c889771f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x55c88976c341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x55c8897b2288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55c8897a97d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55c8897a9338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55c8897a9338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55c8897a9338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55c8896ba697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55c8896baabb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x55c889965695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x55c889ade6b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x55c889aa2357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x55c889aa2357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x55c889aa1d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55c88a08877e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55c88a08792b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x55c88a081e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x55c88a07f9cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x55c88a07ed0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x55c88a0fc4da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x55c88a0fc4da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x55c88a0fa513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x55c88a0fa513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55c88a2a204b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7fc8c5a27634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7fc8c5a276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x55c8893f3314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1968: Python/frozen_modules/_sitebuiltins.h] Error 1
make: *** Waiting for unfinished jobs....
make: *** [Makefile:1956: Python/frozen_modules/abc.h] Error 1

=================================================================
==19726==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x562105515e05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x562105899f51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x562105899f51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x562105899f51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x562105bc8c90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x562105bc8c90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x562105bc8c90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x562106011225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x562106011225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x562106011225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x562106011225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x562105b28423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x562105ae441d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x562105790f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x562105790f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x56210578b341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x5621057d1288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x5621057c87d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x5621057c8338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x5621057c8338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x5621057c8338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x5621056d9697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x5621056d9abb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x562105984695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x562105afd6b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x562105ac1357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x562105ac1357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x562105ac0d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x5621060a777e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x5621060a692b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x5621060a0e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x56210609e9cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x56210609dd0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x56210611b4da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x56210611b4da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x562106119513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x562106119513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x5621062c104b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7f3fdb027634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7f3fdb0276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x562105412314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).

=================================================================
==19735==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x55ad72540e05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55ad728c4f51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55ad728c4f51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55ad728c4f51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x55ad72bf3c90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x55ad72bf3c90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x55ad72bf3c90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x55ad7303c225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x55ad7303c225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x55ad7303c225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x55ad7303c225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x55ad72b53423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x55ad72b0f41d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x55ad727bbf6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x55ad727bbf6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x55ad727b6341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x55ad727fc288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55ad727f37d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55ad727f3338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55ad727f3338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55ad727f3338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55ad72704697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55ad72704abb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x55ad729af695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x55ad72b286b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x55ad72aec357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x55ad72aec357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x55ad72aebd51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55ad730d277e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55ad730d192b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x55ad730cbe3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x55ad730c99cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x55ad730c8d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x55ad731464da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x55ad731464da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x55ad73144513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x55ad73144513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55ad732ec04b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7f12d7a27634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7f12d7a276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x55ad7243d314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1962: Python/frozen_modules/io.h] Error 1
make: *** [Makefile:1989: Python/frozen_modules/importlib.util.h] Error 1

=================================================================
==19731==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x555e2c07be05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x555e2c3fff51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x555e2c3fff51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x555e2c3fff51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x555e2c72ec90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x555e2c72ec90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x555e2c72ec90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x555e2cb77225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x555e2cb77225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x555e2cb77225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x555e2cb77225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x555e2c68e423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x555e2c64a41d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x555e2c2f6f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x555e2c2f6f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x555e2c2f1341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x555e2c337288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x555e2c32e7d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x555e2c32e338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x555e2c32e338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x555e2c32e338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x555e2c23f697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x555e2c23fabb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x555e2c4ea695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x555e2c6636b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x555e2c627357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x555e2c627357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x555e2c626d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x555e2cc0d77e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x555e2cc0c92b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x555e2cc06e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x555e2cc049cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x555e2cc03d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x555e2cc814da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x555e2cc814da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x555e2cc7f513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x555e2cc7f513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x555e2ce2704b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7fbc18227634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7fbc182276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x555e2bf78314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1977: Python/frozen_modules/posixpath.h] Error 1

=================================================================
==19737==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x55bfead65e05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55bfeb0e9f51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55bfeb0e9f51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55bfeb0e9f51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x55bfeb418c90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x55bfeb418c90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x55bfeb418c90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x55bfeb861225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x55bfeb861225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x55bfeb861225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x55bfeb861225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x55bfeb378423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x55bfeb33441d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x55bfeafe0f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x55bfeafe0f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x55bfeafdb341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x55bfeb021288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55bfeb0187d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55bfeb018338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55bfeb018338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55bfeb018338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55bfeaf29697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55bfeaf29abb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x55bfeb1d4695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x55bfeb34d6b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x55bfeb311357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x55bfeb311357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x55bfeb310d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55bfeb8f777e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55bfeb8f692b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x55bfeb8f0e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x55bfeb8ee9cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x55bfeb8edd0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x55bfeb96b4da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x55bfeb96b4da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x55bfeb969513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x55bfeb969513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55bfebb1104b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7f105f227634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7f105f2276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x55bfeac62314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).

=================================================================
==19734==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x556ebf99ae05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x556ebfd1ef51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x556ebfd1ef51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x556ebfd1ef51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x556ec004dc90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x556ec004dc90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x556ec004dc90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x556ec0496225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x556ec0496225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x556ec0496225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x556ec0496225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x556ebffad423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x556ebff6941d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x556ebfc15f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x556ebfc15f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x556ebfc10341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x556ebfc56288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x556ebfc4d7d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x556ebfc4d338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x556ebfc4d338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x556ebfc4d338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x556ebfb5e697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x556ebfb5eabb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x556ebfe09695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x556ebff826b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x556ebff46357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x556ebff46357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x556ebff45d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x556ec052c77e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x556ec052b92b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x556ec0525e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x556ec05239cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x556ec0522d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x556ec05a04da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x556ec05a04da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x556ec059e513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x556ec059e513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x556ec074604b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7fb499e27634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7fb499e276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x556ebf897314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1995: Python/frozen_modules/runpy.h] Error 1
make: *** [Makefile:1986: Python/frozen_modules/stat.h] Error 1

=================================================================
==19729==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x5612908fce05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x561290c80f51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x561290c80f51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x561290c80f51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x561290fafc90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x561290fafc90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x561290fafc90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x5612913f8225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x5612913f8225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x5612913f8225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x5612913f8225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x561290f0f423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x561290ecb41d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x561290b77f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x561290b77f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x561290b72341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x561290bb8288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x561290baf7d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x561290baf338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x561290baf338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x561290baf338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x561290ac0697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x561290ac0abb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x561290d6b695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x561290ee46b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x561290ea8357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x561290ea8357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x561290ea7d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x56129148e77e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x56129148d92b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x561291487e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x5612914859cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x561291484d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x5612915024da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x5612915024da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x561291500513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x561291500513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x5612916a804b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7f4daec27634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7f4daec276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x5612907f9314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1971: Python/frozen_modules/genericpath.h] Error 1

=================================================================
==19725==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x564b04c5ce05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x564b04fe0f51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x564b04fe0f51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x564b04fe0f51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x564b0530fc90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x564b0530fc90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x564b0530fc90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x564b05758225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x564b05758225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x564b05758225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x564b05758225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x564b0526f423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x564b0522b41d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x564b04ed7f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x564b04ed7f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x564b04ed2341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x564b04f18288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x564b04f0f7d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x564b04f0f338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x564b04f0f338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x564b04f0f338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x564b04e20697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x564b04e20abb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x564b050cb695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x564b052446b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x564b05208357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x564b05208357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x564b05207d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x564b057ee77e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x564b057ed92b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x564b057e7e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x564b057e59cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x564b057e4d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x564b058624da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x564b058624da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x564b05860513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x564b05860513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x564b05a0804b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7f90e4027634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7f90e40276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x564b04b59314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1959: Python/frozen_modules/codecs.h] Error 1

=================================================================
==19730==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x55778f121e05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55778f4a5f51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55778f4a5f51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55778f4a5f51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x55778f7d4c90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x55778f7d4c90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x55778f7d4c90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x55778fc1d225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x55778fc1d225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x55778fc1d225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x55778fc1d225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x55778f734423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x55778f6f041d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x55778f39cf6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x55778f39cf6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x55778f397341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x55778f3dd288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55778f3d47d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55778f3d4338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55778f3d4338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55778f3d4338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55778f2e5697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55778f2e5abb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x55778f590695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x55778f7096b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x55778f6cd357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x55778f6cd357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x55778f6ccd51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55778fcb377e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55778fcb292b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x55778fcace3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x55778fcaa9cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x55778fca9d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x55778fd274da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x55778fd274da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x55778fd25513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x55778fd25513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55778fecd04b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7fa721627634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7fa7216276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x55778f01e314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1974: Python/frozen_modules/ntpath.h] Error 1

=================================================================
==19733==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x5576034aae05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55760382ef51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55760382ef51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55760382ef51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x557603b5dc90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x557603b5dc90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x557603b5dc90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x557603fa6225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x557603fa6225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x557603fa6225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x557603fa6225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x557603abd423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x557603a7941d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x557603725f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x557603725f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x557603720341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x557603766288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55760375d7d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55760375d338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55760375d338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55760375d338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55760366e697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55760366eabb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x557603919695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x557603a926b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x557603a56357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x557603a56357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x557603a55d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55760403c77e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55760403b92b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x557604035e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x5576040339cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x557604032d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x5576040b04da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x5576040b04da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x5576040ae513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x5576040ae513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55760425604b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7f9d59427634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7f9d594276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x5576033a7314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1983: Python/frozen_modules/site.h] Error 1

=================================================================
==19732==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x55a956d39e05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55a9570bdf51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55a9570bdf51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55a9570bdf51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x55a9573ecc90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x55a9573ecc90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x55a9573ecc90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x55a957835225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x55a957835225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x55a957835225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x55a957835225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x55a95734c423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x55a95730841d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x55a956fb4f6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x55a956fb4f6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x55a956faf341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x55a956ff5288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55a956fec7d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55a956fec338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55a956fec338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55a956fec338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55a956efd697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55a956efdabb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x55a9571a8695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x55a9573216b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x55a9572e5357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x55a9572e5357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x55a9572e4d51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55a9578cb77e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55a9578ca92b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x55a9578c4e3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x55a9578c29cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x55a9578c1d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x55a95793f4da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x55a95793f4da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x55a95793d513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x55a95793d513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55a957ae504b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7f8aa8e27634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7f8aa8e276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x55a956c36314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).

=================================================================
==19727==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 928 byte(s) in 1 object(s) allocated from:
    #0 0x55decd52fe05 in malloc (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x3c0e05) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)
    #1 0x55decd8b3f51 in _PyMem_DebugRawAlloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2889:24
    #2 0x55decd8b3f51 in _PyMem_DebugRawMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:2922:12
    #3 0x55decd8b3f51 in _PyMem_DebugMalloc /home/boss/projects/oss/cpython/main/Objects/obmalloc.c:3087:12
    #4 0x55decdbe2c90 in _PyObject_MallocWithType /home/boss/projects/oss/cpython/main/./Include/internal/pycore_object_alloc.h:46:17
    #5 0x55decdbe2c90 in gc_alloc /home/boss/projects/oss/cpython/main/Python/gc.c:2352:17
    #6 0x55decdbe2c90 in _PyObject_GC_NewVar /home/boss/projects/oss/cpython/main/Python/gc.c:2394:25
    #7 0x55dece02b225 in allocate_executor /home/boss/projects/oss/cpython/main/Python/optimizer.c:1245:30
    #8 0x55dece02b225 in make_executor_from_uops /home/boss/projects/oss/cpython/main/Python/optimizer.c:1332:35
    #9 0x55dece02b225 in uop_optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:1510:35
    #10 0x55dece02b225 in _PyOptimizer_Optimize /home/boss/projects/oss/cpython/main/Python/optimizer.c:164:15
    #11 0x55decdb42423 in stop_tracing_and_jit /home/boss/projects/oss/cpython/main/Python/ceval.c:1405:15
    #12 0x55decdafe41d in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:11637:27
    #13 0x55decd7aaf6a in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #14 0x55decd7aaf6a in gen_send_ex2 /home/boss/projects/oss/cpython/main/Objects/genobject.c:259:24
    #15 0x55decd7a5341 in gen_iternext /home/boss/projects/oss/cpython/main/Objects/genobject.c:636:9
    #16 0x55decd7eb288 in list_extend_iter_lock_held /home/boss/projects/oss/cpython/main/Objects/listobject.c:1263:26
    #17 0x55decd7e27d0 in _list_extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1452:15
    #18 0x55decd7e2338 in list_extend_impl /home/boss/projects/oss/cpython/main/Objects/listobject.c:1471:9
    #19 0x55decd7e2338 in list_extend /home/boss/projects/oss/cpython/main/Objects/clinic/listobject.c.h:145:20
    #20 0x55decd7e2338 in _PyList_Extend /home/boss/projects/oss/cpython/main/Objects/listobject.c:1480:12
    #21 0x55decd6f3697 in PySequence_List /home/boss/projects/oss/cpython/main/Objects/abstract.c:2086:10
    #22 0x55decd6f3abb in PySequence_Fast /home/boss/projects/oss/cpython/main/Objects/abstract.c:2117:9
    #23 0x55decd99e695 in PyUnicode_Join /home/boss/projects/oss/cpython/main/Objects/unicodeobject.c:9961:12
    #24 0x55decdb176b3 in _PyEval_EvalFrameDefault /home/boss/projects/oss/cpython/main/Python/generated_cases.c.h:3775:35
    #25 0x55decdadb357 in _PyEval_EvalFrame /home/boss/projects/oss/cpython/main/./Include/internal/pycore_ceval.h:119:16
    #26 0x55decdadb357 in _PyEval_Vector /home/boss/projects/oss/cpython/main/Python/ceval.c:2482:12
    #27 0x55decdadad51 in PyEval_EvalCode /home/boss/projects/oss/cpython/main/Python/ceval.c:1008:21
    #28 0x55dece0c177e in run_eval_code_obj /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1366:12
    #29 0x55dece0c092b in run_mod /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1469:19
    #30 0x55dece0bae3c in pyrun_file /home/boss/projects/oss/cpython/main/Python/pythonrun.c:1294:15
    #31 0x55dece0b89cc in _PyRun_SimpleFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:518:13
    #32 0x55dece0b7d0d in _PyRun_AnyFileObject /home/boss/projects/oss/cpython/main/Python/pythonrun.c:81:15
    #33 0x55dece1354da in pymain_run_file_obj /home/boss/projects/oss/cpython/main/Modules/main.c:410:15
    #34 0x55dece1354da in pymain_run_file /home/boss/projects/oss/cpython/main/Modules/main.c:429:15
    #35 0x55dece133513 in pymain_run_python /home/boss/projects/oss/cpython/main/Modules/main.c:691:21
    #36 0x55dece133513 in Py_RunMain /home/boss/projects/oss/cpython/main/Modules/main.c:772:5
    #37 0x55dece2db04b in main /home/boss/projects/oss/cpython/main/Programs/_bootstrap_python.c:100:12
    #38 0x7fa0aea27634  (/usr/lib/libc.so.6+0x27634) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #39 0x7fa0aea276e8 in __libc_start_main (/usr/lib/libc.so.6+0x276e8) (BuildId: 2f722da304c0a508c891285e6840199c35019c8d)
    #40 0x55decd42c314 in _start (/home/boss/projects/oss/cpython/main/_bootstrap_python+0x2bd314) (BuildId: f8ef7f71d6fe2e2a9a442651707bb50443c7e436)

SUMMARY: AddressSanitizer: 928 byte(s) leaked in 1 allocation(s).
make: *** [Makefile:1980: Python/frozen_modules/os.h] Error 1
make: *** [Makefile:1965: Python/frozen_modules/_collections_abc.h] Error 1

Fidget-Spinner

@ashm-dev does the project build if you apply this patch here to main?

ashm-dev

@Fidget-Spinner No, it doesn't build even with my patch applied. It looks like the JIT is broken again.

if test $? -ne 0 ; then \
	echo "generate-posix-vars failed" ; \
	rm -f ./pybuilddir.txt ; \
	exit 1 ; \
fi
Written build/lib.linux-x86_64-3.15/_sysconfigdata_d_linux_x86_64-linux-gnu.py
Written build/lib.linux-x86_64-3.15/_sysconfig_vars_d_linux_x86_64-linux-gnu.json
Python/optimizer.c:1775: _PyObject_GC_UNTRACK: Assertion "_PyObject_GC_IS_TRACKED(((PyObject*)(op)))" failed: object not tracked by the garbage collector
Enable tracemalloc to get the memory block allocation traceback

object address  : 0x7cf76ce44aa0
object refcount : 0
object type     : 0x564921df1c20
object type name: uop_executor
object repr     : <refcnt 0 at 0x7cf76ce44aa0>

Fatal Python error: _PyObject_AssertFailed: _PyObject_AssertFailed
Python runtime state: finalizing (tstate=0x000056492203b0f0)

Current thread 0x00007f476dd91180 [python] (most recent call first):
make: *** [Makefile:1164: pybuilddir.txt] Error 134

Fidget-Spinner

It's not broken (apart from the refcount leak I think), the current patch seems to be breaking it.

ashm-dev

But it doesn't build on main either, even without my patch. I posted the logs above.

sergey-miryanov

Looks good to me. Thanks!

Fidget-Spinner

But it doesn't build on main either, even without my patch. I posted the logs above.

@ashm-dev I think you're misunderstanding me. I'm asking if it builds with this patch currently on this branch?

ashm-dev

@Fidget-Spinner Yes, it builds!

colesbury

I'm seeing GHA segfaults in x86_64-pc-windows-msvc/msvc (Debug) on this commit and the subsequent one, but not on earlier commits:

test_extractall_none_gid (test.test_tarfile.NoneInfoExtractTests_FullyTrusted.test_extractall_none_gid) ... Windows fatal exception: access violation

Current thread 0x000004d4 (most recent call first):
  File "D:\a\cpython\cpython\Lib\pathlib\__init__.py", line 833 in __new__
  File "D:\a\cpython\cpython\Lib\pathlib\__init__.py", line 164 in with_segments
  File "D:\a\cpython\cpython\Lib\pathlib\__init__.py", line 279 in _from_parsed_string
  File "D:\a\cpython\cpython\Lib\pathlib\__init__.py", line 272 in _from_parsed_parts
  File "D:\a\cpython\cpython\Lib\pathlib\__init__.py", line 73 in __getitem__
  File "D:\a\cpython\cpython\Lib\_collections_abc.py", line 1015 in __iter__
  File "D:\a\cpython\cpython\Lib\_collections_abc.py", line 1022 in __contains__
  File "D:\a\cpython\cpython\Lib\pathlib\__init__.py", line 490 in relative_to
  File "D:\a\cpython\cpython\Lib\test\test_tarfile.py", line 3363 in <genexpr>
  File "D:\a\cpython\cpython\Lib\test\test_tarfile.py", line 3362 in check_files_present
  File "D:\a\cpython\cpython\Lib\test\test_tarfile.py", line 3380 in extract_with_none
  File "D:\a\cpython\cpython\Lib\contextlib.py", line 141 in __enter__
  File "D:\a\cpython\cpython\Lib\test\test_tarfile.py", line 3420 in test_extractall_none_gid
  File "D:\a\cpython\cpython\Lib\unittest\case.py", line 613 in _callTestMethod
  File "D:\a\cpython\cpython\Lib\unittest\case.py", line 667 in run
  File "D:\a\cpython\cpython\Lib\unittest\case.py", line 723 in __call__
  File "D:\a\cpython\cpython\Lib\unittest\suite.py", line 122 in run
  File "D:\a\cpython\cpython\Lib\unittest\suite.py", line 84 in __call__
  File "D:\a\cpython\cpython\Lib\unittest\suite.py", line 122 in run
  File "D:\a\cpython\cpython\Lib\unittest\suite.py", line 84 in __call__
  File "D:\a\cpython\cpython\Lib\unittest\runner.py", line 257 in run
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 84 in _run_suite
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 42 in run_unittest
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 162 in test_func
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 118 in regrtest_runner
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 165 in _load_run_test
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 210 in _runtest_env_changed_exc
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 319 in _runtest
  File "D:\a\cpython\cpython\Lib\test\libregrtest\single.py", line 348 in run_single_test
  File "D:\a\cpython\cpython\Lib\test\libregrtest\worker.py", line 99 in worker_process
  File "D:\a\cpython\cpython\Lib\test\libregrtest\worker.py", line 134 in main
  File "D:\a\cpython\cpython\Lib\test\libregrtest\worker.py", line 138 in <module>
  File "D:\a\cpython\cpython\Lib\runpy.py", line 87 in _run_code
  File "D:\a\cpython\cpython\Lib\runpy.py", line 196 in _run_module_as_main

Current thread's C stack trace (most recent call first):
  <cannot get C stack on this system>

…H-142492)

Store chain_depth earlier and DECREF executor

ad78398

ashm-dev requested a review from markshannon as a code owner December 9, 2025 20:27

bedevere-app Bot added the awaiting review label Dec 9, 2025

bedevere-app Bot mentioned this pull request Dec 9, 2025

ASan memory leak in test_gc with --enable-experimental-jit (allocate_executor) #142476

Closed

ashm-dev changed the title ~~gh-142476: Store chain_depth earlier and DECREF executor~~ Dec 9, 2025

Fidget-Spinner reviewed Dec 9, 2025

View reviewed changes

Add comment regarding reference ownership

ae51767

Merge branch 'main' into jit/gc

2f9ab2c

ashm-dev requested a review from Fidget-Spinner December 10, 2025 04:08

Merge branch 'main' into jit/gc

dc5e8d3

Fidget-Spinner reviewed Dec 10, 2025

View reviewed changes

ashm-dev added 7 commits December 11, 2025 11:01

Merge remote-tracking branch 'upstream/main' into jit/gc

cf6deac

Log executor refcount and GC links

bb950c2

Update optimizer.c

29b4663

Merge branch 'main' into jit/gc

4068cf8

Merge branch 'main' into jit/gc

80af6fc

Merge branch 'main' into jit/gc

a22b512

Merge remote-tracking branch 'upstream/main' into jit/gc

94312c3

sergey-miryanov reviewed Dec 12, 2025

View reviewed changes

fix

a166b47

ashm-dev requested review from Fidget-Spinner and sergey-miryanov December 12, 2025 22:05

ashm-dev added 2 commits December 13, 2025 19:53

add comment

26c577d

Merge remote-tracking branch 'upstream/main' into jit/gc

a483193

sergey-miryanov reviewed Dec 13, 2025

View reviewed changes

picnixz changed the title ~~gh-142476: Fix memory leak in the experimental JIT compiler when creating executors.~~ Dec 14, 2025

Merge branch 'main' into jit/gc

1a3b2e9

Fidget-Spinner reviewed Dec 19, 2025

View reviewed changes

fix

d8451d0

ashm-dev requested review from Fidget-Spinner and sergey-miryanov December 19, 2025 09:48

sergey-miryanov approved these changes Dec 19, 2025

View reviewed changes

bedevere-app Bot added awaiting core review and removed awaiting review labels Dec 19, 2025

Fidget-Spinner reviewed Dec 19, 2025

View reviewed changes

follow PEP 7

0b6ed2d

bedevere-app Bot removed the awaiting core review label Dec 19, 2025

ashm-dev deleted the jit/gc branch December 20, 2025 14:16

cocolato pushed a commit to cocolato/cpython that referenced this pull request Dec 22, 2025

pythongh-142476: fix memory leak when creating JIT executors (pythonG… …

6389e8d

…H-142492)

Conversation

ashm-dev commented Dec 9, 2025 • edited by bedevere-app Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ashm-dev commented Dec 9, 2025

Uh oh!

Fidget-Spinner left a comment

Choose a reason for hiding this comment

Uh oh!

Fidget-Spinner commented Dec 9, 2025

Uh oh!

ashm-dev commented Dec 10, 2025

Uh oh!

Fidget-Spinner commented Dec 10, 2025

Uh oh!

sergey-miryanov commented Dec 12, 2025

Uh oh!

Fidget-Spinner commented Dec 12, 2025

Uh oh!

sergey-miryanov commented Dec 12, 2025

Uh oh!

ashm-dev commented Dec 12, 2025

Uh oh!

ashm-dev commented Dec 12, 2025

Uh oh!

Fidget-Spinner commented Dec 13, 2025

Uh oh!

ashm-dev commented Dec 13, 2025

Uh oh!

sergey-miryanov commented Dec 19, 2025

Uh oh!

ashm-dev commented Dec 19, 2025

Uh oh!

Fidget-Spinner commented Dec 19, 2025

Uh oh!

ashm-dev commented Dec 19, 2025

Uh oh!

Fidget-Spinner left a comment

Choose a reason for hiding this comment

Uh oh!

ashm-dev commented Dec 19, 2025

Uh oh!

sergey-miryanov left a comment

Choose a reason for hiding this comment

Uh oh!

Fidget-Spinner commented Dec 19, 2025

Uh oh!

ashm-dev commented Dec 19, 2025

Uh oh!

Uh oh!

colesbury commented Dec 19, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

ashm-dev commented Dec 9, 2025 •

edited by bedevere-app Bot

Loading