bpo-40173: Fix test.support.import_helper.import_fresh_module#28654

serhiy-storchaka

Work correctly if an additional fresh module imports other
additional fresh module which imports a blocked module.
Raises ImportError if the specified module cannot be imported
while all additional fresh modules are successfully imported.
Support blocking packages.
Always restore the import state of fresh and blocked modules
and their submodules.

https://bugs.python.org/issue40173

* Work correctly if an additional fresh module imports other additional fresh module which imports a blocked module. * Raises ImportError if the specified module cannot be imported while all additional fresh modules are successfully imported. * Support blocking packages. * Always restore the import state of fresh and blocked modules and their submodules.

serhiy-storchaka

No tests yet, but it fixes currently failing buildbots.

bedevere-bot

🤖 New build scheduled with the buildbot fleet by @serhiy-storchaka for commit e5b149e 🤖

If you want to schedule another build, you need to add the ":hammer: test-with-buildbots" label again.

serhiy-storchaka

Failures of the multiprocessing tests on some buildbots look unrelated. There were same failures on them few days ago.

miss-islington

Thanks @serhiy-storchaka for the PR 🌮🎉.. I'm working now to backport this PR to: 3.9, 3.10.
🐍🍒⛏🤖

miss-islington

Sorry, @serhiy-storchaka, I could not cleanly backport this to 3.10 due to a conflict.
Please backport using cherry_picker on command line.
cherry_picker ec4d917a6a68824f1895f75d113add9410283da7 3.10

miss-islington

Sorry @serhiy-storchaka, I had trouble checking out the 3.9 backport branch.
Please backport using cherry_picker on command line.
cherry_picker ec4d917a6a68824f1895f75d113add9410283da7 3.9

pythonGH-28654) * Work correctly if an additional fresh module imports other additional fresh module which imports a blocked module. * Raises ImportError if the specified module cannot be imported while all additional fresh modules are successfully imported. * Support blocking packages. * Always restore the import state of fresh and blocked modules and their submodules. * Fix test_decimal and test_xml_etree which depended on an undesired side effect of import_fresh_module().. (cherry picked from commit ec4d917) Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

bedevere-bot

GH-28657 is a backport of this pull request to the 3.10 branch.

…pythonGH-28654) * Work correctly if an additional fresh module imports other additional fresh module which imports a blocked module. * Raises ImportError if the specified module cannot be imported while all additional fresh modules are successfully imported. * Support blocking packages. * Always restore the import state of fresh and blocked modules and their submodules. * Fix test_decimal and test_xml_etree which depended on an undesired side effect of import_fresh_module().. (cherry picked from commit ec4d917) Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

bedevere-bot

GH-28658 is a backport of this pull request to the 3.9 branch.

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x Fedora Clang 3.x has failed when building commit ec4d917.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/3/builds/798) and take a look at the build logs.
Check if the failure is related to this commit (ec4d917) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/3/builds/798

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

410 tests OK.

10 slowest tests:

test_peg_generator: 2 min 51 sec
test_concurrent_futures: 2 min 33 sec
test_multiprocessing_spawn: 1 min 35 sec
test_multiprocessing_forkserver: 1 min 10 sec
test_nntplib: 1 min 6 sec
test_multiprocessing_fork: 1 min 4 sec
test_signal: 48.2 sec
test_asyncio: 45.6 sec
test_socket: 37.9 sec
test_pydoc: 31.4 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

14 tests skipped:
test_devpoll test_ioctl test_kqueue test_msilib test_nis
test_readline test_startfile test_tix test_tk test_ttk_guionly
test_winconsoleio test_winreg test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 5 min 42 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.x.edelsohn-fedora-z.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
    ^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: '/psm_683246f2'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.x.edelsohn-fedora-z.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
    ^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: '/psm_acf45a63'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.x.edelsohn-fedora-z.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
    ^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: '/psm_a4dd64ae'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.x.edelsohn-fedora-z.clang/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/dje/cpython-buildarea/3.x.edelsohn-fedora-z.clang/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
               ^^^^^^^^^^^^^^^^^^^^^
FileExistsError: [Errno 17] File exists: '/test01_tsmb'

GH-28654) (GH-28657) * Work correctly if an additional fresh module imports other additional fresh module which imports a blocked module. * Raises ImportError if the specified module cannot be imported while all additional fresh modules are successfully imported. * Support blocking packages. * Always restore the import state of fresh and blocked modules and their submodules. * Fix test_decimal and test_xml_etree which depended on an undesired side effect of import_fresh_module(). (cherry picked from commit ec4d917)

…GH-28654) (GH-28658) * Work correctly if an additional fresh module imports other additional fresh module which imports a blocked module. * Raises ImportError if the specified module cannot be imported while all additional fresh modules are successfully imported. * Support blocking packages. * Always restore the import state of fresh and blocked modules and their submodules. * Fix test_decimal and test_xml_etree which depended on an undesired side effect of import_fresh_module(). (cherry picked from commit ec4d917)

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot AMD64 Fedora Stable 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/659/builds/362) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/659/builds/362

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

412 tests OK.

10 slowest tests:

test_gdb: 2 min 56 sec
test_concurrent_futures: 2 min 48 sec
test_multiprocessing_spawn: 2 min 6 sec
test_capi: 2 min
test_peg_generator: 1 min 54 sec
test_multiprocessing_forkserver: 1 min 24 sec
test_asyncio: 1 min 22 sec
test_nntplib: 1 min 21 sec
test_multiprocessing_fork: 1 min 13 sec
test_unparse: 1 min 12 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

12 tests skipped:
test_devpoll test_ioctl test_kqueue test_msilib test_startfile
test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg
test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 5 min 25 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_613f2379'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_6f7deadc'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_5501cb22'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x Fedora 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/655/builds/378) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/655/builds/378

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

410 tests OK.

10 slowest tests:

test_concurrent_futures: 2 min 58 sec
test_multiprocessing_spawn: 1 min 52 sec
test_peg_generator: 1 min 31 sec
test_multiprocessing_forkserver: 1 min 19 sec
test_multiprocessing_fork: 1 min 14 sec
test_unparse: 1 min 13 sec
test_nntplib: 1 min 6 sec
test_gdb: 58.1 sec
test_tokenize: 57.2 sec
test_capi: 56.5 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

14 tests skipped:
test_devpoll test_ioctl test_kqueue test_msilib test_nis
test_readline test_startfile test_tix test_tk test_ttk_guionly
test_winconsoleio test_winreg test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 5 min 46 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_2a361171'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_0f1ca437'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_394aab1f'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot AMD64 Fedora Stable Clang 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/627/builds/364) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/627/builds/364

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

412 tests OK.

10 slowest tests:

test_peg_generator: 2 min 38 sec
test_concurrent_futures: 2 min 32 sec
test_multiprocessing_spawn: 1 min 29 sec
test_nntplib: 1 min 20 sec
test_multiprocessing_forkserver: 1 min 12 sec
test_multiprocessing_fork: 1 min 3 sec
test_asyncio: 53.8 sec
test_signal: 46.8 sec
test_io: 41.2 sec
test_socket: 37.7 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

12 tests skipped:
test_devpoll test_ioctl test_kqueue test_msilib test_startfile
test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg
test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 3 min 58 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_7a86bee6'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_8ec16e90'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_d24ab32e'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x Fedora Clang 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/676/builds/378) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/676/builds/378

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

410 tests OK.

10 slowest tests:

test_peg_generator: 2 min 38 sec
test_concurrent_futures: 2 min 30 sec
test_multiprocessing_spawn: 1 min 31 sec
test_multiprocessing_forkserver: 1 min 18 sec
test_nntplib: 1 min 5 sec
test_multiprocessing_fork: 1 min 2 sec
test_signal: 47.0 sec
test_asyncio: 46.4 sec
test_socket: 38.1 sec
test_io: 35.2 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

14 tests skipped:
test_devpoll test_ioctl test_kqueue test_msilib test_nis
test_readline test_startfile test_tix test_tk test_ttk_guionly
test_winconsoleio test_winreg test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 5 min 38 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_ce3ff8e4'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_db49f21c'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_f273a2cd'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot AMD64 Fedora Stable Clang Installed 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/650/builds/363) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/650/builds/363

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

408 tests OK.

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

16 tests skipped:
test_asdl_parser test_check_c_globals test_clinic test_devpoll
test_gdb test_ioctl test_kqueue test_msilib test_startfile
test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg
test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 3 min 31 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang-installed/build/target/lib/python3.10/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_e08d6072'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang-installed/build/target/lib/python3.10/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_433e1553'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang-installed/build/target/lib/python3.10/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_128806f9'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang-installed/build/target/lib/python3.10/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.clang-installed/build/target/lib/python3.10/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x Fedora Clang Installed 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/690/builds/375) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/690/builds/375

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

406 tests OK.

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

18 tests skipped:
test_asdl_parser test_check_c_globals test_clinic test_devpoll
test_gdb test_ioctl test_kqueue test_msilib test_nis test_readline
test_startfile test_tix test_tk test_ttk_guionly test_winconsoleio
test_winreg test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 4 min 16 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang-installed/build/target/lib/python3.10/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_0186e582'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang-installed/build/target/lib/python3.10/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_6afaa84c'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang-installed/build/target/lib/python3.10/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_e03234b5'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang-installed/build/target/lib/python3.10/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.clang-installed/build/target/lib/python3.10/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot AMD64 Fedora Stable LTO + PGO 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/651/builds/366) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/651/builds/366

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

411 tests OK.

10 slowest tests:

test_concurrent_futures: 2 min 31 sec
test_multiprocessing_spawn: 1 min 26 sec
test_nntplib: 1 min 20 sec
test_multiprocessing_forkserver: 1 min 9 sec
test_multiprocessing_fork: 1 min 2 sec
test_asyncio: 52.3 sec
test_signal: 47.0 sec
test_io: 37.9 sec
test_socket: 37.8 sec
test_pydoc: 31.6 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

13 tests skipped:
test_devpoll test_gdb test_ioctl test_kqueue test_msilib
test_startfile test_tix test_tk test_ttk_guionly test_winconsoleio
test_winreg test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 3 min 6 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_47b38763'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_9356849e'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_10d6c239'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x Fedora LTO + PGO 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/656/builds/374) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/656/builds/374

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

409 tests OK.

10 slowest tests:

test_concurrent_futures: 2 min 31 sec
test_multiprocessing_spawn: 1 min 26 sec
test_multiprocessing_forkserver: 1 min 8 sec
test_multiprocessing_fork: 1 min 2 sec
test_signal: 47.1 sec
test_asyncio: 44.4 sec
test_socket: 37.9 sec
test_io: 32.9 sec
test_pydoc: 31.0 sec
test_xmlrpc: 27.5 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

15 tests skipped:
test_devpoll test_gdb test_ioctl test_kqueue test_msilib test_nis
test_readline test_startfile test_tix test_tk test_ttk_guionly
test_winconsoleio test_winreg test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 3 min 25 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_cdf948ce'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto-pgo/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto-pgo/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_7dfe4a55'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_8befa944'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot AMD64 Fedora Stable LTO 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/624/builds/338) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/624/builds/338

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

412 tests OK.

10 slowest tests:

test_peg_generator: 3 min 21 sec
test_concurrent_futures: 2 min 36 sec
test_gdb: 1 min 41 sec
test_multiprocessing_spawn: 1 min 28 sec
test_nntplib: 1 min 20 sec
test_multiprocessing_forkserver: 1 min 12 sec
test_multiprocessing_fork: 1 min 4 sec
test_asyncio: 54.1 sec
test_signal: 47.1 sec
test_socket: 38.0 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

12 tests skipped:
test_devpoll test_ioctl test_kqueue test_msilib test_startfile
test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg
test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 5 min 10 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_9e2b9cff'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_a9f7324a'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_bb87d445'


Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'

bedevere-bot

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x Fedora LTO 3.10 has failed when building commit 7873884.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/all/#builders/637/builds/345) and take a look at the build logs.
Check if the failure is related to this commit (7873884) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/all/#builders/637/builds/345

Failed tests:

test_multiprocessing_fork
test_multiprocessing_forkserver
test_multiprocessing_spawn

Failed subtests:

test_shared_memory_basics - test.test_multiprocessing_spawn.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_fork.WithProcessesTestSharedMemory
test_shared_memory_basics - test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory

Summary of the results of the build (if available):

== Tests result: FAILURE then FAILURE ==

410 tests OK.

10 slowest tests:

test_peg_generator: 3 min 32 sec
test_concurrent_futures: 2 min 35 sec
test_gdb: 1 min 47 sec
test_multiprocessing_spawn: 1 min 28 sec
test_multiprocessing_forkserver: 1 min 11 sec
test_multiprocessing_fork: 1 min 8 sec
test_signal: 47.1 sec
test_asyncio: 46.5 sec
test_socket: 37.9 sec
test_io: 34.6 sec

3 tests failed:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

14 tests skipped:
test_devpoll test_ioctl test_kqueue test_msilib test_nis
test_readline test_startfile test_tix test_tk test_ttk_guionly
test_winconsoleio test_winreg test_winsound test_zipfile64

3 re-run tests:
test_multiprocessing_fork test_multiprocessing_forkserver
test_multiprocessing_spawn

Total duration: 4 min 56 sec

Click to see traceback logs

Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_28bbce81'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_19ea9bb9'


Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.10.edelsohn-fedora-z.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_fd8ef217'

pganssle

This seems like kind of a significant change to go through with no review, TBH. You even change a test in the decimal module!

serhiy-storchaka

I was in a hurry to fix refleak buildbots.

There were bugs in test_decimal and test_xml_etree. They depended on a side effect of import_fresh_module() which should not be.

serhiy-storchaka added tests Tests in the Lib/test dir needs backport to 3.9 needs backport to 3.10 only security fixes labels Sep 30, 2021

serhiy-storchaka requested a review from shihai1991 September 30, 2021 14:00

serhiy-storchaka requested review from brettcannon, encukou, ericsnowcurrently, ncoghlan and warsaw as code owners September 30, 2021 14:00

the-knights-who-say-ni added the CLA signed label Sep 30, 2021

bedevere-bot added the awaiting core review label Sep 30, 2021

serhiy-storchaka force-pushed the import_fresh_module branch from 1d5a3a9 to 9bd77bc Compare September 30, 2021 14:04

serhiy-storchaka mentioned this pull request Sep 30, 2021

bpo-40173: Remove redundant import module of import_fresh_module() #19390

Closed

Fix test_decimal and test_xml_etree.

e5b149e

serhiy-storchaka requested a review from rhettinger as a code owner September 30, 2021 14:50

serhiy-storchaka added the 🔨 test-with-buildbots Test PR w/ buildbots; report in status section label Sep 30, 2021

bedevere-bot removed the 🔨 test-with-buildbots Test PR w/ buildbots; report in status section label Sep 30, 2021

serhiy-storchaka merged commit ec4d917 into python:main Sep 30, 2021

bedevere-bot removed the awaiting core review label Sep 30, 2021

serhiy-storchaka deleted the import_fresh_module branch September 30, 2021 16:20

miss-islington assigned serhiy-storchaka Sep 30, 2021

serhiy-storchaka mentioned this pull request Sep 30, 2021

[3.10] bpo-40173: Fix test.support.import_helper.import_fresh_module(… #28657

Merged

bedevere-bot removed the only security fixes label Sep 30, 2021

serhiy-storchaka mentioned this pull request Sep 30, 2021

[3.9] bpo-40173: Fix test.support.import_helper.import_fresh_module()… #28658

Merged

bedevere-bot removed the needs backport to 3.9 label Sep 30, 2021

serhiy-storchaka removed their assignment Jun 21, 2022

Conversation

serhiy-storchaka commented Sep 30, 2021 • edited by bedevere-bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

serhiy-storchaka commented Sep 30, 2021

Uh oh!

bedevere-bot commented Sep 30, 2021

Uh oh!

serhiy-storchaka commented Sep 30, 2021

Uh oh!

miss-islington commented Sep 30, 2021

Uh oh!

miss-islington commented Sep 30, 2021

Uh oh!

miss-islington commented Sep 30, 2021

Uh oh!

bedevere-bot commented Sep 30, 2021

Uh oh!

bedevere-bot commented Sep 30, 2021

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

bedevere-bot commented Sep 30, 2021

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

pganssle commented Sep 30, 2021

Uh oh!

serhiy-storchaka commented Sep 30, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

serhiy-storchaka commented Sep 30, 2021 •

edited by bedevere-bot

Loading