Repository navigation
regrtest: Don't list tests expected to be skipped #161430
Description
At the end of running the Python test suite, the report has a long list of skipped tests. It makes the output hard to read, especially on buildbot where only the last 40 lines are displayed by default.
I propose to omit listing tests which are expected to be skipped.
Example on Windows:
76 tests skipped:
test.test_asyncio.test_windows_events
test.test_asyncio.test_windows_utils
test.test_free_threading.test_async_generators
test.test_free_threading.test_bisect
test.test_free_threading.test_bytes_object
test.test_free_threading.test_bz2
test.test_free_threading.test_capi
test.test_free_threading.test_code
test.test_free_threading.test_collections
test.test_free_threading.test_context
test.test_free_threading.test_cprofile
test.test_free_threading.test_csv
test.test_free_threading.test_datetime
test.test_free_threading.test_dbm_gnu
test.test_free_threading.test_dict
test.test_free_threading.test_dict_watcher
test.test_free_threading.test_enumerate
test.test_free_threading.test_exceptions
test.test_free_threading.test_frame
test.test_free_threading.test_func_annotations
test.test_free_threading.test_functions
test.test_free_threading.test_functools
test.test_free_threading.test_gc
test.test_free_threading.test_gc_get_stats_race
test.test_free_threading.test_generators
test.test_free_threading.test_grp
test.test_free_threading.test_heapq
test.test_free_threading.test_interpreters
test.test_free_threading.test_io
test.test_free_threading.test_iteration
test.test_free_threading.test_itertools
test.test_free_threading.test_itertools_combinatoric
test.test_free_threading.test_json
test.test_free_threading.test_list
test.test_free_threading.test_lzma
test.test_free_threading.test_memoryview
test.test_free_threading.test_methodcaller
test.test_free_threading.test_mmap
test.test_free_threading.test_monitoring
test.test_free_threading.test_os
test.test_free_threading.test_pickle
test.test_free_threading.test_pwd
test.test_free_threading.test_races
test.test_free_threading.test_re
test.test_free_threading.test_readline
test.test_free_threading.test_resource
test.test_free_threading.test_reversed
test.test_free_threading.test_set
test.test_free_threading.test_slots
test.test_free_threading.test_sqlite3
test.test_free_threading.test_str
test.test_free_threading.test_string_template_race
test.test_free_threading.test_suggestions
test.test_free_threading.test_sys
test.test_free_threading.test_syslog
test.test_free_threading.test_threading
test.test_free_threading.test_tokenize
test.test_free_threading.test_type
test.test_free_threading.test_types
test.test_free_threading.test_uuid
test.test_free_threading.test_weakref
test.test_free_threading.test_zip
test.test_free_threading.test_zlib test.test_os.test_windows
test_android test_apple test_devpoll test_dtrace test_kqueue
test_msvcrt test_startfile test_winapi test_winconsoleio
test_winreg test_winsound test_wmi
Example on Linux:
76 tests skipped:
test.test_asyncio.test_windows_events
test.test_asyncio.test_windows_utils
test.test_free_threading.test_async_generators
test.test_free_threading.test_bisect
test.test_free_threading.test_bytes_object
test.test_free_threading.test_bz2
test.test_free_threading.test_capi
test.test_free_threading.test_code
test.test_free_threading.test_collections
test.test_free_threading.test_context
test.test_free_threading.test_cprofile
test.test_free_threading.test_csv
test.test_free_threading.test_datetime
test.test_free_threading.test_dbm_gnu
test.test_free_threading.test_dict
test.test_free_threading.test_dict_watcher
test.test_free_threading.test_enumerate
test.test_free_threading.test_exceptions
test.test_free_threading.test_frame
test.test_free_threading.test_func_annotations
test.test_free_threading.test_functions
test.test_free_threading.test_functools
test.test_free_threading.test_gc
test.test_free_threading.test_gc_get_stats_race
test.test_free_threading.test_generators
test.test_free_threading.test_grp
test.test_free_threading.test_heapq
test.test_free_threading.test_interpreters
test.test_free_threading.test_io
test.test_free_threading.test_iteration
test.test_free_threading.test_itertools
test.test_free_threading.test_itertools_combinatoric
test.test_free_threading.test_json
test.test_free_threading.test_list
test.test_free_threading.test_lzma
test.test_free_threading.test_memoryview
test.test_free_threading.test_methodcaller
test.test_free_threading.test_mmap
test.test_free_threading.test_monitoring
test.test_free_threading.test_os
test.test_free_threading.test_pickle
test.test_free_threading.test_pwd
test.test_free_threading.test_races
test.test_free_threading.test_re
test.test_free_threading.test_readline
test.test_free_threading.test_resource
test.test_free_threading.test_reversed
test.test_free_threading.test_set
test.test_free_threading.test_slots
test.test_free_threading.test_sqlite3
test.test_free_threading.test_str
test.test_free_threading.test_string_template_race
test.test_free_threading.test_suggestions
test.test_free_threading.test_sys
test.test_free_threading.test_syslog
test.test_free_threading.test_threading
test.test_free_threading.test_tokenize
test.test_free_threading.test_type
test.test_free_threading.test_types
test.test_free_threading.test_uuid
test.test_free_threading.test_weakref
test.test_free_threading.test_zip
test.test_free_threading.test_zlib test.test_os.test_windows
test_android test_apple test_devpoll test_dtrace test_kqueue
test_msvcrt test_startfile test_winapi test_winconsoleio
test_winreg test_winsound test_wmi
It's way worse (way longer list) on Emscripten an WASI.
Activity
cmaloney commentedon Nov 5, 2026
My main worry here is on bots where there is little skipped we don't have a way of detecting "on this platform more was skipped than we expected". I think the output is needed so I can hand-solve for that but could definitely be located elsewhere or hidden by default.
For github actions we can use: https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-commands#grouping-log-lines. I haven't found an equivalent feature in buildbot yet though :/.