Changelog¶
Python 3.10.19 final¶
Release date: 2025-10-09
Security¶
gh-139700: Check consistency of the zip64 end of central directory record. Support records with “zip64 extensible data” if there are no bytes prepended to the ZIP file.
gh-139400:
xml.parsers.expat: Make sure that parent Expat parsers are only garbage-collected once they are no longer referenced by subparsers created byExternalEntityParserCreate(). Patch by Sebastian Pipping.gh-135661: Fix parsing start and end tags in
html.parser.HTMLParseraccording to the HTML5 standard.Whitespaces no longer accepted between
</and the tag name. E.g.</ script>does not end the script section.Vertical tabulation (
\v) and non-ASCII whitespaces no longer recognized as whitespaces. The only whitespaces are\t\n\r\fand space.Null character (U+0000) no longer ends the tag name.
Attributes and slashes after the tag name in end tags are now ignored, instead of terminating after the first
>in quoted attribute value. E.g.</script/foo=">"/>.Multiple slashes and whitespaces between the last attribute and closing
>are now ignored in both start and end tags. E.g.<a foo=bar/ //>.Multiple
=between attribute name and value are no longer collapsed. E.g.<a foo==bar>produces attribute “foo” with value “=bar”.
gh-135661: Fix CDATA section parsing in
html.parser.HTMLParseraccording to the HTML5 standard:] ]>and]] >no longer end the CDATA section. Add private method_set_support_cdata()which can be used to specify how to parse<[CDATA[— as a CDATA section in foreign content (SVG or MathML) or as a bogus comment in the HTML namespace.gh-102555: Fix comment parsing in
html.parser.HTMLParseraccording to the HTML5 standard.--!>now ends the comment.-- >no longer ends the comment. Support abnormally ended empty comments<-->and<--->.gh-135462: Fix quadratic complexity in processing specially crafted input in
html.parser.HTMLParser. End-of-file errors are now handled according to the HTML5 specs – comments and declarations are automatically closed, tags are ignored.gh-118350: Fix support of escapable raw text mode (elements “textarea” and “title”) in
html.parser.HTMLParser.gh-86155:
html.parser.HTMLParser.close()no longer loses data when the<script>tag is not closed. Patch by Waylan Limberg.
Library¶
Python 3.10.18 final¶
Release date: 2025-06-03
Security¶
gh-135034: Fixes multiple issues that allowed
tarfileextraction filters (filter="data"andfilter="tar") to be bypassed using crafted symlinks and hard links.Addresses CVE 2024-12718, CVE 2025-4138, CVE 2025-4330, and CVE 2025-4517.
gh-133767: Fix use-after-free in the “unicode-escape” decoder with a non-“strict” error handler.
gh-128840: Short-circuit the processing of long IPv6 addresses early in
ipaddressto prevent excessive memory consumption and a minor denial-of-service.
Library¶
gh-128840: Fix parsing long IPv6 addresses with embedded IPv4 address.
gh-134062:
ipaddress: fix collisions in__hash__()forIPv4NetworkandIPv6Networkobjects.gh-123409: Fix
ipaddress.IPv6Address.reverse_pointeroutput according to RFC 3596, §2.5. Patch by Bénédikt Tran.bpo-43633: Improve the textual representation of IPv4-mapped IPv6 addresses (RFC 4291 Sections 2.2, 2.5.5.2) in
ipaddress. Patch by Oleksandr Pavliuk.
Python 3.10.17 final¶
Release date: 2025-04-08
Security¶
gh-131809: Update bundled libexpat to 2.7.1
gh-131261: Upgrade to libexpat 2.7.0
gh-105704: When using
urllib.parse.urlsplit()andurllib.parse.urlparse()host parsing would not reject domain names containing square brackets ([and]). Square brackets are only valid for IPv6 and IPvFuture hosts according to RFC 3986 Section 3.2.2.gh-121284: Fix bug in the folding of rfc2047 encoded-words when flattening an email message using a modern email policy. Previously when an encoded-word was too long for a line, it would be decoded, split across lines, and re-encoded. But commas and other special characters in the original text could be left unencoded and unquoted. This could theoretically be used to spoof header lines using a carefully constructed encoded-word if the resulting rendered email was transmitted or re-parsed.
gh-80222: Fix bug in the folding of quoted strings when flattening an email message using a modern email policy. Previously when a quoted string was folded so that it spanned more than one line, the surrounding quotes and internal escapes would be omitted. This could theoretically be used to spoof header lines using a carefully constructed quoted string if the resulting rendered email was transmitted or re-parsed.
gh-119511: Fix a potential denial of service in the
imaplibmodule. When connecting to a malicious server, it could cause an arbitrary amount of memory to be allocated. On many systems this is harmless as unused virtual memory is only a mapping, but if this hit a virtual address size limit it could lead to aMemoryErroror other process crash. On unusual systems or builds where all allocated memory is touched and backed by actual ram or storage it could’ve consumed resources doing so until similarly crashing.
Library¶
Documentation¶
gh-121277: Writers of CPython’s documentation can now use
nextas the version for theversionchanged,versionadded,deprecateddirectives.
Python 3.10.16 final¶
Release date: 2024-12-03
Tests¶
gh-125041: Re-enable skipped tests for
zlibon the s390x architecture: only skip checks of the compressed bytes, which can be different between zlib’s software implementation and the hardware-accelerated implementation.gh-109396: Fix
test_socket.test_hmac_sha1()in FIPS mode. Use a longer key: FIPS mode requires at least of at least 112 bits. The previous key was only 32 bits. Patch by Victor Stinner.
Security¶
Library¶
gh-124651: Properly quote template strings in
venvactivation scripts.gh-103848: Add checks to ensure that
[bracketed]hosts found byurllib.parse.urlsplit()are of IPv6 or IPvFuture format.
Python 3.10.15 final¶
Release date: 2024-09-07
Windows¶
Tests¶
gh-112769: The tests now correctly compare zlib version when
zlib.ZLIB_RUNTIME_VERSIONcontains non-integer suffixes. For example zlib-ng defines the version as1.3.0.zlib-ng.gh-117187: Fix XML tests for vanilla Expat <2.6.0.
gh-100454: Fix SSL tests CI for OpenSSL 3.1+
Security¶
gh-123678: Upgrade libexpat to 2.6.3
gh-121957: Fixed missing audit events around interactive use of Python, now also properly firing for
python -i, as well as forpython -m asyncio. The event in question iscpython.run_stdin.gh-122133: Authenticate the socket connection for the
socket.socketpair()fallback on platforms whereAF_UNIXis not available like Windows.Patch by Gregory P. Smith <greg@krypto.org> and Seth Larson <seth@python.org>. Reported by Ellie <el@horse64.org>
gh-121285: Remove backtracking from tarfile header parsing for
hdrcharset, PAX, and GNU sparse headers.gh-118486:
os.mkdir()on Windows now accepts mode of0o700to restrict the new directory to the current user. This fixes CVE-2024-4030 affectingtempfile.mkdtemp()in scenarios where the base temporary directory is more permissive than the default.gh-116741: Update bundled libexpat to 2.6.2
Library¶
gh-123693: Use platform-agnostic behavior when computing
zipfile.Path.name.gh-123270: Applied a more surgical fix for malformed payloads in
zipfile.Pathcausing infinite loops (gh-122905) without breaking contents using legitimate characters.gh-123067: Fix quadratic complexity in parsing
"-quoted cookie values with backslashes byhttp.cookies.gh-122905:
zipfile.Pathobjects now sanitize names from the zipfile.gh-121650:
emailheaders with embedded newlines are now quoted on output. Thegeneratorwill now refuse to serialize (write) headers that are unsafely folded or delimited; seeverify_generated_headers. (Contributed by Bas Bloemsaat and Petr Viktorin in gh-121650.)gh-113171: Fixed various false positives and false negatives in
ipaddress.IPv4Address.is_private(see these docs for details)
Also in the corresponding
ipaddress.IPv4Networkandipaddress.IPv6Networkattributes.gh-102988:
email.utils.getaddresses()andemail.utils.parseaddr()now return('', '')2-tuples in more situations where invalid email addresses are encountered instead of potentially inaccurate values. Add optional strict parameter to these two functions: usestrict=Falseto get the old behavior, accept malformed inputs.getattr(email.utils, 'supports_strict_parsing', False)can be use to check if the strict paramater is available. Patch by Thomas Dwyer and Victor Stinner to improve the CVE-2023-27043 fix.gh-67693: Fix
urllib.parse.urlunparse()andurllib.parse.urlunsplit()for URIs with path starting with multiple slashes and no authority. Based on patch by Ashwin Ramaswami.
Core and Builtins¶
gh-112275: A deadlock involving
pystate.c’sHEAD_LOCKinposixmodule.cat fork is now fixed. Patch by ChuBoning based on previous Python 3.12 fix by Victor Stinner.
Python 3.10.14 final¶
Release date: 2024-03-19
Security¶
gh-115398: Allow controlling Expat >=2.6.0 reparse deferral (CVE-2023-52425) by adding five new methods:
gh-115399: Update bundled libexpat to 2.6.0
gh-114572:
ssl.SSLContext.cert_store_stats()andssl.SSLContext.get_ca_certs()now correctly lock access to the certificate store, when thessl.SSLContextis shared across multiple threads.gh-113659: Skip
.pthfiles with names starting with a dot or hidden file attribute.
Core and Builtins¶
gh-102388: Fix a bug where
iso2022_jp_3andiso2022_jp_2004codecs read out of bounds
Library¶
gh-115197:
urllib.requestno longer resolves the hostname before checking it against the system’s proxy bypass list on macOS and Windows.gh-115133: Fix tests for
XMLPullParserwith Expat 2.6.0.gh-81194: Fix a crash in
socket.if_indextoname()with specific value (UINT_MAX). Fix an integer overflow insocket.if_indextoname()on 64-bit non-Windows platforms.gh-109858: Protect
zipfilefrom “quoted-overlap” zipbomb. It now raises BadZipFile when try to read an entry that overlaps with other entry or central directory.gh-91133: Fix a bug in
tempfile.TemporaryDirectorycleanup, which now no longer dereferences symlinks when working around file system permission errors.
Documentation¶
gh-115399: Document CVE-2023-52425 of Expat <2.6.0 under “XML vulnerabilities”.
Windows¶
Tools/Demos¶
gh-109991: Update GitHub CI workflows to use OpenSSL 3.0.11 and multissltests to use 1.1.1w, 3.0.11, and 3.1.3.
Python 3.10.13 final¶
Release date: 2023-08-24
Security¶
gh-108310: Fixed an issue where instances of
ssl.SSLSocketwere vulnerable to a bypass of the TLS handshake and included protections (like certificate verification) and treating sent unencrypted data as if it were post-handshake TLS encrypted data. Security issue reported as CVE-2023-40217 by Aapo Oksman. Patch by Gregory P. Smith.
Library¶
gh-107845:
tarfile.data_filter()now takes the location of symlinks into account when determining their target, so it will no longer reject some valid tarballs withLinkOutsideDestinationError.
Tools/Demos¶
gh-107565: Update multissltests and GitHub CI workflows to use OpenSSL 1.1.1v, 3.0.10, and 3.1.2.
C API¶
gh-99612: Fix
PyUnicode_DecodeUTF8Stateful()for ASCII-only data:*consumedwas not set.
Python 3.10.12 final¶
Release date: 2023-06-06
Security¶
gh-103142: The version of OpenSSL used in our binary builds has been upgraded to 1.1.1u to address several CVEs.
gh-99889: Fixed a security in flaw in
uu.decode()that could allow for directory traversal based on the input if noout_filewas specified.gh-104049: Do not expose the local on-disk location in directory indexes produced by
http.client.SimpleHTTPRequestHandler.gh-102153:
urllib.parse.urlsplit()now strips leading C0 control and space characters following the specification for URLs defined by WHATWG in response to CVE-2023-24329. Patch by Illia Volochii.
Library¶
gh-103935: Use
io.open_code()for files to be executed instead of rawopen()gh-102953: The extraction methods in
tarfile, andshutil.unpack_archive(), have a new a filter argument that allows limiting tar features than may be surprising or dangerous, such as creating files outside the destination directory. See Extraction filters for details.
Documentation¶
gh-89412: Add missing documentation for the
end_linenoandend_offsetattributes of thetraceback.TracebackExceptionclass.
Build¶
gh-103262: Fixes Windows installer build to work with latest compilers.
Python 3.10.11 final¶
Release date: 2023-04-04
Security¶
gh-101727: Updated the OpenSSL version used in Windows and macOS binary release builds to 1.1.1t to address CVE-2023-0286, CVE-2022-4303, and CVE-2022-4303 per the OpenSSL 2023-02-07 security advisory.
gh-101283:
subprocess.Popennow uses a safer approach to findcmd.exewhen launching withshell=True. Patch by Eryk Sun, based on a patch by Oleg Iarygin.
Core and Builtins¶
gh-102416: Do not memoize incorrectly automatically generated loop rules in the parser. Patch by Pablo Galindo.
gh-102356: Fix a bug that caused a crash when deallocating deeply nested filter objects. Patch by Marta Gómez Macías.
gh-102397: Fix segfault from race condition in signal handling during garbage collection. Patch by Kumar Aditya.
gh-102126: Fix deadlock at shutdown when clearing thread states if any finalizer tries to acquire the runtime head lock. Patch by Kumar Aditya.
gh-102027: Fix SSE2 and SSE3 detection in
_blake2internal module. Patch by Max Bachmann.gh-101967: Fix possible segfault in
positional_only_passed_as_keywordfunction, when new list created.gh-101765: Fix SystemError / segmentation fault in iter
__reduce__when internal access ofbuiltins.__dict__keys mutates the iter object.
Library¶
gh-102947: Improve traceback when
dataclasses.fields()is called on a non-dataclass. Patch by Alex Waygoodgh-101979: Fix a bug where parentheses in the
metavarargument toargparse.ArgumentParser.add_argument()were dropped. Patch by Yeojin Kim.gh-101961: For the binary mode,
fileinput.hookcompressed()doesn’t set theencodingvalue even if the value isNone. Patch by Gihwan Kim.gh-101936: The default value of
fpbecomesio.BytesIOifHTTPErroris initialized without a designatedfpparameter. Patch by Long Vo.gh-101566: In zipfile, apply fix for extractall on the underlying zipfile after being wrapped in
Path.gh-101997: Upgrade pip wheel bundled with ensurepip (pip 23.0.1)
gh-101892: Callable iterators no longer raise
SystemErrorwhen the callable object exhausts the iterator but forgets to either return a sentinel value or raiseStopIteration.gh-97786: Fix potential undefined behaviour in corner cases of floating-point-to-time conversions.
gh-101517: Fixed bug where
bdblooks up the source line withlinecachewith alineno=None, which causes it to fail with an unhandled exception.gh-101673: Fix a
pdbbug wherellclears the changes to local variables.gh-96931: Fix incorrect results from
ssl.SSLSocket.shared_ciphers()gh-88233: Correctly preserve “extra” fields in
zipfileregardless of their ordering relative to a zip64 “extra.”gh-95495: When built against OpenSSL 3.0, the
sslmodule had a bug where it reported unauthenticated EOFs (i.e. without close_notify) as a clean TLS-level EOF. It now raisesSSLEOFError, matching the behavior in previous versions of OpenSSL. Theoptionsattribute onSSLContextalso no longer includesOP_IGNORE_UNEXPECTED_EOFby default. This option may be set to specify the previous OpenSSL 3.0 behavior.gh-94440: Fix a
concurrent.futures.processbug whereProcessPoolExecutorshutdown could hang after a future has been quickly submitted and canceled.
Documentation¶
gh-103112: Add docstring to
http.client.HTTPResponse.read()to fixpydocoutput.gh-85417: Update
cmathdocumentation to clarify behaviour on branch cuts.gh-97725: Fix
asyncio.Task.print_stack()description forfile=None. Patch by Oleg Iarygin.
Tests¶
Build¶
gh-102711: Fix
-Wstrict-prototypescompiler warnings.
Windows¶
macOS¶
gh-103207: Add instructions to the macOS installer welcome display on how to workaround the macOS 13 Ventura “The installer encountered an error” failure.
gh-101759: Update macOS installer to SQLite 3.40.1.
gh-87235: On macOS
python3 /dev/fd/9 9</path/to/script.pyfailed for any script longer than a couple of bytes.
Python 3.10.10 final¶
Release date: 2023-02-07
Core and Builtins¶
gh-101400: Fix wrong lineno in exception message on
continueorbreakwhich are not in a loop. Patch by Dong-hee Na.gh-101372: Fix
is_normalized()to properly handle the UCD 3.2.0 cases. Patch by Dong-hee Na.gh-101046: Fix a possible memory leak in the parser when raising
MemoryError. Patch by Pablo Galindogh-100942: Fixed segfault in property.getter/setter/deleter that occurred when a property subclass overrode the
__new__method to return a non-property instance.gh-100892: Fix race while iterating over thread states in clearing
threading.local. Patch by Kumar Aditya.gh-100776: Fix misleading default value in
input()’s__text_signature__.gh-100374: Fix incorrect result and delay in
socket.getfqdn(). Patch by Dominic Socular.gh-100050: Honor existing errors obtained when searching for mismatching parentheses in the tokenizer. Patch by Pablo Galindo
bpo-32782:
ctypesarrays of length 0 now report a correct itemsize when amemoryviewis constructed from them, rather than always giving a value of 0.
Library¶
gh-100795: Avoid potential unexpected
freeaddrinfocall (double free) insocketwhen when a libcgetaddrinfo()implementation leaves garbage in an output pointer when returning an error. Original patch by Sergey G. Brester.gh-101143: Remove unused references to
TimerHandleinasyncio.base_events.BaseEventLoop._add_callback.gh-101144: Make
zipfile.Path.open()andzipfile.Path.read_text()also acceptencodingas a positional argument. This was the behavior in Python 3.9 and earlier. Earlier 3.10 versions had a regression where supplying it as a positional argument would lead to aTypeError.gh-100573: Fix a Windows
asynciobug with named pipes where a client doingos.stat()on the pipe would cause an error in the server that disabled serving future requests.gh-90104: Avoid RecursionError on
reprif a dataclass field definition has a cyclic reference.gh-100689: Fix crash in
pyexpatby statically allocatingPyExpat_CAPIcapsule.gh-100740: Fix
unittest.mock.Mocknot respecting the spec for attribute names prefixed withassert.gh-86508: Fix
asyncio.open_connection()to skip binding to local addresses of different family. Patch by Kumar Aditya.gh-100287: Fix the interaction of
unittest.mock.seal()withunittest.mock.AsyncMock.gh-100474:
http.servernow checks that an index page is actually a regular file before trying to serve it. This avoids issues with directories namedindex.html.gh-100160: Remove any deprecation warnings in
asyncio.get_event_loop(). They are deferred to Python 3.12.gh-99952: Fix a reference undercounting issue in
ctypes.Structurewithfrom_param()results larger than a C pointer.gh-98778: Update
HTTPErrorto be initialized properly, even if thefpisNone. Patch by Dong-hee Na.gh-83035: Fix
inspect.getsource()handling of decorator calls with nested parentheses.gh-99240: Fix double-free bug in Argument Clinic
str_converterby extracting memory clean up to a newpost_parsingsection.gh-85267: Several improvements to
inspect.signature()’s handling of__text_signature. - Fixes a case whereinspect.signature()dropped parameters - Fixes a case whereinspect.signature()raisedtokenize.TokenError- Allowsinspect.signature()to understand defaults involving binary operations of constants -inspect.signature()is documented as only raisingTypeErrororValueError, but sometimes raisedRuntimeError. These cases now raiseValueError- Removed a dead code pathgh-96192: Fix handling of
bytespath-like objects inos.ismount().bpo-44817: Ignore WinError 53 (ERROR_BAD_NETPATH), 65 (ERROR_NETWORK_ACCESS_DENIED) and 161 (ERROR_BAD_PATHNAME) when using ntpath.realpath().
bpo-40447: Accept
os.PathLike(such aspathlib.Path) in thestripdirarguments ofcompileall.compile_file()andcompileall.compile_dir().bpo-36880: Fix a reference counting issue when a
ctypescallback with return typepy_objectreturnsNone, which could cause crashes.
Documentation¶
gh-100616: Document existing
attrparameter tocurses.window.vline()function incurses.gh-100472: Remove claim in documentation that the
stripdir,prependdirandlimit_sl_destparameters ofcompileall.compile_dir()andcompileall.compile_file()could bebytes.
Tests¶
Build¶
gh-101522: Allow overriding Windows dependencies versions and paths using MSBuild properties.
Windows¶
gh-82052: Fixed an issue where writing more than 32K of Unicode output to the console screen in one go can result in mojibake.
gh-100180: Update Windows installer to OpenSSL 1.1.1s
bpo-43984:
winreg.SetValueEx()now leaves the target value untouched in the case of conversion errors. Previously,-1would be written in case of such errors.
macOS¶
gh-100180: Update macOS installer to OpenSSL 1.1.1s
C API¶
gh-99240: In argument parsing, after deallocating newly allocated memory, reset its pointer to NULL.
Python 3.10.9 final¶
Release date: 2022-12-06
Security¶
gh-100001:
python -m http.serverno longer allows terminal control characters sent within a garbage request to be printed to the stderr server log.This is done by changing the
http.serverBaseHTTPRequestHandler.log_messagemethod to replace control characters with a\xHHhex escape before printing.gh-87604: Avoid publishing list of active per-interpreter audit hooks via the
gcmodulegh-98433: The IDNA codec decoder used on DNS hostnames by
socketorasynciorelated name resolution functions no longer involves a quadratic algorithm. This prevents a potential CPU denial of service if an out-of-spec excessive length hostname involving bidirectional characters were decoded. Some protocols such asurllibhttp3xxredirects potentially allow for an attacker to supply such a name.gh-98739: Update bundled libexpat to 2.5.0
gh-98517: Port XKCP’s fix for the buffer overflows in SHA-3 (CVE-2022-37454).
gh-97514: On Linux the
multiprocessingmodule returns to using filesystem backed unix domain sockets for communication with the forkserver process instead of the Linux abstract socket namespace. Only code that chooses to use the “forkserver” start method is affected.Abstract sockets have no permissions and could allow any user on the system in the same network namespace (often the whole system) to inject code into the multiprocessing forkserver process. This was a potential privilege escalation. Filesystem based socket permissions restrict this to the forkserver process user as was the default in Python 3.8 and earlier.
This prevents Linux CVE-2022-42919.
Core and Builtins¶
gh-99578: Fix a reference bug in
_imp.create_builtin()after the creation of the first sub-interpreter for modulesbuiltinsandsys. Patch by Victor Stinner.gh-99581: Fixed a bug that was causing a buffer overflow if the tokenizer copies a line missing the newline caracter from a file that is as long as the available tokenizer buffer. Patch by Pablo galindo
gh-96055: Update
faulthandlerto emit an error message with the proper unexpected signal number. Patch by Dong-hee Na.gh-98852: Fix subscription of
types.GenericAliasinstances containing bare generic types: for exampletuple[A, T][int], whereAis a generic type, andTis a type variable.gh-98415: Fix detection of MAC addresses for
uuidon certain OSs. Patch by Chaim Sandersgh-92119: Print exception class name instead of its string representation when raising errors from
ctypescalls.gh-93696: Allow
pdbto locate source for frozen modules in the standard library.bpo-31718: Raise
ValueErrorinstead ofSystemErrorwhen methods of uninitializedio.IncrementalNewlineDecoderobjects are called. Patch by Oren Milman.bpo-38031: Fix a possible assertion failure in
io.FileIOwhen the opener returns an invalid file descriptor.
Library¶
gh-100001: Also escape s in the http.server BaseHTTPRequestHandler.log_message so that it is technically possible to parse the line and reconstruct what the original data was. Without this a xHH is ambiguious as to if it is a hex replacement we put in or the characters r”x” came through in the original request line.
gh-93453:
asyncio.get_event_loop()now only emits a deprecation warning when a new event loop was created implicitly. It no longer emits a deprecation warning if the current event loop was set.gh-51524: Fix bug when calling trace.CoverageResults with valid infile.
gh-99645: Fix a bug in handling class cleanups in
unittest.TestCase. NowaddClassCleanup()uses separate lists for differentTestCasesubclasses, anddoClassCleanups()only cleans up the particular class.gh-97001: Release the GIL when calling termios APIs to avoid blocking threads.
gh-99341: Fix
ast.increment_lineno()to also coverast.TypeIgnorewhen changing line numbers.gh-74044: Fixed bug where
inspect.signature()reported incorrect arguments for decorated methods.gh-99275: Fix
SystemErrorinctypeswhen exception was not set during__initsubclass__.gh-99155: Fix
statistics.NormalDistpickle with0and1protocols.gh-99134: Update the bundled copy of pip to version 22.3.1.
gh-99130: Apply bugfixes from importlib_metadata 4.11.4, namely: In
PathDistribution._name_from_stem, avoid including parts of the extension in the result. InPathDistribution._normalized_name, ensure names loaded from the stem of the filename are also normalized, ensuring duplicate entry points by packages varying only by non-normalized name are hidden.gh-83004: Clean up refleak on failed module initialisation in
_zoneinfogh-83004: Clean up refleaks on failed module initialisation in in
_picklegh-83004: Clean up refleak on failed module initialisation in
_io.gh-98897: Fix memory leak in
math.dist()when both points don’t have the same dimension. Patch by Kumar Aditya.gh-98793: Fix argument typechecks in
_overlapped.WSAConnect()and_overlapped.Overlapped.WSASendTo()functions.gh-98740: Fix internal error in the
remodule which in very rare circumstances prevented compilation of a regular expression containing a conditional expression without the “else” branch.gh-98703: Fix
asyncio.StreamWriter.drain()to callprotocol.connection_lostcallback only once on Windows.gh-98624: Add a mutex to unittest.mock.NonCallableMock to protect concurrent access to mock attributes.
gh-89237: Fix hang on Windows in
subprocess.wait_closed()inasynciowithProactorEventLoop. Patch by Kumar Aditya.gh-98458: Fix infinite loop in unittest when a self-referencing chained exception is raised
gh-97928:
tkinter.Text.count()raises now an exception for options starting with “-” instead of silently ignoring them.gh-97966: On
uname_result, restored expectation that_fieldsand_asdictwould include all six properties includingprocessor.gh-98331: Update the bundled copies of pip and setuptools to versions 22.3 and 65.5.0 respectively.
gh-96035: Fix bug in
urllib.parse.urlparse()that causes certain port numbers containing whitespace, underscores, plus and minus signs, or non-ASCII digits to be incorrectly accepted.gh-98251: Allow
venvto pass alongPYTHON*variables toensurepipandpipwhen they do not impact path resolutiongh-98178: On macOS, fix a crash in
syslog.syslog()in multi-threaded applications. On macOS, the libcsyslog()function is not thread-safe, sosyslog.syslog()no longer releases the GIL to call it. Patch by Victor Stinner.gh-96151: Allow
BUILTINSto be a valid field name for frozen dataclasses.gh-98086: Make sure
patch.dict()can be applied on async functions.gh-88863: To avoid apparent memory leaks when
asyncio.open_connection()raises, break reference cycles generated by local exception and future instances (which has exception instance as its member var). Patch by Dong Uk, Kang.gh-93858: Prevent error when activating venv in nested fish instances.
bpo-46364: Restrict use of sockets instead of pipes for stdin of subprocesses created by
asyncioto AIX platform only.bpo-38523:
shutil.copytree()now applies the ignore_dangling_symlinks argument recursively.bpo-36267: Fix IndexError in
argparse.ArgumentParserwhen astore_trueaction is given an explicit argument.
Documentation¶
gh-92892: Document that calling variadic functions with ctypes requires special care on macOS/arm64 (and possibly other platforms).
Tests¶
Build¶
gh-99086: Fix
-Wimplicit-int,-Wstrict-prototypes, and-Wimplicit-function-declarationcompiler warnings in configure checks.gh-99086: Fix
-Wimplicit-intcompiler warning in configure check forPTHREAD_SCOPE_SYSTEM.gh-97731: Specify the full path to the source location for
make docclean(needed for cross-builds).gh-98671: Fix
NO_MISALIGNED_ACCESSESbeing not defined for the SHA3 extension whenHAVE_ALIGNED_REQUIREDis set. Allowing builds on hardware that unaligned memory accesses are not allowed.
Windows¶
gh-99345: Use faster initialization functions to detect install location for Windows Store package
gh-98689: Update Windows builds to zlib v1.2.13. v1.2.12 has CVE-2022-37434, but the vulnerable
inflateGetHeaderAPI is not used by Python.gh-94328: Update Windows installer to use SQLite 3.39.4.
bpo-40882: Fix a memory leak in
multiprocessing.shared_memory.SharedMemoryon Windows.
macOS¶
gh-94328: Update macOS installer to SQLite 3.39.4.
IDLE¶
gh-97527: Fix a bug in the previous bugfix that caused IDLE to not start when run with 3.10.8, 3.12.0a1, and at least Microsoft Python 3.10.2288.0 installed without the Lib/test package. 3.11.0 was never affected.
Tools/Demos¶
gh-95731: Fix handling of module docstrings in
Tools/i18n/pygettext.py.
Python 3.10.8 final¶
Release date: 2022-10-11
Security¶
gh-97616: Fix multiplying a list by an integer (
list *= int): detect the integer overflow when the new allocated length is close to the maximum size. Issue reported by Jordan Limor. Patch by Victor Stinner.gh-97612: Fix a shell code injection vulnerability in the
get-remote-certificate.pyexample script. The script no longer uses a shell to runopensslcommands. Issue reported and initial fix by Caleb Shortt. Patch by Victor Stinner.gh-68966: The deprecated mailcap module now refuses to inject unsafe text (filenames, MIME types, parameters) into shell commands. Instead of using such text, it will warn and act as if a match was not found (or for test commands, as if the test failed).
Core and Builtins¶
gh-96078:
os.sched_yield()now release the GIL while calling sched_yield(2). Patch by Dong-hee Na.gh-97943: Bugfix:
PyFunction_GetAnnotations()should return a borrowed reference. It was returning a new reference.gh-97591: Fixed a missing incref/decref pair in
Exception.__setstate__(). Patch by Ofey Chan.gh-96848: Fix command line parsing: reject
-X int_max_str_digitsoption with no value (invalid) when thePYTHONINTMAXSTRDIGITSenvironment variable is set to a valid limit. Patch by Victor Stinner.gh-95921: Fix overly-broad source position information for chained comparisons used as branching conditions.
gh-96821: Fix undefined behaviour in
_testcapimodule.c.gh-95778: When
ValueErroris raised if an integer is larger than the limit, mention thesys.set_int_max_str_digits()function in the error message. Patch by Victor Stinner.gh-96387: At Python exit, sometimes a thread holding the GIL can wait forever for a thread (usually a daemon thread) which requested to drop the GIL, whereas the thread already exited. To fix the race condition, the thread which requested the GIL drop now resets its request before exiting. Issue discovered and analyzed by Mingliang ZHAO. Patch by Victor Stinner.
gh-96864: Fix a possible assertion failure, fatal error, or
SystemErrorif a line tracing event raises an exception while opcode tracing is enabled.gh-96678: Fix undefined behaviour in C code of null pointer arithmetic.
gh-96641: Do not expose
KeyWrapperin_functools.gh-96611: When loading a file with invalid UTF-8 inside a multi-line string, a correct SyntaxError is emitted.
gh-95196: Disable incorrect pickling of the C implemented classmethod descriptors.
gh-96352: Fix
AttributeErrormissingnameandobjattributes inobject.__getattribute__(). Patch by Philip Georgi.bpo-42316: Document some places where an assignment expression needs parentheses.
Library¶
gh-87730: Wrap network errors consistently in urllib FTP support, so the test suite doesn’t fail when a network is available but the public internet is not reachable.
gh-97825: Fixes
AttributeErrorwhensubprocess.check_output()is used with argumentinput=Noneand either of the arguments encoding or errors are used.gh-96827: Avoid spurious tracebacks from
asynciowhen default executor cleanup is delayed until after the event loop is closed (e.g. as the result of a keyboard interrupt).gh-97592: Avoid a crash in the C version of
asyncio.Future.remove_done_callback()when an evil argument is passed.gh-97545: Make Semaphore run faster.
gh-73588: Fix generation of the default name of
tkinter.Checkbutton. Previously, checkbuttons in different parent widgets could have the same short name and share the same state if arguments “name” and “variable” are not specified. Now they are globally unique.gh-97005: Update bundled libexpat to 2.4.9
gh-85760: Fix race condition in
asynciowhereprocess_exited()called before thepipe_data_received()leading to inconsistent output. Patch by Kumar Aditya.gh-96819: Fixed check in
multiprocessing.resource_trackerthat guarantees that the length of a write to a pipe is not greater thanPIPE_BUF.gh-96741: Corrected type annotation for dataclass attribute
pstats.FunctionProfile.ncallsto bestr.gh-96652: Fix the faulthandler implementation of
faulthandler.register(signal, chain=True)if thesigaction()function is not available: don’t call the previous signal handler if it’s NULL. Patch by Victor Stinner.gh-96073: In
inspect, fix overeager replacement of “typing.” in formatting annotations.gh-90467: Fix
asyncio.streams.StreamReaderProtocolto keep a strong reference to the created task, so that it’s not garbage collectedgh-96052: Fix handling compiler warnings (SyntaxWarning and DeprecationWarning) in
codeop.compile_command()when checking for incomplete input. Previously it emitted warnings and raised a SyntaxError. Now it always returnsNonefor incomplete input without emitting any warnings.gh-91212: Fixed flickering of the turtle window when the tracer is turned off. Patch by Shin-myoung-serp.
gh-74116: Allow
asyncio.StreamWriter.drain()to be awaited concurrently by multiple tasks. Patch by Kumar Aditya.gh-90155: Fix broken
asyncio.Semaphorewhen acquire is cancelled.gh-92986: Fix
ast.unparse()whenImportFrom.levelis Nonegh-91539: Improve performance of
urllib.request.getproxies_environmentwhen there are many environment variables
Documentation¶
gh-97741: Fix
!in c domain ref target syntax via aconf.pypatch, so it works as intended to disable ref target resolution.gh-95588: Clarified the conflicting advice given in the
astdocumentation aboutast.literal_eval()being “safe” for use on untrusted input while at the same time warning that it can crash the process. The latter statement is true and is deemed unfixable without a large amount of work unsuitable for a bugfix. So we keep the warning and no longer claim thatliteral_evalis safe.gh-93031: Update tutorial introduction output to use 3.10+ SyntaxError invalid range.
Build¶
gh-96729: Ensure that Windows releases built with
Tools\msi\buildrelease.batare upgradable to and from official Python releases.
Windows¶
gh-97728: Fix possible crashes caused by the use of uninitialized variables when pass invalid arguments in
os.system()on Windows and in Windows-specific modules (likewinreg).gh-90989: Clarify some text in the Windows installer.
macOS¶
gh-97897: The macOS 13 SDK includes support for the
mkfifoatandmknodatsystem calls. Using thedir_fdoption with eitheros.mkfifo()oros.mknod()could result in a segfault if cpython is built with the macOS 13 SDK but run on an earlier version of macOS. Prevent this by adding runtime support for detection of these system calls (“weaklinking”) as is done for other newer syscalls on macOS.
Python 3.10.7 final¶
Release date: 2022-09-05
Security¶
gh-95778: Converting between
intandstrin bases other than 2 (binary), 4, 8 (octal), 16 (hexadecimal), or 32 such as base 10 (decimal) now raises aValueErrorif the number of digits in string form is above a limit to avoid potential denial of service attacks due to the algorithmic complexity. This is a mitigation for CVE-2020-10735.This new limit can be configured or disabled by environment variable, command line flag, or
sysAPIs. See the integer string conversion length limitation documentation. The default limit is 4300 digits in string form.Patch by Gregory P. Smith [Google] and Christian Heimes [Red Hat] with feedback from Victor Stinner, Thomas Wouters, Steve Dower, Ned Deily, and Mark Dickinson.
Core and Builtins¶
gh-96187: Fixed a bug that caused
_PyCode_GetExtrato return garbage for negative indexes. Patch by Pablo Galindogh-95876: Fix format string in
_PyPegen_raise_error_known_locationthat can lead to memory corruption on some 64bit systems. The function was building a tuple withi(int) instead ofn(Py_ssize_t) for Py_ssize_t arguments.gh-95605: Fix misleading contents of error message when converting an all-whitespace string to
float.gh-93592:
coroutine.throw()now properly initializes theframe.f_backwhen resuming a stack of coroutines. This allows e.g.traceback.print_stack()to work correctly when an exception (such asCancelledError) is thrown into a coroutine.gh-94996:
ast.parse()will no longer parse function definitions with positional-only params when passedfeature_versionless than(3, 8). Patch by Shantanu Jain.
Library¶
gh-68163: Correct conversion of
numbers.Rational’s tofloat.gh-96159: Fix a performance regression in logging TimedRotatingFileHandler. Only check for special files when the rollover time has passed.
gh-96175: Fix unused
localNameparameter in theAttrclass inxml.dom.minidom.gh-95609: Update bundled pip to 22.2.2.
gh-95231: Fail gracefully if
EPERMorENOSYSis raised when loadingcryptmethods. This may happen when trying to loadMD5on a Linux kernel with FIPS enabled.
Documentation¶
gh-96098: Improve discoverability of the higher level concurrent.futures module by providing clearer links from the lower level threading and multiprocessing modules.
gh-95789: Update the default RFC base URL from deprecated tools.ietf.org to datatracker.ietf.org
gh-91207: Fix stylesheet not working in Windows CHM htmlhelp docs. Contributed by C.A.M. Gerlach.
bpo-47115: The documentation now lists which members of C structs are part of the Limited API/Stable ABI.
Tests¶
gh-95243: Mitigate the inherent race condition from using find_unused_port() in testSockName() by trying to find an unused port a few times before failing. Patch by Ross Burton.
Build¶
gh-94682: Build and test with OpenSSL 1.1.1q
IDLE¶
Python 3.10.6 final¶
Release date: 2022-08-01
Security¶
gh-87389:
http.server: Fix an open redirection vulnerability in the HTTP server when an URI path starts with//. Vulnerability discovered, and initial fix proposed, by Hamza Avvan.gh-92888: Fix
memoryviewuse after free when accessing the backing buffer in certain cases.
Core and Builtins¶
gh-95355:
_PyPegen_Parser_Newnow properly detects token memory allocation errors. Patch by Honglin Zhu.gh-94938: Fix error detection in some builtin functions when keyword argument name is an instance of a str subclass with overloaded
__eq__and__hash__. Previously it could cause SystemError or other undesired behavior.gh-94949:
ast.parse()will no longer parse parenthesized context managers when passedfeature_versionless than(3, 9). Patch by Shantanu Jain.gh-94947:
ast.parse()will no longer parse assignment expressions when passedfeature_versionless than(3, 8). Patch by Shantanu Jain.gh-94869: Fix the column offsets for some expressions in multi-line f-strings
astnodes. Patch by Pablo Galindo.gh-91153: Fix an issue where a
bytearrayitem assignment could crash if it’s resized by the new value’s__index__()method.gh-94329: Compile and run code with unpacking of extremely large sequences (1000s of elements). Such code failed to compile. It now compiles and runs correctly.
gh-94360: Fixed a tokenizer crash when reading encoded files with syntax errors from
stdinwith non utf-8 encoded text. Patch by Pablo Galindogh-94192: Fix error for dictionary literals with invalid expression as value.
gh-93964: Strengthened compiler overflow checks to prevent crashes when compiling very large source files.
gh-93671: Fix some exponential backtrace case happening with deeply nested sequence patterns in match statements. Patch by Pablo Galindo
gh-93021: Fix the
__text_signature__for__get__()methods implemented in C. Patch by Jelle Zijlstra.gh-92930: Fixed a crash in
_pickle.cfrom mutating collections during__reduce__orpersistent_id.gh-92914: Always round the allocated size for lists up to the nearest even number.
gh-92858: Improve error message for some suites with syntax error before ‘:’
Library¶
gh-95339: Update bundled pip to 22.2.1.
gh-95045: Fix GC crash when deallocating
_lsprof.Profilerby untracking it before calling any callbacks. Patch by Kumar Aditya.gh-95087: Fix IndexError in parsing invalid date in the
emailmodule.gh-95199: Upgrade bundled setuptools to 63.2.0.
gh-95194: Upgrade bundled pip to 22.2.
gh-93899: Fix check for existence of
os.EFD_CLOEXEC,os.EFD_NONBLOCKandos.EFD_SEMAPHOREflags on older kernel versions where these flags are not present. Patch by Kumar Aditya.gh-95166: Fix
concurrent.futures.Executor.map()to cancel the currently waiting on future on an error - e.g. TimeoutError or KeyboardInterrupt.gh-93157: Fix
fileinputmodule didn’t supporterrorsoption wheninplaceis true.gh-94821: Fix binding of unix socket to empty address on Linux to use an available address from the abstract namespace, instead of “0”.
gh-94736: Fix crash when deallocating an instance of a subclass of
_multiprocessing.SemLock. Patch by Kumar Aditya.gh-94637:
SSLContext.set_default_verify_paths()now releases the GIL aroundSSL_CTX_set_default_verify_pathscall. The function call performs I/O and CPU intensive work.gh-94510: Re-entrant calls to
sys.setprofile()andsys.settrace()now raiseRuntimeError. Patch by Pablo Galindo.gh-92336: Fix bug where
linecache.getline()fails on bad files withUnicodeDecodeErrororSyntaxError. It now returns an empty string as per the documentation.gh-89988: Fix memory leak in
pickle.Picklerwhen looking updispatch_table. Patch by Kumar Aditya.gh-94254: Fixed types of
structmodule to be immutable. Patch by Kumar Aditya.gh-94245: Fix pickling and copying of
typing.Tuple[()].gh-94207: Made
_struct.StructGC-tracked in order to fix a reference leak in the_structmodule.gh-94101: Manual instantiation of
ssl.SSLSessionobjects is no longer allowed as it lead to misconfigured instances that crashed the interpreter when attributes where accessed on them.gh-84753:
inspect.iscoroutinefunction(),inspect.isgeneratorfunction(), andinspect.isasyncgenfunction()now properly returnTruefor duck-typed function-like objects like instances ofunittest.mock.AsyncMock.This makes
inspect.iscoroutinefunction()consistent with the behavior ofasyncio.iscoroutinefunction(). Patch by Mehdi ABAAKOUK.gh-83499: Fix double closing of file description in
tempfile.gh-79512: Fixed names and
__module__value ofweakrefclassesReferenceType,ProxyType,CallableProxyType. It makes them pickleable.gh-90494:
copy.copy()andcopy.deepcopy()now always raise a TypeError if__reduce__()returns a tuple with length 6 instead of silently ignore the 6th item or produce incorrect result.gh-90549: Fix a multiprocessing bug where a global named resource (such as a semaphore) could leak when a child process is spawned (as opposed to forked).
gh-79579:
sqlite3now correctly detects DML queries with leading comments. Patch by Erlend E. Aasland.gh-93421: Update
sqlite3.Cursor.rowcountwhen a DML statement has run to completion. This fixes the row count for SQL queries likeUPDATE ... RETURNING. Patch by Erlend E. Aasland.gh-91810: Suppress writing an XML declaration in open files in
ElementTree.write()withencoding='unicode'andxml_declaration=None.gh-93353: Fix the
importlib.resources.as_file()context manager to remove the temporary file if destroyed late during Python finalization: keep a local reference to theos.remove()function. Patch by Victor Stinner.gh-83658: Make
multiprocessing.Poolraise an exception ifmaxtasksperchildis notNoneor a positive int.gh-74696:
shutil.make_archive()no longer temporarily changes the current working directory during creation of standard.zipor tar archives.gh-91577: Move imports in
SharedMemorymethods to module level so that they can be executed late in python finalization.bpo-47231: Fixed an issue with inconsistent trailing slashes in tarfile longname directories.
bpo-46755: In
QueueHandler, clearstack_infofromLogRecordto prevent stack trace from being written twice.bpo-46053: Fix OSS audio support on NetBSD.
bpo-46197: Fix
ensurepipenvironment isolation for subprocess runningpip.bpo-45924: Fix
asyncioincorrect traceback when future’s exception is raised multiple times. Patch by Kumar Aditya.bpo-34828:
sqlite3.Connection.iterdump()now handles databases that useAUTOINCREMENTin one or more tables.
Documentation¶
gh-94321: Document the PEP 246 style protocol type
sqlite3.PrepareProtocol.gh-86128: Document a limitation in ThreadPoolExecutor where its exit handler is executed before any handlers in atexit.
gh-61162: Clarify
sqlite3behavior when How to use the connection context manager.gh-87260: Align
sqlite3argument specs with the actual implementation.gh-86986: The minimum Sphinx version required to build the documentation is now 3.2.
gh-88831: Augmented documentation of asyncio.create_task(). Clarified the need to keep strong references to tasks and added a code snippet detailing how to do this.
bpo-47161: Document that
pathlib.PurePathdoes not collapse initial double slashes because they denote UNC paths.
Tests¶
gh-95280: Fix problem with
test_ssltest_get_cipherson systems that require perfect forward secrecy (PFS) ciphers.gh-95212: Make multiprocessing test case
test_shared_memory_recreateparallel-safe.gh-91330: Added more tests for
dataclassesto cover behavior with data descriptor-based fields.gh-94208:
test_sslis now checking for supported TLS version and protocols in more tests.gh-93951: In test_bdb.StateTestCase.test_skip, avoid including auxiliary importers.
gh-93957: Provide nicer error reporting from subprocesses in test_venv.EnsurePipTest.test_with_pip.
gh-57539: Increase calendar test coverage for
calendar.LocaleTextCalendar.formatweekday().gh-92886: Fixing tests that fail when running with optimizations (
-O) intest_zipimport.pybpo-47016: Create a GitHub Actions workflow for verifying bundled pip and setuptools. Patch by Illia Volochii and Adam Turner.
Build¶
gh-94841: Fix the possible performance regression of
PyObject_Free()compiled with MSVC version 1932.bpo-45816: Python now supports building with Visual Studio 2022 (MSVC v143, VS Version 17.0). Patch by Jeremiah Vivian.
Windows¶
gh-90844: Allow virtual environments to correctly launch when they have spaces in the path.
gh-92841:
asynciono longer throwsRuntimeError: Event loop is closedon interpreter exit after asynchronous socket activity. Patch by Oleg Iarygin.bpo-42658: Support native Windows case-insensitive path comparisons by using
LCMapStringExinstead ofstr.lower()inntpath.normcase(). AddLCMapStringExto the_winapimodule.
IDLE¶
gh-95511: Fix the Shell context menu copy-with-prompts bug of copying an extra line when one selects whole lines.
gh-95471: In the Edit menu, move
Select Alland add a new separator.gh-95411: Enable using IDLE’s module browser with .pyw files.
gh-89610: Add .pyi as a recognized extension for IDLE on macOS. This allows opening stub files by double clicking on them in the Finder.
Tools/Demos¶
C API¶
gh-94930: Fix
SystemErrorraised whenPyArg_ParseTupleAndKeywords()is used with#in(...)but withoutPY_SSIZE_T_CLEANdefined.gh-94864: Fix
PyArg_Parse*with deprecated format units “u” and “Z”. It returned 1 (success) when warnings are turned into exceptions.
Python 3.10.5 final¶
Release date: 2022-06-06
Core and Builtins¶
gh-93418: Fixed an assert where an f-string has an equal sign ‘=’ following an expression, but there’s no trailing brace. For example, f”{i=”.
gh-91924: Fix
__ltrace__debug feature if the stdout encoding is not UTF-8. Patch by Victor Stinner.gh-93061: Backward jumps after
async forloops are no longer given dubious line numbers.gh-93065: Fix contextvars HAMT implementation to handle iteration over deep trees.
The bug was discovered and fixed by Eli Libman. See MagicStack/immutables#84 for more details.
gh-92311: Fixed a bug where setting
frame.f_linenoto jump over a list comprehension could misbehave or crash.gh-92112: Fix crash triggered by an evil custom
mro()on a metaclass.gh-92036: Fix a crash in subinterpreters related to the garbage collector. When a subinterpreter is deleted, untrack all objects tracked by its GC. To prevent a crash in deallocator functions expecting objects to be tracked by the GC, leak a strong reference to these objects on purpose, so they are never deleted and their deallocator functions are not called. Patch by Victor Stinner.
gh-91421: Fix a potential integer overflow in _Py_DecodeUTF8Ex.
bpo-47212: Raise
IndentationErrorinstead ofSyntaxErrorfor a bareexceptwith no following indent. ImproveSyntaxErrorlocations for an un-parenthesized generator used as arguments. Patch by Matthieu Dartiailh.bpo-47182: Fix a crash when using a named unicode character like
"\N{digit nine}"after the main interpreter has been initialized a second time.bpo-46775: Some Windows system error codes(>= 10000) are now mapped into the correct errno and may now raise a subclass of
OSError. Patch by Dong-hee Na.bpo-47117: Fix a crash if we fail to decode characters in interactive mode if the tokenizer buffers are uninitialized. Patch by Pablo Galindo.
bpo-39829: Removed the
__len__()call when initializing a list and moved initializing tolist_extend. Patch by Jeremiah Pascual.bpo-46962: Classes and functions that unconditionally declared their docstrings ignoring the
--without-doc-stringscompilation flag no longer do so.The classes affected are
ctypes.UnionType,pickle.PickleBuffer,testcapi.RecursingInfinitelyError, andtypes.GenericAlias.The functions affected are 24 methods in
ctypes.Patch by Oleg Iarygin.
bpo-36819: Fix crashes in built-in encoders with error handlers that return position less or equal than the starting position of non-encodable characters.
Library¶
gh-93156: Accessing the
pathlib.PurePath.parentssequence of an absolute path using negative index values produced incorrect results.gh-89973: Fix
re.errorraised infnmatchif the pattern contains a character range with upper bound lower than lower bound (e.g.[c-a]). Now such ranges are interpreted as empty ranges.gh-93010: In a very special case, the email package tried to append the nonexistent
InvalidHeaderErrorto the defect list. It should have beenInvalidHeaderDefect.gh-92839: Fixed crash resulting from calling bisect.insort() or bisect.insort_left() with the key argument not equal to None.
gh-91581:
utcfromtimestamp()no longer attempts to resolvefoldin the pure Python implementation, since the fold is never 1 in UTC. In addition to being slightly faster in the common case, this also prevents some errors when the timestamp is close todatetime.min. Patch by Paul Ganssle.gh-92530: Fix an issue that occurred after interrupting
threading.Condition.notify().gh-92049: Forbid pickling constants
re._constants.SUCCESSetc. Previously, pickling did not fail, but the result could not be unpickled.bpo-47029: Always close the read end of the pipe used by
multiprocessing.Queueafter the last write of buffered data to the write end of the pipe to avoidBrokenPipeErrorat garbage collection and atmultiprocessing.Queue.close()calls. Patch by Géry Ogam.gh-91401: Provide a fail-safe way to disable
subprocessuse ofvfork()via a privatesubprocess._USE_VFORKattribute. While there is currently no known need for this, if you find a need please only set it toFalse. File a CPython issue as to why you needed it and link to that from a comment in your code. This attribute is documented as a footnote in 3.11.gh-91910: Add missing f prefix to f-strings in error messages from the
multiprocessingandasynciomodules.gh-91810:
ElementTreemethodwrite()and functiontostring()now use the text file’s encoding (“UTF-8” if not available) instead of locale encoding in XML declaration whenencoding="unicode"is specified.gh-91832: Add
requiredattribute toargparse.Actionrepr output.gh-91734: Fix OSS audio support on Solaris.
gh-91700: Compilation of regular expression containing a conditional expression
(?(group)...)now raises an appropriatere.errorif the group number refers to not defined group. Previously an internal RuntimeError was raised.gh-91676: Fix
unittest.IsolatedAsyncioTestCaseto shutdown the per test event loop executor before returning from itsrunmethod so that a not yet stopped or garbage collected executor state does not persist beyond the test.gh-90568: Parsing
\Nescapes of Unicode Named Character Sequences in aregular expressionraises nowre.errorinstead ofTypeError.gh-91595: Fix the comparison of character and integer inside
Tools.gdb.libpython.write_repr(). Patch by Yu Liu.gh-90622: Worker processes for
concurrent.futures.ProcessPoolExecutorare no longer spawned on demand (a feature added in 3.9) when the multiprocessing context start method is"fork"as that can lead to deadlocks in the child processes due to a fork happening while threads are running.gh-91575: Update case-insensitive matching in the
remodule to the latest Unicode version.gh-91581: Remove an unhandled error case in the C implementation of calls to
datetime.fromtimestampwith no time zone (i.e. getting a local time from an epoch timestamp). This should have no user-facing effect other than giving a possibly more accurate error message when called with timestamps that fall on 10000-01-01 in the local time. Patch by Paul Ganssle.bpo-47260: Fix
os.closerange()potentially being a no-op in a Linux seccomp sandbox.bpo-39064:
zipfile.ZipFilenow raiseszipfile.BadZipFileinstead ofValueErrorwhen reading a corrupt zip file in which the central directory offset is negative.bpo-47151: When subprocess tries to use vfork, it now falls back to fork if vfork returns an error. This allows use in situations where vfork isn’t allowed by the OS kernel.
bpo-27929: Fix
asyncio.loop.sock_connect()to only resolve names forsocket.AF_INETorsocket.AF_INET6families. Resolution may not make sense for other families, likesocket.AF_BLUETOOTHandsocket.AF_UNIX.bpo-43323: Fix errors in the
emailmodule if the charset itself contains undecodable/unencodable characters.bpo-47101:
hashlib.algorithms_availablenow lists only algorithms that are provided by activated crypto providers on OpenSSL 3.0. Legacy algorithms are not listed unless the legacy provider has been loaded into the default OSSL context.bpo-46787: Fix
concurrent.futures.ProcessPoolExecutorexception memory leakbpo-45393: Fix the formatting for
await xandnot xin the operator precedence table when using thehelp()system.bpo-46415: Fix ipaddress.ip_{address,interface,network} raising TypeError instead of ValueError if given invalid tuple as address parameter.
bpo-28249: Set
doctest.DocTest.linenotoNonewhen object does not have__doc__.bpo-45138: Fix a regression in the
sqlite3trace callback where bound parameters were not expanded in the passed statement string. The regression was introduced in Python 3.10 by bpo-40318. Patch by Erlend E. Aasland.bpo-44493: Add missing terminated NUL in sockaddr_un’s length
This was potentially observable when using non-abstract AF_UNIX datagram sockets to processes written in another programming language.
bpo-42627: Fix incorrect parsing of Windows registry proxy settings
bpo-36073: Raise
ProgrammingErrorinstead of segfaulting on recursive usage of cursors insqlite3converters. Patch by Sergey Fedoseev.
Documentation¶
gh-86438: Clarify that
-WandPYTHONWARNINGSare matched literally and case-insensitively, rather than as regular expressions, inwarnings.gh-92240: Added release dates for “What’s New in Python 3.X” for 3.0, 3.1, 3.2, 3.8 and 3.10
gh-91888: Add a new
ghrole to the documentation to link to GitHub issues.gh-91783: Document security issues concerning the use of the function
shutil.unpack_archive()gh-91547: Remove “Undocumented modules” page.
bpo-44347: Clarify the meaning of dirs_exist_ok, a kwarg of
shutil.copytree().bpo-38668: Update the introduction to documentation for
os.pathto remove warnings that became irrelevant after the implementations of PEP 383 and PEP 529.bpo-47138: Pin Jinja to a version compatible with Sphinx version 3.2.1.
bpo-46962: All docstrings in code snippets are now wrapped into
PyDoc_STR()to follow the guideline of PEP 7’s Documentation Strings paragraph. Patch by Oleg Iarygin.bpo-26792: Improve the docstrings of
runpy.run_module()andrunpy.run_path(). Original patch by Andrew Brezovsky.bpo-40838: Document that
inspect.getdoc(),inspect.getmodule(), andinspect.getsourcefile()might returnNone.bpo-45790: Adjust inaccurate phrasing in Defining Extension Types: Tutorial about the
ob_basefield and the macros used to access its contents.bpo-42340: Document that in some circumstances
KeyboardInterruptmay cause the code to enter an inconsistent state. Provided a sample workaround to avoid it if needed.bpo-41233: Link the errnos referenced in
Doc/library/exceptions.rstto their respective section inDoc/library/errno.rst, and vice versa. Previously this was only done for EINTR and InterruptedError. Patch by Yan “yyyyyyyan” Orestes.bpo-38056: Overhaul the Error Handlers documentation in
codecs.bpo-13553: Document tkinter.Tk args.
Tests¶
gh-92886: Fixing tests that fail when running with optimizations (
-O) intest_imaplib.py.gh-92670: Skip
test_shutil.TestCopy.test_copyfile_nonexistent_dirtest on AIX as the test uses a trailing slash to force the OS consider the path as a directory, but on AIX the trailing slash has no effect and is considered as a file.gh-91904: Fix initialization of
PYTHONREGRTEST_UNICODE_GUARDwhich prevented running regression tests on non-UTF-8 locale.gh-91607: Fix
test_concurrent_futuresto test the correct multiprocessing start method context in several cases where the test logic mixed this up.bpo-47205: Skip test for
sched_getaffinity()andsched_setaffinity()error case on FreeBSD.bpo-47104: Rewrite
asyncio.to_thread()tests to useunittest.IsolatedAsyncioTestCase.bpo-29890: Add tests for
ipaddress.IPv4Interfaceandipaddress.IPv6Interfaceconstruction with tuple arguments. Original patch and tests by louisom.
Build¶
bpo-47103: Windows
PGInstrumentbuilds now copy a required DLL into the output directory, making it easier to run the profile stage of a PGO build.
Windows¶
gh-92984: Explicitly disable incremental linking for non-Debug builds
bpo-47194: Update
zlibto v1.2.12 to resolve CVE-2018-25032.bpo-46785: Fix race condition between
os.stat()and unlinking a file on Windows, by using errors codes returned byFindFirstFileW()when appropriate inwin32_xstat_impl.bpo-40859: Update Windows build to use xz-5.2.5
Tools/Demos¶
gh-91583: Fix regression in the code generated by Argument Clinic for functions with the
defining_classparameter.
Python 3.10.4 final¶
Release date: 2022-03-23
Core and Builtins¶
bpo-46968: Check for the existence of the “sys/auxv.h” header in
faulthandlerto avoid compilation problems in systems where this header doesn’t exist. Patch by Pablo Galindo
Library¶
bpo-23691: Protect the
re.finditer()iterator from re-entering.bpo-42369: Fix thread safety of
zipfile._SharedFile.tell()to avoid a “zipfile.BadZipFile: Bad CRC-32 for file” exception when reading aZipFilefrom multiple threads.bpo-38256: Fix
binascii.crc32()when it is compiled to use zlib’c crc32 to work properly on inputs 4+GiB in length instead of returning the wrong result. The workaround prior to this was to always feed the function data in increments smaller than 4GiB or to just call the zlib module function.bpo-39394: A warning about inline flags not at the start of the regular expression now contains the position of the flag.
bpo-47061: Deprecate the various modules listed by PEP 594:
aifc, asynchat, asyncore, audioop, cgi, cgitb, chunk, crypt, imghdr, msilib, nntplib, nis, ossaudiodev, pipes, smtpd, sndhdr, spwd, sunau, telnetlib, uu, xdrlib
bpo-2604: Fix bug where doctests using globals would fail when run multiple times.
bpo-45997: Fix
asyncio.Semaphorere-aquiring FIFO order.bpo-47022: The
asynchat,asyncoreandsmtpdmodules have been deprecated since at least Python 3.6. Their documentation and deprecation warnings and have now been updated to note they will removed in Python 3.12 (PEP 594).bpo-46421: Fix a unittest issue where if the command was invoked as
python -m unittestand the filename(s) began with a dot (.), aValueErroris returned.
Python 3.10.3 final¶
Release date: 2022-03-16
Core and Builtins¶
bpo-46940: Avoid overriding
AttributeErrormetadata information for nested attribute access calls. Patch by Pablo Galindo.bpo-46852: Rename the private undocumented
float.__set_format__()method tofloat.__setformat__()to fix a typo introduced in Python 3.7. The method is only used by test_float. Patch by Victor Stinner.bpo-46794: Bump up the libexpat version into 2.4.6
bpo-46820: Fix parsing a numeric literal immediately (without spaces) followed by “not in” keywords, like in
1not in x. Now the parser only emits a warning, not a syntax error.bpo-46762: Fix an assert failure in debug builds when a ‘<’, ‘>’, or ‘=’ is the last character in an f-string that’s missing a closing right brace.
bpo-46724: Make sure that all backwards jumps use the
JUMP_ABSOLUTEinstruction, rather thanJUMP_FORWARDwith an argument of(2**32)+offset.bpo-46732: Correct the docstring for the
__bool__()method. Patch by Jelle Zijlstra.bpo-46707: Avoid potential exponential backtracking when producing some syntax errors involving lots of brackets. Patch by Pablo Galindo.
bpo-40479: Add a missing call to
va_end()inModules/_hashopenssl.c.bpo-46615: When iterating over sets internally in
setobject.c, acquire strong references to the resulting items from the set. This prevents crashes in corner-cases of various set operations where the set gets mutated.bpo-45773: Remove two invalid “peephole” optimizations from the bytecode compiler.
bpo-43721: Fix docstrings of
getter,setter, anddeleterto clarify that they create a new copy of the property.bpo-46503: Fix an assert when parsing some invalid N escape sequences in f-strings.
bpo-46417: Fix a race condition on setting a type
__bases__attribute: the internal functionadd_subclass()now gets thePyTypeObject.tp_subclassesmember after callingPyWeakref_NewRef()which can trigger a garbage collection which can indirectly modifyPyTypeObject.tp_subclasses. Patch by Victor Stinner.bpo-46383: Fix invalid signature of
_zoneinfo’smodule_freefunction to resolve a crash on wasm32-emscripten platform.bpo-46070:
Py_EndInterpreter()now explicitly untracks all objects currently tracked by the GC. Previously, if an object was used later by another interpreter, callingPyObject_GC_UnTrack()on the object crashed if the previous or the next object of thePyGC_Headstructure became a dangling pointer. Patch by Victor Stinner.bpo-46339: Fix a crash in the parser when retrieving the error text for multi-line f-strings expressions that do not start in the first line of the string. Patch by Pablo Galindo
bpo-46240: Correct the error message for unclosed parentheses when the tokenizer doesn’t reach the end of the source when the error is reported. Patch by Pablo Galindo
bpo-46091: Correctly calculate indentation levels for lines with whitespace character that are ended by line continuation characters. Patch by Pablo Galindo
Library¶
bpo-43253: Fix a crash when closing transports where the underlying socket handle is already invalid on the Proactor event loop.
bpo-47004: Apply bugfixes from importlib_metadata 4.11.3, including bugfix for EntryPoint.extras, which was returning match objects and not the extras strings.
bpo-46985: Upgrade pip wheel bundled with ensurepip (pip 22.0.4)
bpo-46968:
faulthandler: On Linux 5.14 and newer, dynamically determine size of signal handler stack size CPython allocates usinggetauxval(AT_MINSIGSTKSZ). This changes allows for Python extension’s request to Linux kernel to use AMX_TILE instruction set on Sapphire Rapids Xeon processor to succeed, unblocking use of the ISA in frameworks.bpo-46955: Expose
asyncio.base_events.Serverasasyncio.Server. Patch by Stefan Zabka.bpo-23325: The
signalmodule no longer assumes thatSIG_IGNandSIG_DFLare small int singletons.bpo-46932: Update bundled libexpat to 2.4.7
bpo-25707: Fixed a file leak in
xml.etree.ElementTree.iterparse()when the iterator is not exhausted. Patch by Jacob Walls.bpo-44886: Inherit asyncio proactor datagram transport from
asyncio.DatagramTransport.bpo-46827: Support UDP sockets in
asyncio.loop.sock_connect()for selector-based event loops. Patch by Thomas Grainger.bpo-46811: Make test suite support Expat >=2.4.5
bpo-46252: Raise
TypeErrorifssl.SSLSocketis passed to transport-based APIs.bpo-46784: Fix libexpat symbols collisions with user dynamically loaded or statically linked libexpat in embedded Python.
bpo-39327:
shutil.rmtree()can now work with VirtualBox shared folders when running from the guest operating-system.bpo-46756: Fix a bug in
urllib.request.HTTPPasswordMgr.find_user_password()andurllib.request.HTTPPasswordMgrWithPriorAuth.is_authenticated()which allowed to bypass authorization. For example, access to URIexample.org/foobarwas allowed if the user was authorized for URIexample.org/foo.bpo-46643: In
typing.get_type_hints(), support evaluating stringifiedParamSpecArgsandParamSpecKwargsannotations. Patch by Gregory Beauregard.bpo-45863: When the
tarfilemodule creates a pax format archive, it will put an integer representation of timestamps in the ustar header (if possible) for the benefit of older unarchivers, in addition to the existing full-precision timestamps in the pax extended header.bpo-46676: Make
typing.ParamSpecargs and kwargs equal to themselves. Patch by Gregory Beauregard.bpo-46672: Fix
NameErrorinasyncio.gather()when initial type check fails.bpo-46655: In
typing.get_type_hints(), support evaluating bare stringifiedTypeAliasannotations. Patch by Gregory Beauregard.bpo-45948: Fixed a discrepancy in the C implementation of the
xml.etree.ElementTreemodule. Now, instantiating anxml.etree.ElementTree.XMLParserwith atarget=Nonekeyword provides a defaultxml.etree.ElementTree.TreeBuildertarget as the Python implementation does.bpo-46521: Fix a bug in the
codeopmodule that was incorrectly identifying invalid code involving string quotes as valid code.bpo-46581: Brings
ParamSpecpropagation forGenericAliasin line withConcatenate(and others).bpo-46591: Make the IDLE doc URL on the About IDLE dialog clickable.
bpo-46400: expat: Update libexpat from 2.4.1 to 2.4.4
bpo-46487: Add the
get_write_buffer_limitsmethod toasyncio.transports.WriteTransportand to the SSL transport.bpo-45173: Note the configparser deprecations will be removed in Python 3.12.
bpo-46539: In
typing.get_type_hints(), support evaluating stringifiedClassVarandFinalannotations insideAnnotated. Patch by Gregory Beauregard.bpo-46491: Allow
typing.Annotatedto wraptyping.Finalandtyping.ClassVar. Patch by Gregory Beauregard.bpo-46436: Fix command-line option
-d/--directoryin modulehttp.serverwhich is ignored when combined with command-line option--cgi. Patch by Géry Ogam.bpo-41403: Make
mock.patch()raise aTypeErrorwith a relevant error message on invalid arg. Previously it allowed a crypticAttributeErrorto escape.bpo-46474: In
importlib.metadata.EntryPoint.pattern, avoid potential REDoS by limiting ambiguity in consecutive whitespace.bpo-46469:
asynciogeneric classes now returntypes.GenericAliasin__class_getitem__instead of the same class.bpo-46434:
pdbnow gracefully handleshelpwhen__doc__is missing, for example when run with pregenerated optimized.pycfiles.bpo-46333: The
__eq__()and__hash__()methods oftyping.ForwardRefnow honor themoduleparameter oftyping.ForwardRef. Forward references from different modules are now differentiated.bpo-46246: Add missing
__slots__toimportlib.metadata.DeprecatedList. Patch by Arie Bovenberg.bpo-46266: Improve day constants in
calendar.Now all constants (
MONDAY…SUNDAY) are documented, tested, and added to__all__.bpo-46232: The
sslmodule now handles certificates with bit strings in DN correctly.bpo-43118: Fix a bug in
inspect.signature()that was causing it to fail on some subclasses of classes with a__text_signature__referencing module globals. Patch by Weipeng Hong.bpo-26552: Fixed case where failing
asyncio.ensure_future()did not close the coroutine. Patch by Kumar Aditya.bpo-21987: Fix an issue with
tarfile.TarFile.getmember()getting a directory name with a trailing slash.bpo-20392: Fix inconsistency with uppercase file extensions in
MimeTypes.guess_type(). Patch by Kumar Aditya.bpo-46080: Fix exception in argparse help text generation if a
argparse.BooleanOptionalActionargument’s default isargparse.SUPPRESSand it hashelpspecified. Patch by Felix Fontein.bpo-44439: Fix
.write()method of a member file inZipFile, when the input data is an object that supports the buffer protocol, the file length may be wrong.bpo-45703: When a namespace package is imported before another module from the same namespace is created/installed in a different
sys.pathlocation while the program is running, calling theimportlib.invalidate_caches()function will now also guarantee the new module is noticed.bpo-24959: Fix bug where
unittestsometimes drops frames from tracebacks of exceptions raised in tests.bpo-44791: Fix substitution of
ParamSpecinConcatenatewith different parameter expressions. Substitution with a list of types returns now a tuple of types. Substitution withConcatenatereturns now aConcatenatewith concatenated lists of arguments.bpo-14156: argparse.FileType now supports an argument of ‘-’ in binary mode, returning the .buffer attribute of sys.stdin/sys.stdout as appropriate. Modes including ‘x’ and ‘a’ are treated equivalently to ‘w’ when argument is ‘-’. Patch contributed by Josh Rosenberg
Documentation¶
bpo-46463: Fixes
escape4chm.pyscript used when building the CHM documentation file
Tests¶
bpo-46913: Fix test_faulthandler.test_sigfpe() if Python is built with undefined behavior sanitizer (UBSAN): disable UBSAN on the faulthandler_sigfpe() function. Patch by Victor Stinner.
bpo-46708: Prevent default asyncio event loop policy modification warning after
test_asyncioexecution.bpo-46678: The function
make_legacy_pycinLib/test/support/import_helper.pyno longer fails whenPYTHONPYCACHEPREFIXis set to a directory on a different device from where tempfiles are stored.bpo-46616: Ensures
test_importlib.test_windowscleans up registry keys after completion.bpo-44359: test_ftplib now silently ignores socket errors to prevent logging unhandled threading exceptions. Patch by Victor Stinner.
bpo-46542: Fix a Python crash in test_lib2to3 when using Python built in debug mode: limit the recursion limit. Patch by Victor Stinner.
bpo-46576: test_peg_generator now disables compiler optimization when testing compilation of its own C extensions to significantly speed up the testing on non-debug builds of CPython.
bpo-46542: Fix
test_jsontests checking forRecursionError: modify these tests to usesupport.infinite_recursion(). Patch by Victor Stinner.bpo-13886: Skip test_builtin PTY tests on non-ASCII characters if the readline module is loaded. The readline module changes input() behavior, but test_builtin is not intented to test the readline module. Patch by Victor Stinner.
Build¶
bpo-47032: Ensure Windows install builds fail correctly with a non-zero exit code when part of the build fails.
bpo-47024: Update OpenSSL to 1.1.1n for macOS installers and all Windows builds.
bpo-38472: Fix GCC detection in setup.py when cross-compiling. The C compiler is now run with LC_ALL=C. Previously, the detection failed with a German locale.
bpo-46513: configure no longer uses
AC_C_CHAR_UNSIGNEDmacro andpyconfig.hno longer defines reserved symbol__CHAR_UNSIGNED__.bpo-45925: Update Windows installer to use SQLite 3.37.2.
Windows¶
bpo-44549: Update bzip2 to 1.0.8 in Windows builds to mitigate CVE-2016-3189 and CVE-2019-12900
bpo-46948: Prevent CVE-2022-26488 by ensuring the Add to PATH option in the Windows installer uses the correct path when being repaired.
bpo-46638: Ensures registry virtualization is consistently disabled. For 3.10 and earlier, it remains enabled (some registry writes are protected), while for 3.11 and later it is disabled (registry modifications affect all applications).
macOS¶
bpo-45925: Update macOS installer to SQLite 3.37.2.
IDLE¶
bpo-46630: Make query dialogs on Windows start with a cursor in the entry box.
bpo-45296: Clarify close, quit, and exit in IDLE. In the File menu, ‘Close’ and ‘Exit’ are now ‘Close Window’ (the current one) and ‘Exit’ is now ‘Exit IDLE’ (by closing all windows). In Shell, ‘quit()’ and ‘exit()’ mean ‘close Shell’. If there are no other windows, this also exits IDLE.
bpo-45447: Apply IDLE syntax highlighting to
pyifiles. Patch by Alex Waygood and Terry Jan Reedy.
C API¶
Python 3.10.2 final¶
Release date: 2022-01-13
Core and Builtins¶
bpo-46347: Fix memory leak in PyEval_EvalCodeEx.
bpo-46289: ASDL declaration of
FormattedValuehas changed to reflectconversionfield is not optional.bpo-46237: Fix the line number of tokenizer errors inside f-strings. Patch by Pablo Galindo.
bpo-46006: Fix a regression when a type method like
__init__()is modified in a subinterpreter. Fix a regression in_PyUnicode_EqualToASCIIId()and typeupdate_slot(). Revert the change which made the Unicode dictionary of interned strings compatible with subinterpreters: the internal interned dictionary is shared again by all interpreters. Patch by Victor Stinner.bpo-46085: Fix iterator cache mechanism of
OrderedDict.bpo-46110: Add a maximum recursion check to the PEG parser to avoid stack overflow. Patch by Pablo Galindo
bpo-46054: Fix parser error when parsing non-utf8 characters in source files. Patch by Pablo Galindo.
bpo-46042: Improve the location of the caret in
SyntaxErrorexceptions emitted by the symbol table. Patch by Pablo Galindo.bpo-46025: Fix a crash in the
atexitmodule involving functions that unregister themselves before raising exceptions. Patch by Pablo Galindo.bpo-46009: Restore behavior from 3.9 and earlier when sending non-None to newly started generator. In 3.9 this did not affect the state of the generator. In 3.10.0 and 3.10.1
gen_func().send(0)is equivalent togen_func().throw(TypeError(...)which exhausts the generator. In 3.10.2 onward, the behavior has been reverted to that of 3.9.bpo-46000: Improve compatibility of the
cursesmodule with NetBSD curses.bpo-46004: Fix the
SyntaxErrorlocation for errors involving for loops with invalid targets. Patch by Pablo Galindobpo-42918: Fix bug where the built-in
compile()function did not always raise aSyntaxErrorwhen passed multiple statements in ‘single’ mode. Patch by Weipeng Hong.
Library¶
bpo-40479: Fix
hashlibusedforsecurity option to work correctly with OpenSSL 3.0.0 in FIPS mode.bpo-46070: Fix possible segfault when importing the
asynciomodule from different sub-interpreters in parallel. Patch by Erlend E. Aasland.bpo-46278: Reflect
contextargument inAbstractEventLoop.call_*()methods. Loop implementations already support it.bpo-46239: Improve error message when importing
asyncio.windows_eventson non-Windows.bpo-20369:
concurrent.futures.wait()no longer blocks forever when given duplicate Futures. Patch by Kumar Aditya.bpo-46105: Honor spec when generating requirement specs with urls and extras (importlib_metadata 4.8.3).
bpo-26952:
argparseraisesValueErrorwith clear message when trying to render usage for an empty mutually-exclusive group. Previously it raised a crypticIndexError.bpo-27718: Fix help for the
signalmodule. Some functions (e.g.signal()andgetsignal()) were omitted.bpo-46032: The
registry()method offunctools.singledispatch()functions checks now the first argument or the first parameter annotation and raises a TypeError if it is not supported. Previously unsupported “types” were ignored (e.g.typing.List[int]) or caused an error at calling time (e.g.list[int]).bpo-46018: Ensure that
math.expm1()does not raise on underflow.bpo-45755:
typinggeneric aliases now reveal the class attributes of the original generic class when passed todir(). This was the behavior up to Python 3.6, but was changed in 3.7-3.9.bpo-13236:
unittest.TextTestResultandunittest.TextTestRunnerflush now the output stream more often.bpo-42378: Fixes the issue with log file being overwritten when
logging.FileHandleris used inatexitwith filemode set to'w'. Note this will cause the message in atexit not being logged if the log stream is already closed due to shutdown of logging.
Documentation¶
bpo-46120: State that
|is preferred for readability overUnionin thetypingdocs.bpo-46040: Fix removal Python version for
@asyncio.coroutine, the correct value is 3.11.bpo-19737: Update the documentation for the
globals()function.bpo-45840: Improve cross-references in the documentation for the data model.
Tests¶
bpo-46205: Fix hang in runtest_mp due to race condition
bpo-46263: Fix test_capi on FreeBSD 14-dev: instruct jemalloc to not fill freed memory with junk byte.
bpo-46150: Now
fakenameintest_pathlib.PosixPathTest.test_expanduseris checked to be non-existent.bpo-46129: Rewrite
asyncio.lockstests withunittest.IsolatedAsyncioTestCaseusage.bpo-46114: Fix test case for OpenSSL 3.0.1 version. OpenSSL 3.0 uses
0xMNN00PP0L.
Build¶
macOS¶
bpo-40477: The Python Launcher app for macOS now properly launches scripts and, if necessary, the Terminal app when running on recent macOS releases.
C API¶
bpo-46236: Fix a bug in
PyFunction_GetAnnotations()that caused it to return atupleinstead of adict.
Python 3.10.1 final¶
Release date: 2021-12-06
Core and Builtins¶
bpo-42268: Fail the configure step if the selected compiler doesn’t support memory sanitizer. Patch by Pablo Galindo
bpo-45727: Refine the custom syntax error that suggests that a comma may be missing to trigger only when the expressions are detected between parentheses or brackets. Patch by Pablo Galindo
bpo-45614: Fix
tracebackdisplay for exceptions with invalid module name.bpo-45848: Allow the parser to obtain error lines directly from encoded files. Patch by Pablo Galindo
bpo-45826: Fixed a crash when calling
.with_traceback(None)onNameError. This occurs internally inunittest.TestCase.assertRaises().bpo-45822: Fixed a bug in the parser that was causing it to not respect PEP 263 coding cookies when no flags are provided. Patch by Pablo Galindo
bpo-45820: Fix a segfault when the parser fails without reading any input. Patch by Pablo Galindo
bpo-42540: Fix crash when
os.fork()is called with an active non-default memory allocator.bpo-45738: Fix computation of error location for invalid continuation characters in the parser. Patch by Pablo Galindo.
bpo-45773: Fix a compiler hang when attempting to optimize certain jump patterns.
bpo-45716: Improve the
SyntaxErrormessage when usingTrue,NoneorFalseas keywords in a function call. Patch by Pablo Galindo.bpo-45688:
sys.stdlib_module_namesnow contains the macOS-specific module_scproxy.bpo-30570: Fixed a crash in
issubclass()from infinite recursion when searching pathological__bases__tuples.bpo-45521: Fix a bug in the obmalloc radix tree code. On 64-bit machines, the bug causes the tree to hold 46-bits of virtual addresses, rather than the intended 48-bits.
bpo-45494: Fix parser crash when reporting errors involving invalid continuation characters. Patch by Pablo Galindo.
bpo-45408: Fix a crash in the parser when reporting tokenizer errors that occur at the same time unclosed parentheses are detected. Patch by Pablo Galindo.
bpo-45385: Fix reference leak from descr_check. Patch by Dong-hee Na.
bpo-45167: Fix deepcopying of
types.GenericAliasobjects.bpo-44219: Release the GIL while performing
isattysystem calls on arbitrary file descriptors. In particular, this affectsos.isatty(),os.device_encoding()andio.TextIOWrapper. By extension,io.open()in text mode is also affected. This change solves a deadlock inos.isatty(). Patch by Vincent Michel in bpo-44219.bpo-44959: Added fallback to extension modules with ‘.sl’ suffix on HP-UX
bpo-44050: Extensions that indicate they use global state (by setting
m_sizeto -1) can again be used in multiple interpreters. This reverts to behavior of Python 3.8.bpo-45121: Fix issue where
Protocol.__init__raisesRecursionErrorwhen it’s called directly or viasuper(). Patch provided by Yurii Karabas.bpo-45083: When the interpreter renders an exception, its name now has a complete qualname. Previously only the class name was concatenated to the module name, which sometimes resulted in an incorrect full name being displayed.
(This issue impacted only the C code exception rendering, the
tracebackmodule was using qualname already).bpo-45056: Compiler now removes trailing unused constants from co_consts.
Library¶
bpo-27946: Fix possible crash when getting an attribute of class:
xml.etree.ElementTree.Elementsimultaneously with replacing theattribdict.bpo-37658: Fix issue when on certain conditions
asyncio.wait_for()may allow a coroutine to complete successfully, but fail to return the result, potentially causing memory leaks or other issues.bpo-44649: Handle dataclass(slots=True) with a field that has default a default value, but for which init=False.
bpo-45803: Added missing kw_only parameter to dataclasses.make_dataclass().
bpo-45831:
faulthandlercan now write ASCII-only strings (like filenames and function names) with a single write() syscall when dumping a traceback. It reduces the risk of getting an unreadable dump when two threads or two processes dump a traceback to the same file (like stderr) at the same time. Patch by Victor Stinner.bpo-41735: Fix thread lock in
zlib.Decompress.flush()method beforePyObject_GetBuffer.bpo-45235: Reverted an argparse bugfix that caused regression in the handling of default arguments for subparsers. This prevented leaf level arguments from taking precedence over root level arguments.
bpo-45765: In importlib.metadata, fix distribution discovery for an empty path.
bpo-45757: Fix bug where
disproduced an incorrect oparg whenEXTENDED_ARGis followed by an opcode that does not use its argument.bpo-45644: In-place JSON file formatting using
python3 -m json.tool infile infilenow works correctly, previously it left the file empty. Patch by Chris Wesseling.bpo-45679: Fix caching of multi-value
typing.Literal.Literal[True, 2]is no longer equal toLiteral[1, 2].bpo-45664: Fix
types.resolve_bases()andtypes.new_class()fortypes.GenericAliasinstance as a base.bpo-45663: Fix
dataclasses.is_dataclass()for dataclasses which are subclasses oftypes.GenericAlias.bpo-45662: Fix the repr of
dataclasses.InitVarwith a type alias to the built-in class, e.g.InitVar[list[int]].bpo-45438: Fix typing.Signature string representation for generic builtin types.
bpo-45574: Fix warning about
print_escapebeing unused.bpo-45581:
sqlite3.connect()now correctly raisesMemoryErrorif the underlying SQLite API signals memory error. Patch by Erlend E. Aasland.bpo-45557: pprint.pprint() now handles underscore_numbers correctly. Previously it was always setting it to False.
bpo-45515: Add references to
zoneinfoin thedatetimedocumentation, mostly replacing outdated references todateutil.tz. Change by Paul Ganssle.bpo-45475: Reverted optimization of iterating
gzip.GzipFile,bz2.BZ2File, andlzma.LZMAFile(see bpo-43787) because it caused regression when user iterate them without having reference of them. Patch by Inada Naoki.bpo-45428: Fix a regression in py_compile when reading filenames from standard input.
bpo-45467: Fix incremental decoder and stream reader in the “raw-unicode-escape” codec. Previously they failed if the escape sequence was split.
bpo-45461: Fix incremental decoder and stream reader in the “unicode-escape” codec. Previously they failed if the escape sequence was split.
bpo-45239: Fixed
email.utils.parsedate_tz()crashing withUnboundLocalErroron certain invalid input instead of returningNone. Patch by Ben Hoyt.bpo-45249: Fix the behaviour of
traceback.print_exc()when displaying the caret when theend_offsetin the exception is set to 0. Patch by Pablo Galindobpo-45416: Fix use of
asyncio.Conditionwith explicitasyncio.Lockobjects, which was a regression due to removal of explicit loop arguments. Patch by Joongi Kim.bpo-45419: Correct interfaces on DegenerateFiles.Path.
bpo-44904: Fix bug in the
doctestmodule that caused it to fail if a docstring included an example with aclassmethodproperty. Patch by Alex Waygood.bpo-45406: Make
inspect.getmodule()catchFileNotFoundErrorraised by :’func:inspect.getabsfile, and returnNoneto indicate that the module could not be determined.bpo-45262: Prevent use-after-free in asyncio. Make sure the cached running loop holder gets cleared on dealloc to prevent use-after-free in get_running_loop
bpo-45386: Make
xmlrpc.clientmore robust to C runtimes where the underlying Cstrftimefunction results in aValueErrorwhen testing for year formatting options.bpo-45371: Fix clang rpath issue in
distutils. The UnixCCompiler now uses correct clang option to add a runtime library directory (rpath) to a shared library.bpo-20028: Improve error message of
csv.Dialectwhen initializing. Patch by Vajrasky Kok and Dong-hee Na.bpo-45343: Update bundled pip to 21.2.4 and setuptools to 58.1.0
bpo-45329: Fix freed memory access in
pyexpat.xmlparserwhen building it with an installed expat library <= 2.2.0.bpo-41710: On Unix, if the
sem_clockwait()function is available in the C library (glibc 2.30 and newer), thethreading.Lock.acquire()method now uses the monotonic clock (time.CLOCK_MONOTONIC) for the timeout, rather than using the system clock (time.CLOCK_REALTIME), to not be affected by system clock changes. Patch by Victor Stinner.bpo-45328: Fixed
http.client.HTTPConnectionto work properly in OSs that don’t support theTCP_NODELAYsocket option.bpo-1596321: Fix the
threading._shutdown()function when thethreadingmodule was imported first from a thread different than the main thread: no longer log an error at Python exit.bpo-45274: Fix a race condition in the
Thread.join()method of thethreadingmodule. If the function is interrupted by a signal and the signal handler raises an exception, make sure that the thread remains in a consistent state to prevent a deadlock. Patch by Victor Stinner.bpo-45238: Fix
unittest.IsolatedAsyncioTestCase.debug(): it runs now asynchronous methods and callbacks.bpo-36674:
unittest.TestCase.debug()raises now aunittest.SkipTestif the class or the test method are decorated with the skipping decorator.bpo-45235: Fix an issue where argparse would not preserve values in a provided namespace when using a subparser with defaults.
bpo-45183: Have zipimport.zipimporter.find_spec() not raise an exception when the underlying zip file has been deleted and the internal cache has been reset via invalidate_cache().
bpo-45234: Fixed a regression in
copyfile(),copy(),copy2()raisingFileNotFoundErrorwhen source is a directory, which should raiseIsADirectoryErrorbpo-45228: Fix stack buffer overflow in parsing J1939 network address.
bpo-45192: Fix the
tempfile._infer_return_typefunction so that thedirargument of thetempfilefunctions accepts an object implementing theos.PathLikeprotocol.Patch by Kyungmin Lee.
bpo-42135: Fix typo:
importlib.find_loaderis really slated for removal in Python 3.12 not 3.10, like the others in PR 25169.Patch by Hugo van Kemenade.
bpo-45160: When tracing a tkinter variable used by a ttk OptionMenu, callbacks are no longer made twice.
bpo-35474: Calling
mimetypes.guess_all_extensions()withstrict=Falseno longer affects the result of the following call withstrict=True. Also, mutating the returned list no longer affects the global state.bpo-45166:
typing.get_type_hints()now works withFinalwrapped inForwardRef.bpo-20499: Improve the speed and accuracy of statistics.pvariance().
bpo-24444: Fixed an error raised in
argparsehelp display when help for an option is set to 1+ blank spaces or when choices arg is an empty container.bpo-45021: Fix a potential deadlock at shutdown of forked children when using
concurrent.futuresmodulebpo-39039: tarfile.open raises
ReadErrorwhen a zlib error occurs during file extraction.bpo-44594: Fix an edge case of
ExitStackandAsyncExitStackexception chaining. They will now matchwithblock behavior when__context__is explicitly set toNonewhen the exception is in flight.bpo-44295: Ensure deprecation warning from
assertDictContainsSubset()points at calling code - by Anthony Sottile.bpo-43498: Avoid a possible “RuntimeError: dictionary changed size during iteration” when adjusting the process count of
ProcessPoolExecutor.
Documentation¶
bpo-45640: Properly marked-up grammar tokens in the documentation are now clickable and take you to the definition of a given piece of grammar. Patch by Arthur Milchior.
bpo-45788: Link doc for sys.prefix to sysconfig doc on installation paths.
bpo-45772:
socket.socketdocumentation is corrected to a class from a function.bpo-45392: Update the docstring of the
typebuilt-in to remove a redundant line and to mention keyword arguments for the constructor.bpo-45726: Improve documentation for
functools.singledispatch()andfunctools.singledispatchmethod.bpo-45680: Amend the docs on
GenericAliasobjects to clarify that non-container classes can also implement__class_getitem__. Patch contributed by Alex Waygood.bpo-45655: Add a new “relevant PEPs” section to the top of the documentation for the
typingmodule. Patch by Alex Waygood.bpo-45604: Add
levelargument tomultiprocessing.log_to_stderrfunction docs.bpo-45250: Update the documentation to note that CPython does not consistently require iterators to define
__iter__.bpo-45464: Mention in the documentation of Built-in Exceptions that inheriting from multiple exception types in a single subclass is not recommended due to possible memory layout incompatibility.
bpo-45449: Add note about PEP 585 in
collections.abc.bpo-45516: Add protocol description to the
importlib.abc.Traversabledocumentation.bpo-20692: Add Programming FAQ entry explaining that int literal attribute access requires either a space after or parentheses around the literal.
bpo-45216: Remove extra documentation listing methods in
difflib. It was rendering twice in pydoc and was outdated in some places.bpo-45024:
collections.abcdocumentation has been expanded to explicitly cover how instance and subclass checks work, with additional doctest examples and an exhaustive list of ABCs which test membership purely by presence of the right special methods. Patch by Raymond Hettinger.bpo-25381: In the extending chapter of the extending doc, update a paragraph about the global variables containing exception information.
bpo-43905: Expanded
astuple()andasdict()docs, warning about deepcopy being applied and providing a workaround.
Tests¶
bpo-19460: Add new Test for
email.mime.nonmultipart.MIMENonMultipart.bpo-45835: Fix race condition in test_queue tests with multiple “feeder” threads.
bpo-45678: Add tests for scenarios in which
functools.singledispatchmethodis stacked on top of a method that has already been wrapped by two other decorators. Patch by Alex Waygood.bpo-45578: Add tests for
dis.distb()bpo-45678: Add tests to ensure that
functools.singledispatchmethodcorrectly wraps the attributes of the target function.bpo-45577: Add subtests for all
pickleprotocols intest_zoneinfo.bpo-45566: Fix
test_frozen_pickleintest_dataclassesto check allpickleversions.bpo-43592:
test.libregrtestnow raises the soft resource limit for the maximum number of file descriptors when the default is too low for our test suite as was often the case on macOS.bpo-39679: Add more test cases for
@functools.singledispatchmethodwhen combined with@classmethodor@staticmethod.bpo-45400: Fix test_name_error_suggestions_do_not_trigger_for_too_many_locals() of test_exceptions if a directory name contains “a1” (like “Python-3.11.0a1”): use a stricter regular expression. Patch by Victor Stinner.
bpo-40173: Fix
test.support.import_helper.import_fresh_module().bpo-45280: Add a test case for empty
typing.NamedTuple.bpo-45269: Cover case when invalid
markerstype is supplied toc_make_encoder.bpo-45128: Fix
test_multiprocessing_forkfailure due totest_loggingandsys.modulesmanipulation.bpo-45209: Fix
UserWarning: resource_trackerwarning in_test_multiprocessing._TestSharedMemory.test_shared_memory_cleaned_after_process_terminationbpo-45195: Fix test_readline.test_nonascii(): sometimes, the newline character is not written at the end, so don’t expect it in the output. Patch by Victor Stinner.
bpo-45156: Fixes infinite loop on
unittest.mock.seal()of mocks created bycreate_autospec().bpo-45125: Improves pickling tests and docs of
SharedMemoryandSharableListobjects.bpo-44860: Update
test_sysconfig.test_user_similar()for the posix_user scheme:platlibdoesn’t usesys.platlibdir. Patch by Victor Stinner.bpo-25130: Add calls of
gc.collect()in tests to support PyPy.
Build¶
bpo-44035: CI now verifies that autoconf files have been regenerated with a current and unpatched autoconf package.
bpo-33393: Update
config.guessto 2021-06-03 andconfig.subto 2021-08-14.Makefilenow has anupdate-configtarget to make updating more convenient.bpo-45866:
make regen-allnow produces the same output when run from a directory other than the source tree: when building Python out of the source tree. pegen now strips directory of the “generated by pygen from <FILENAME>” header Patch by Victor Stinner.bpo-41498: Python now compiles on platforms without
sigset_t. Several functions insignalare not available whensigset_tis missing.Based on patch by Roman Yurchak for pyodide.
bpo-45881:
setup.pynow usesCCfrom environment first to discover multiarch and cross compile paths.bpo-43158:
setup.pynow uses values from configure script to build the_uuidextension module. Configure now detects util-linux’slibuuid, too.bpo-45571:
Modules/Setupnow usePY_CFLAGS_NODISTinstead ofPY_CFLAGSto compile shared modules.bpo-45561: Run smelly.py tool from $(srcdir).
bpo-45532: Update
sys.versionto usemainas fallback information. Patch by Jeong YunWon.bpo-45536: The
configurescript now checks whether OpenSSL headers and libraries provide required APIs. Most common APIs are verified. The check detects outdated or missing OpenSSL. Failures do not stop configure.bpo-45221: Fixed regression in handling of
LDFLAGSandCPPFLAGSoptions whereargparse.parse_known_args()could interpret an option as one of the built-in command line argument, for example-hfor help.bpo-45405: Prevent
internal configure errorwhen runningconfigurewith recent versions of non-Apple clang. Patch by David Bohman.bpo-45220: Avoid building with the Windows 11 SDK previews automatically. This may be overridden by setting the
DefaultWindowsSDKVersionenvironment variable before building.bpo-45067: The ncurses function extended_color_content was introduced in 2017
(https://invisible-island.net/ncurses/NEWS.html#index-t20170401). The
ncurses-devel package in CentOS 7 had a older version ncurses resulted in compilation error. For compiling ncurses with extended color support, we verify the version of the ncurses library >= 20170401.
Windows¶
bpo-45901: When installed through the Microsoft Store and set as the default app for
*.pyfiles, command line arguments will now be passed to Python when invoking a script without explicitly launching Python (that is,script.py argsrather thanpython script.py args).bpo-45616: Fix Python Launcher’s ability to distinguish between versions 3.1 and 3.10 when either one is explicitly requested. Previously, 3.1 would be used if 3.10 was requested but not installed, and 3.10 would be used if 3.1 was requested but 3.10 was installed.
bpo-45732: Updates bundled Tcl/Tk to 8.6.12.
bpo-45720: Internal reference to
shlwapi.dllwas dropped to help improve startup time. This DLL will no longer be loaded at the start of every Python process.bpo-43652: Update Tcl/Tk to 8.6.11, actually this time. The previous update incorrectly included 8.6.10.
bpo-45337: venv now warns when the created environment may need to be accessed at a different path, due to redirections, links or junctions. It also now correctly installs or upgrades components when the alternate path is required.
macOS¶
bpo-45732: Update python.org macOS installer to use Tcl/Tk 8.6.12.
bpo-44828: Avoid tkinter file dialog failure on macOS 12 Monterey when using the Tk 8.6.11 provided by python.org macOS installers. Patch by Marc Culler of the Tk project.
bpo-34602: When building CPython on macOS with
./configure --with-undefined-behavior-sanitizer --with-pydebug, the stack size is now quadrupled to allow for the entire test suite to pass.
IDLE¶
Tools/Demos¶
bpo-44786: Fix a warning in regular expression in the c-analyzer script.
C API¶
bpo-39026: Fix Python.h to build C extensions with Xcode: remove a relative include from
Include/cpython/pystate.h.bpo-45307: Restore the private C API function
_PyImport_FindExtensionObject(). It will be removed in Python 3.11.bpo-44687:
BufferedReader.peek()no longer raisesValueErrorwhen the entire file has already been buffered.bpo-44751: Remove
crypt.hinclude from the publicPython.hheader.
Python 3.10.0 final¶
Release date: 2021-10-04
Core and Builtins¶
bpo-45121: Fix issue where
Protocol.__init__raisesRecursionErrorwhen it’s called directly or viasuper(). Patch provided by Yurii Karabas.
Library¶
bpo-45234: Fixed a regression in
copyfile(),copy(),copy2()raisingFileNotFoundErrorwhen source is a directory, which should raiseIsADirectoryError
Documentation¶
bpo-45216: Remove extra documentation listing methods in
difflib. It was rendering twice in pydoc and was outdated in some places.bpo-45024:
collections.abcdocumentation has been expanded to explicitly cover how instance and subclass checks work, with additional doctest examples and an exhaustive list of ABCs which test membership purely by presence of the right special methods. Patch by Raymond Hettinger.
Tests¶
bpo-45128: Fix
test_multiprocessing_forkfailure due totest_loggingandsys.modulesmanipulation.bpo-44860: Update
test_sysconfig.test_user_similar()for the posix_user scheme:platlibdoesn’t usesys.platlibdir. Patch by Victor Stinner.
Build¶
bpo-45067: The ncurses function extended_color_content was introduced in 2017
(https://invisible-island.net/ncurses/NEWS.html#index-t20170401). The
ncurses-devel package in CentOS 7 had a older version ncurses resulted in compilation error. For compiling ncurses with extended color support, we verify the version of the ncurses library >= 20170401.
IDLE¶
bpo-45193: Make completion boxes appear on Ubuntu again.
C API¶
bpo-45307: Restore the private C API function
_PyImport_FindExtensionObject(). It will be removed in Python 3.11.
Python 3.10.0 release candidate 2¶
Release date: 2021-09-07
Security¶
bpo-42278: Replaced usage of
tempfile.mktemp()withTemporaryDirectoryto avoid a potential race condition.bpo-44394: Update the vendored copy of libexpat to 2.4.1 (from 2.2.8) to get the fix for the CVE-2013-0340 “Billion Laughs” vulnerability. This copy is most used on Windows and macOS.
bpo-43124: Made the internal
putcmdfunction insmtplibsanitize input for presence of\rand\ncharacters to avoid (unlikely) command injection.
Core and Builtins¶
bpo-45123: Fix PyAiter_Check to only check for the __anext__ presence (not for __aiter__). Rename PyAiter_Check to PyAIter_Check, PyObject_GetAiter -> PyObject_GetAIter.
bpo-45018: Fixed pickling of range iterators that iterated for over 2**32 times.
bpo-45000: A
SyntaxErroris now raised when trying to delete__debug__. Patch by Dong-hee Na.bpo-44963: Implement
send()andthrow()methods foranext_awaitableobjects. Patch by Pablo Galindo.bpo-44962: Fix a race in WeakKeyDictionary, WeakValueDictionary and WeakSet when two threads attempt to commit the last pending removal. This fixes asyncio.create_task and fixes a data loss in asyncio.run where shutdown_asyncgens is not run
bpo-44954: Fixed a corner case bug where the result of
float.fromhex('0x.8p-1074')was rounded the wrong way.bpo-44947: Refine the syntax error for trailing commas in import statements. Patch by Pablo Galindo.
bpo-44698: Restore behaviour of complex exponentiation with integer-valued exponent of type
floatorcomplex.bpo-44885: Correct the ast locations of f-strings with format specs and repeated expressions. Patch by Pablo Galindo
bpo-44872: Use new trashcan macros (Py_TRASHCAN_BEGIN/END) in frameobject.c instead of the old ones (Py_TRASHCAN_SAFE_BEGIN/END).
bpo-33930: Fix segmentation fault with deep recursion when cleaning method objects. Patch by Augusto Goulart and Pablo Galindo.
bpo-25782: Fix bug where
PyErr_SetObjecthangs when the current exception has a cycle in its context chain.bpo-44856: Fix reference leaks in the error paths of
update_bases()and__build_class__. Patch by Pablo Galindo.bpo-44838: Fixed a bug that was causing the parser to raise an incorrect custom
SyntaxErrorfor invalid ‘if’ expressions. Patch by Pablo Galindo.bpo-44584: The threading debug (
PYTHONTHREADDEBUGenvironment variable) is deprecated in Python 3.10 and will be removed in Python 3.12. This feature requires a debug build of Python. Patch by Victor Stinner.bpo-39091: Fix crash when using passing a non-exception to a generator’s
throw()method. Patch by Noah Oxer
Library¶
bpo-45081: Fix issue when dataclasses that inherit from
typing.Protocolsubclasses have wrong__init__. Patch provided by Yurii Karabas.bpo-41620:
run()now always return aTestResultinstance. Previously it returnedNoneif the test class or method was decorated with a skipping decorator.bpo-43913: Fix bugs in cleaning up classes and modules in
unittest:Functions registered with
addModuleCleanup()were not called unless the user definestearDownModule()in their test module.Functions registered with
addClassCleanup()were not called iftearDownClassis set toNone.Buffering in
TestResultdid not work with functions registered withaddClassCleanup()andaddModuleCleanup().Errors in functions registered with
addClassCleanup()andaddModuleCleanup()were not handled correctly in buffered and debug modes.Errors in
setUpModule()and functions registered withaddModuleCleanup()were reported in wrong order.And several lesser bugs.
bpo-45030: Fix integer overflow in pickling and copying the range iterator.
bpo-45001: Made email date parsing more robust against malformed input, namely a whitespace-only
Date:header. Patch by Wouter Bolsterlee.bpo-44449: Fix a crash in the signal handler of the
faulthandlermodule: no longer modify the reference count of frame objects. Patch by Victor Stinner.bpo-44955: Method
stopTestRun()is now always called in pair with methodstartTestRun()forTestResultobjects implicitly created inrun(). Previously it was not called for test methods and classes decorated with a skipping decorator.bpo-44935:
subprocesson Solaris now also usesos.posix_spawn()for better performance.bpo-44911:
IsolatedAsyncioTestCasewill no longer throw an exception while cancelling leaked tasks. Patch by Bar Harel.bpo-44524: Make exception message more useful when subclass from typing special form alias. Patch provided by Yurii Karabas.
bpo-38956:
argparse.BooleanOptionalAction’s default value is no longer printed twice when used withargparse.ArgumentDefaultsHelpFormatter.bpo-44860: Fix the
posix_userscheme insysconfigto not depend onsys.platlibdir.bpo-44581: Upgrade bundled pip to 21.2.3 and setuptools to 57.4.0
bpo-44849: Fix the
os.set_inheritable()function on FreeBSD 14 for file descriptor opened with theO_PATHflag: ignore theEBADFerror onioctl(), fallback on thefcntl()implementation. Patch by Victor Stinner.bpo-44605: The @functools.total_ordering() decorator now works with metaclasses.
bpo-44524: Fixed an issue wherein the
__name__and__qualname__attributes of subscribed specialforms could beNone.bpo-44822:
sqlite3user-defined functions and aggregators returningstringswith embedded NUL characters are no longer truncated. Patch by Erlend E. Aasland.bpo-44801: Ensure that the
ParamSpecvariable in Callable can only be substituted with a parameters expression (a list of types, an ellipsis, ParamSpec or Concatenate).bpo-27334: The
sqlite3context manager now performs a rollback (thus releasing the database lock) if commit failed. Patch by Luca Citi and Erlend E. Aasland.bpo-41402: Fix
email.message.EmailMessage.set_content()when called with binary data and7bitcontent transfer encoding.bpo-32695: The compresslevel and preset keyword arguments of
tarfile.open()are now both documented and tested.bpo-34990: Fixed a Y2k38 bug in the compileall module where it would fail to compile files with a modification time after the year 2038.
bpo-38840: Fix
test___all__on platforms lacking a shared memory implementation.bpo-26228: pty.spawn no longer hangs on FreeBSD, macOS, and Solaris.
bpo-33349: lib2to3 now recognizes async generators everywhere.
Documentation¶
bpo-44957: Promote PEP 604 union syntax by using it where possible. Also, mention
X | Ymore prominently in section aboutUnionand mentionX | Noneat all in section aboutOptional.bpo-44903: Removed the othergui.rst file, any references to it, and the list of GUI frameworks in the FAQ. In their place I’ve added links to the Python Wiki
page on GUI frameworks.bpo-33479: Tkinter documentation has been greatly expanded with new “Architecture” and “Threading model” sections.
bpo-36700:
base64RFC references were updated to point to RFC 4648; a section was added to point users to the new “security considerations” section of the RFC.bpo-44756: Reverted automated virtual environment creation on
make htmlwhen building documentation. It turned out to be disruptive for downstream distributors.bpo-42958: Updated the docstring and docs of
filecmp.cmp()to be more accurate and less confusing especially in respect to shallow arg.bpo-43066: Added a warning to
zipfiledocs: filename arg with a leading slash may cause archive to be un-openable on Windows systems.bpo-39452: Rewrote
Doc/library/__main__.rst. Broadened scope of the document to explicitly discuss and differentiate between__main__.pyin packages versus the__name__ == '__main__'expression (and the idioms that surround it).bpo-27752: Documentation of csv.Dialect is more descriptive.
bpo-41576: document BaseException in favor of bare except
bpo-39498: Add a “Security Considerations” index which links to standard library modules that have explicitly documented security considerations.
bpo-33479: Remove the unqualified claim that tkinter is threadsafe. It has not been true for several years and likely never was. An explanation of what is true may be added later, after more discussion, and possibly after patching _tkinter.c,
Tests¶
bpo-45052:
WithProcessesTestSharedMemory.test_shared_memory_basicstest was ignored, becauseself.assertEqual(sms.size, sms2.size)line was failing. It is now removed and test is unskipped.The main motivation for this line to be removed from the test is that the
sizeofSharedMemoryis not ever guaranteed to be the same. It is decided by the platform.bpo-45042: Fixes that test classes decorated with
@hashlib_helper.requires_hashdigestwere skipped all the time.bpo-45011: Made tests relying on the
_asyncioC extension module optional to allow running on alternative Python implementations. Patch by Serhiy Storchaka.bpo-44949: Fix auto history tests of test_readline: sometimes, the newline character is not written at the end, so don’t expect it in the output.
bpo-44891: Tests were added to clarify
id()is preserved whenobj * 1is used onstrandbytesobjects. Patch by Nikita Sobolev.bpo-44852: Add ability to wholesale silence DeprecationWarnings while running the regression test suite.
bpo-40928: Notify users running test_decimal regression tests on macOS of potential harmless “malloc can’t allocate region” messages spewed by test_decimal.
Windows¶
bpo-45007: Update to OpenSSL 1.1.1l in Windows build
macOS¶
bpo-45007: Update macOS installer builds to use OpenSSL 1.1.1l.
bpo-44689:
ctypes.util.find_library()now works correctly on macOS 11 Big Sur even if Python is built on an older version of macOS. Previously, when built on older macOS systems,find_librarywas not able to find macOS system libraries when running on Big Sur due to changes in how system libraries are stored.
Python 3.10.0 release candidate 1¶
Release date: 2021-08-02
Security¶
Core and Builtins¶
bpo-44792: Improve syntax errors for if expressions. Patch by Miguel Brito
bpo-34013: Generalize the invalid legacy statement custom error message (like the one generated when “print” is called without parentheses) to include more generic expressions. Patch by Pablo Galindo
bpo-44732: Rename
types.Uniontotypes.UnionType.bpo-44698: Fix undefined behaviour in complex object exponentiation.
bpo-44653: Support
typingtypes in parameter substitution in the union type.bpo-44676: Add ability to serialise
types.Unionobjects. Patch provided by Yurii Karabas.bpo-44633: Parameter substitution of the union type with wrong types now raises
TypeErrorinstead of returningNotImplemented.bpo-44662: Add
__module__totypes.Union. This also fixestypes.Unionissues withtyping.Annotated. Patch provided by Yurii Karabas.bpo-44655: Include the name of the type in unset __slots__ attribute errors. Patch by Pablo Galindo
bpo-44655: Don’t include a missing attribute with the same name as the failing one when offering suggestions for missing attributes. Patch by Pablo Galindo
bpo-44646: Fix the hash of the union type: it no longer depends on the order of arguments.
bpo-44636: Collapse union of equal types. E.g. the result of
int | intis nowint. Fix comparison of the union type with non-hashable objects. E.g.int | str == {}no longer raises a TypeError.bpo-44635: Convert
Nonetotype(None)in the union type constructor.bpo-44589: Mapping patterns in
matchstatements with two or more equal literal keys will now raise aSyntaxErrorat compile-time.bpo-44606: Fix
__instancecheck__and__subclasscheck__for the union type.bpo-42073: The
@classmethoddecorator can now wrap other classmethod-like descriptors.bpo-44490:
typingnow searches for type parameters intypes.Unionobjects.get_type_hintswill also properly resolve annotations with nestedtypes.Unionobjects. Patch provided by Yurii Karabas.bpo-44490: Add
__parameters__attribute and__getitem__operator totypes.Union. Patch provided by Yurii Karabas.bpo-44472: Fix ltrace functionality when exceptions are raised. Patch by Pablo Galindo
Library¶
bpo-44806: Non-protocol subclasses of
typing.Protocolignore now the__init__method inherited from protocol base classes.bpo-44793: Fix checking the number of arguments when subscribe a generic type with
ParamSpecparameter.bpo-44784: In importlib.metadata tests, override warnings behavior under expected DeprecationWarnings (importlib_metadata 4.6.3).
bpo-44667: The
tokenize.tokenize()doesn’t incorrectly generate aNEWLINEtoken if the source doesn’t end with a new line character but the last line is a comment, as the function is already generating aNLtoken. Patch by Pablo Galindobpo-44752:
rcompleterdoes not callgetattr()onpropertyobjects to avoid the side-effect of evaluating the corresponding method.bpo-44720:
weakref.proxyobjects referencing non-iterators now raiseTypeErrorrather than dereferencing the nulltp_iternextslot and crashing.bpo-44704: The implementation of
collections.abc.Set._hash()now matches that offrozenset.__hash__().bpo-44666: Fixed issue in
compileall.compile_file()whensys.stdoutis redirected. Patch by Stefan Hölzl.bpo-42854: Fixed a bug in the
_sslmodule that was throwingOverflowErrorwhen using_ssl._SSLSocket.write()and_ssl._SSLSocket.read()for a big value of thelenparameter. Patch by Pablo Galindobpo-44353: Refactor
typing.NewTypefrom function into callable class. Patch provided by Yurii Karabas.bpo-44524: Add missing
__name__and__qualname__attributes totypingmodule classes. Patch provided by Yurii Karabas.bpo-40897: Give priority to using the current class constructor in
inspect.signature(). Patch by Weipeng Hong.bpo-44648: Fixed wrong error being thrown by
inspect.getsource()when examining a class in the interactive session. Instead ofTypeError, it should beOSErrorwith appropriate error message.bpo-44608: Fix memory leak in
_tkinter._flatten()if it is called with a sequence or set, but not list or tuple.bpo-44559: [Enum] module reverted to 3.9; 3.10 changes pushed until 3.11
bpo-41928: Update
shutil.copyfile()to raiseFileNotFoundErrorinstead of confusingIsADirectoryErrorwhen a path ending with aos.path.sepdoes not exist;shutil.copy()andshutil.copy2()are also affected.bpo-44566: handle StopIteration subclass raised from @contextlib.contextmanager generator
bpo-41249: Fixes
TypedDictto work withtyping.get_type_hints()and postponed evaluation of annotations across modules.bpo-44461: Fix bug with
pdb’s handling of import error due to a package which does not have a__main__modulebpo-43625: Fix a bug in the detection of CSV file headers by
csv.Sniffer.has_header()and improve documentation of same.bpo-42892: Fixed an exception thrown while parsing a malformed multipart email by
email.message.EmailMessage.bpo-27827:
pathlib.PureWindowsPath.is_reserved()now identifies a greater range of reserved filenames, including those with trailing spaces or colons.bpo-38741:
configparser: using ‘]’ inside a section header will no longer cut the section name short at the ‘]’bpo-27513:
email.utils.getaddresses()now acceptsemail.header.Headerobjects along with string values. Patch by Zackery Spytz.bpo-29298: Fix
TypeErrorwhen required subparsers withoutdestdo not receive arguments. Patch by Anthony Sottile.
Documentation¶
bpo-44740: Replaced occurences of uppercase “Web” and “Internet” with lowercase versions per the 2016 revised Associated Press Style Book.
bpo-44693: Update the definition of __future__ in the glossary by replacing the confusing word “pseudo-module” with a more accurate description.
bpo-35183: Add typical examples to os.path.splitext docs
bpo-30511: Clarify that
shutil.make_archive()is not thread-safe due to reliance on changing the current working directory.bpo-44561: Update of three expired hyperlinks in Doc/distributing/index.rst: “Project structure”, “Building and packaging the project”, and “Uploading the project to the Python Packaging Index”.
bpo-44613: importlib.metadata is no longer provisional.
bpo-44544: List all kwargs for
textwrap.wrap(),textwrap.fill(), andtextwrap.shorten(). Now, there are nav links to attributes ofTextWrap, which makes navigation much easier while minimizing duplication in the documentation.bpo-44453: Fix documentation for the return type of
sysconfig.get_path().
Tests¶
bpo-44734: Fixed floating point precision issue in turtle tests.
bpo-44708: Regression tests, when run with -w, are now re-running only the affected test methods instead of re-running the entire test file.
bpo-44647: Added a permanent Unicode-valued environment variable to regression tests to ensure they handle this use case in the future. If your test environment breaks because of that, report a bug to us, and temporarily set PYTHONREGRTEST_UNICODE_GUARD=0 in your test environment.
bpo-44515: Adjust recently added contextlib tests to avoid assuming the use of a refcounted GC
Windows¶
bpo-44572: Avoid consuming standard input in the
platformmodulebpo-40263: This is a follow-on bug from https://bugs.python.org/issue26903. Once that is applied we run into an off-by-one assertion problem. The assert was not correct.
macOS¶
Tools/Demos¶
bpo-44756: In the Makefile for documentation (
Doc/Makefile), thebuildrule is dependent on thevenvrule. Therefore,html,latex, and other build-dependent rules are also now dependent onvenv. Thevenvrule only performs an action if$(VENVDIR)does not exist.Doc/README.rstwas updated; most users now only need to typemake html.
C API¶
bpo-41103: Reverts removal of the old buffer protocol because they are part of stable ABI.
bpo-42747: The
Py_TPFLAGS_HAVE_VERSION_TAGtype flag now does nothing. ThePy_TPFLAGS_HAVE_AM_SENDflag (which was added in 3.10) is removed. Both were unnecessary because it is not possible to have type objects with the relevant fields missing.
Python 3.10.0 beta 4¶
Release date: 2021-07-10
Security¶
bpo-41180: Add auditing events to the
marshalmodule, and stop raisingcode.__init__events for every unmarshalled code object. Directly instantiated code objects will continue to raise an event, and audit event handlers should inspect or collect the raw marshal data. This reduces a significant performance overhead when loading from.pycfiles.
Core and Builtins¶
bpo-44562: Remove uses of
PyObject_GC_Del()in error path when initializingtypes.GenericAlias.bpo-41486: Fix a memory consumption and copying performance regression in earlier 3.10 beta releases if someone used an output buffer larger than 4GiB with zlib.decompress on input data that expands that large.
bpo-44553: Implement GC methods for
types.Unionto break reference cycles and prevent memory leaks.bpo-44523: Remove the pass-through for
hash()ofweakref.proxyobjects to prevent unintended consequences when the original referred object dies while the proxy is part of a hashable object. Patch by Pablo Galindo.bpo-44483: Fix a crash in
types.Unionobjects when creating a union of an object with bad__module__field.bpo-44297: Make sure that the line number is set when entering a comprehension scope. Ensures that backtraces inclusing generator expressions show the correct line number.
bpo-44456: Improve the syntax error when mixing positional and keyword patterns. Patch by Pablo Galindo.
bpo-44368: Improve syntax errors for invalid “as” targets. Patch by Pablo Galindo
bpo-44317: Improve tokenizer error with improved locations. Patch by Pablo Galindo.
bpo-43667: Improve Unicode support in non-UTF locales on Oracle Solaris. This issue does not affect other Solaris systems.
Library¶
bpo-44558: Make the implementation consistency of
indexOf()between C and Python versions. Patch by Dong-hee Na.bpo-34798: Break up paragraph about
pprint.PrettyPrinterconstruction parameters to make it easier to read.bpo-44516: Update vendored pip to 21.1.3
bpo-44468:
typing.get_type_hints()now finds annotations in classes and base classes with unexpected__module__. Previously, it skipped those MRO elements.bpo-43977: Set the proper
Py_TPFLAGS_MAPPINGandPy_TPFLAGS_SEQUENCEflags for subclasses created before a parent has been registered as acollections.abc.Mappingorcollections.abc.Sequence.bpo-44482: Fix very unlikely resource leak in
globin alternate Python implementations.bpo-44466: The
faulthandlermodule now detects if a fatal error occurs during a garbage collector collection. Patch by Victor Stinner.bpo-44404:
tkinter’safter()method now supports callables without the__name__attribute.bpo-44458:
BUFFER_BLOCK_SIZEis now declared static, to avoid linking collisions when bz2, lmza or zlib are statically linked.bpo-44464: Remove exception for flake8 in deprecated importlib.metadata interfaces. Sync with importlib_metadata 4.6.
bpo-44446: Take into account that
linenomight beNoneintraceback.FrameSummary.bpo-44439: Fix in
bz2.BZ2File.write()/lzma.LZMAFile.write()methods, when the input data is an object that supports the buffer protocol, the file length may be wrong.bpo-44434: _thread.start_new_thread() no longer calls PyThread_exit_thread() explicitly at the thread exit, the call was redundant. On Linux with the glibc, pthread_exit() aborts the whole process if dlopen() fails to open libgcc_s.so file (ex: EMFILE error). Patch by Victor Stinner.
bpo-44395: Fix
as_string()to pass unixfrom properly. Patch by Dong-hee Na.bpo-34266: Handle exceptions from parsing the arg of
pdb’s run/restart command.bpo-44077: It’s now possible to receive the type of service (ToS), a.k.a. differentiated services (DS), a.k.a. differenciated services code point (DSCP) and excplicit congestion notification (ECN) IP header fields with
socket.IP_RECVTOS.bpo-43024: Improve the help signature of
traceback.print_exception(),traceback.format_exception()andtraceback.format_exception_only().bpo-30256: Pass multiprocessing BaseProxy argument
manager_ownedthrough AutoProxy.
Documentation¶
bpo-44558: Match the docstring and python implementation of
countOf()to the behavior of its c implementation.bpo-38062: Clarify that atexit uses equality comparisons internally.
bpo-40620: Convert examples in tutorial controlflow.rst section 4.3 to be interpreter-demo style.
bpo-13814: In the Design FAQ, answer “Why don’t generators support the with statement?”
bpo-41621: Document that
collections.defaultdictparameterdefault_factorydefaults to None and is positional-only.
Tests¶
bpo-44287: Fix asyncio test_popen() of test_windows_utils by using a longer timeout. Use military grade battle-tested
test.support.SHORT_TIMEOUTtimeout rather than a hardcoded timeout of 10 seconds: it’s 30 seconds by default, but it is made longer on slow buildbots. Patch by Victor Stinner.bpo-44451: Reset
DeprecationWarningfilters intest.test_importlib.test_metadata_api.APITests.test_entry_points_by_indexto avoidStopIterationerror ifDeprecationWarningsare ignored.bpo-30256: Add test for nested queues when using
multiprocessingshared objectsAutoProxy[Queue]insideListProxyandDictProxy
Build¶
Windows¶
bpo-44582: Accelerate speed of
mimetypesinitialization using a native implementation of the registry scan.bpo-41299: Fix 16ms jitter when using timeouts in
threading, such as withthreading.Lock.acquire()orthreading.Condition.wait().
C API¶
bpo-44441:
Py_RunMain()now resetsPyImport_Inittabto its initial value at exit. It must be possible to callPyImport_AppendInittab()orPyImport_ExtendInittab()at each Python initialization. Patch by Victor Stinner.bpo-40939: Removed documentation for the removed
PyParser_*C API.
Python 3.10.0 beta 3¶
Release date: 2021-06-17
Core and Builtins¶
bpo-44409: Fix error location information for tokenizer errors raised on initialization of the tokenizer. Patch by Pablo Galindo.
bpo-44396: Fix a possible crash in the tokenizer when raising syntax errors for unclosed strings. Patch by Pablo Galindo.
bpo-44349: Fix an edge case when displaying text from files with encoding in syntax errors. Patch by Pablo Galindo.
bpo-44335: Fix a regression when identifying incorrect characters in syntax errors. Patch by Pablo Galindo
bpo-44304: Fix a crash in the
sqlite3module that happened when the garbage collector clearssqlite.Statementobjects. Patch by Pablo Galindobpo-44305: Improve error message for
tryblocks withoutexceptorfinallyblocks. Patch by Pablo Galindo.bpo-43833: Emit a deprecation warning if the numeric literal is immediately followed by one of keywords: and, else, for, if, in, is, or. Raise a syntax error with more informative message if it is immediately followed by other keyword or identifier.
bpo-11105: When compiling
ast.ASTobjects with recursive references throughcompile(), the interpreter doesn’t crash anymore instead it raises aRecursionError.
Library¶
bpo-42972: The _thread.RLock type now fully implement the GC protocol: add a traverse function and the
Py_TPFLAGS_HAVE_GCflag. Patch by Victor Stinner.bpo-44422: The
threading.enumerate()function now uses a reentrant lock to prevent a hang on reentrant call. Patch by Victor Stinner.bpo-44389: Fix deprecation of
ssl.OP_NO_TLSv1_3bpo-44362: Improve
sslmodule’s deprecation messages, error reporting, and documentation for deprecations.bpo-44342: [Enum] Change pickling from by-value to by-name.
bpo-44356: [Enum] Allow multiple data-type mixins if they are all the same.
bpo-44351: Restore back
parse_makefile()indistutils.sysconfigbecause it behaves differently than the similar implementation insysconfig.bpo-44242: Remove missing flag check from Enum creation and move into a
verifydecorator.bpo-44246: In
importlib.metadata, restore compatibility in the result fromDistribution.entry_points(EntryPoints) to honor expectations in older implementations and issuing deprecation warnings for these cases: A.EntryPointsobjects are once again mutable, allowing forsort()and other list-based mutation operations. Avoid deprecation warnings by casting to a mutable sequence (e.g.list(dist.entry_points).sort()). B.EntryPointsresults once again allow for access by index. To avoid deprecation warnings, cast the result to a Sequence first (e.g.tuple(dist.entry_points)[0]).bpo-44246: In importlib.metadata.entry_points, de-duplication of distributions no longer requires loading the full metadata for PathDistribution objects, improving entry point loading performance by ~10x.
bpo-43853: Improved string handling for
sqlite3user-defined functions and aggregates:It is now possible to pass strings with embedded null characters to UDFs
Conversion failures now correctly raise
MemoryError
Patch by Erlend E. Aasland.
bpo-43318: Fix a bug where
pdbdoes not always echo cleared breakpoints.bpo-37022:
pdbnow displays exceptions fromrepr()with itspandppcommands.
Documentation¶
bpo-44392: Added a new section in the C API documentation for types used in type hinting. Documented
Py_GenericAliasandPy_GenericAliasType.bpo-38291: Mark
typing.ioandtyping.reas deprecated since Python 3.8 in the documentation. They were never properly supported by type checkers.bpo-44322: Document that SyntaxError args have a details tuple and that details are adjusted for errors in f-string field replacement expressions.
Tests¶
bpo-44363: Account for address sanitizer in test_capi. test_capi now passes when run GCC address sanitizer.
bpo-43921: Fix test_ssl.test_wrong_cert_tls13(): use
suppress_ragged_eofs=False, sinceread()can raisessl.SSLEOFErroron Windows. Patch by Victor Stinner.bpo-43921: Fix test_pha_required_nocert() of test_ssl: catch two more EOF cases (when the
recv()method returns an empty string). Patch by Victor Stinner.
Build¶
bpo-44381: The Windows build now accepts
EnableControlFlowGuardset toguardto enable CFG.
IDLE¶
bpo-40128: Mostly fix completions on macOS when not using tcl/tk 8.6.11 (as with 3.9). The added update_idletask call should be harmless and possibly helpful otherwise.
bpo-33962: Move the indent space setting from the Font tab to the new Windows tab. Patch by Mark Roseman and Terry Jan Reedy.
bpo-40468: Split the settings dialog General tab into Windows and Shell/ED tabs. Move help sources, which extend the Help menu, to the Extensions tab. Make space for new options and shorten the dialog. The latter makes the dialog better fit small screens.
C API¶
bpo-43795: The list in Contents of Limited API now shows the public name
PyFrameObjectrather than_frame. The non-existing entry_nodeno longer appears in the list.bpo-44378:
Py_IS_TYPE()no longer usesPy_TYPE()to avoid a compiler warning: no longer castconst PyObject*toPyObject*. Patch by Victor Stinner.
Python 3.10.0 beta 2¶
Release date: 2021-05-31
Security¶
bpo-44022: mod:
http.clientnow avoids infinitely reading potential HTTP headers after a100 Continuestatus response from the server.
Core and Builtins¶
bpo-43667: Improve Unicode support in non-UTF locales on Oracle Solaris. This issue does not affect other Solaris systems.
bpo-44232: Fix a regression in
type()when a metaclass raises an exception. The C functiontype_new()must properly report the exception when a metaclass constructor raises an exception and the winner class is not the metaclass. Patch by Victor Stinner.bpo-44201: Avoid side effects of checking for specialized syntax errors in the REPL that was causing it to ask for extra tokens after a syntax error had been detected. Patch by Pablo Galindo
bpo-44184: Fix a crash at Python exit when a deallocator function removes the last strong reference to a heap type. Patch by Victor Stinner.
bpo-44180: The parser doesn’t report generic syntax errors that happen in a position further away that the one it reached in the first pass. Patch by Pablo Galindo
bpo-44168: Fix error message in the parser involving keyword arguments with invalid expressions. Patch by Pablo Galindo
bpo-44143: Fixed a crash in the parser that manifest when raising tokenizer errors when an existing exception was present. Patch by Pablo Galindo.
bpo-44114: Fix incorrect dictkeys_reversed and dictitems_reversed function signatures in C code, which broke webassembly builds.
bpo-43149: Corrent the syntax error message regarding multiple exception types to not refer to “exception groups”. Patch by Pablo Galindo
bpo-44056: Syntax errors when default
exceptis not the lastexceptare reported with the correct location. Patch by Mark Shannon.bpo-43822: The parser will prioritize tokenizer errors over custom syntax errors when raising exceptions. Patch by Pablo Galindo.
bpo-28146: Fix a confusing error message in
str.format().
Library¶
bpo-44254: On Mac, give turtledemo button text a color that works on both light or dark background. Programmers cannot control the latter.
bpo-38693: Prefer f-strings to
.formatin importlib.resources.bpo-33693: Importlib.metadata now prefers f-strings to .format.
bpo-44241: Incorporate minor tweaks from importlib_metadata 4.1: SimplePath protocol, support for Metadata 2.2.
bpo-44210: Make importlib.metadata._meta.PackageMetadata public.
bpo-43643: Declare readers.MultiplexedPath.name as a property per the spec.
bpo-33433: For IPv4 mapped IPv6 addresses (RFC 4291 Section 2.5.5.2), the
ipaddress.IPv6Address.is_privatecheck is deferred to the mapped IPv4 address. This solves a bug where public mapped IPv4 addresses were considered private by the IPv6 check.bpo-44145:
hmaccomputations were not releasing the GIL while calling the OpenSSLHMAC_UpdateC API (a new feature in 3.9). This unintentionally prevented parallel computation as otherhashlibalgorithms support.bpo-37788: Fix a reference leak when a Thread object is never joined.
bpo-38908: Subclasses of
typing.Protocolwhich only have data variables declared will now raise aTypeErrorwhen checked withisinstanceunless they are decorated withruntime_checkable(). Previously, these checks passed silently. Patch provided by Yurii Karabas.bpo-44098:
typing.ParamSpecwill no longer be found in the__parameters__of mosttypinggenerics except in valid use locations specified by PEP 612. This prevents incorrect usage liketyping.List[P][int]. This change means incorrect usage which may have passed silently in 3.10 beta 1 and earlier will now error.bpo-44089: Allow subclassing
csv.Errorin 3.10 (it was allowed in 3.9 and earlier but was disallowed in early versions of 3.10).bpo-44059: Register the SerenityOS Browser in the
webbrowsermodule.bpo-36515: The
hashlibmodule no longer does unaligned memory accesses when compiled for ARM platforms.bpo-44018: random.seed() no longer mutates bytearray inputs.
bpo-38352: Add
IO,BinaryIO,TextIO,Match, andPatterntotyping.__all__. Patch by Jelle Zijlstra.bpo-43972: When
http.server.SimpleHTTPRequestHandlersends a301 (Moved Permanently)for a directory path not ending with/, add aContent-Length: 0header. This improves the behavior for certain clients.bpo-28528: Fix a bug in
pdbwherecheckline()raisesAttributeErrorif it is called afterreset().bpo-43650: Fix
MemoryErrorinshutil.unpack_archive()which fails insideshutil._unpack_zipfile()on large files. Patch by Igor Bolshakov.bpo-41730:
DeprecationWarningis now raised when importingtkinter.tix, which has been deprecated in documentation since Python 3.6.
Documentation¶
bpo-42392: Document the deprecation and removal of the
loopparameter for many functions and classes inasyncio.bpo-44195: Corrected references to
TraversableResourcesin docs. There is noTraversableReader.bpo-41963: Document that
ConfigParserstrips off comments when reading configuration files.bpo-44072: Correct where in the numeric ABC hierarchy
**support is added, i.e., in numbers.Complex, not numbers.Integral.bpo-43558: Add the remark to
dataclassesdocumentation that the__init__()of any base class has to be called in__post_init__(), along with a code example.bpo-44025: Clarify when ‘_’ in match statements is a keyword, and when not.
Tests¶
bpo-31904: Ignore error string case in test_py_compile
test_file_not_exists().bpo-42083: Add test to check that
PyStructSequence_NewTypeaccepts aPyStructSequence_Descwithdocfield set toNULL.bpo-35753: Fix crash in doctest when doctest parses modules that include unwrappable functions by skipping those functions.
Build¶
bpo-41282: Fix broken
make installthat caused standard library extension modules to be unnecessarily and incorrectly rebuilt during the install phase of cpython.
Windows¶
macOS¶
bpo-43109: Allow –with-lto configure option to work with Apple-supplied Xcode or Command Line Tools.
IDLE¶
bpo-41611: Avoid uncaught exceptions in
AutoCompleteWindow.winconfig_event().bpo-41611: Fix IDLE sometimes freezing upon tab-completion on macOS.
bpo-44010: Highlight the new match statement’s soft keywords:
match,case, and_. However, this highlighting is not perfect and will be incorrect in some rare cases, including some_-s incasepatterns.bpo-44026: Include interpreter’s typo fix suggestions in message line for NameErrors and AttributeErrors. Patch by E. Paine.
Tools/Demos¶
bpo-44074: Make patchcheck automatically detect the correct base branch name (previously it was hardcoded to ‘master’)
C API¶
bpo-43795: The undocumented function
Py_FrozenMain()is removed from the Limited API.bpo-43795:
PyCodec_Unregister()is now properly exported as a function in the Windows Stable ABI DLL.
Python 3.10.0 beta 1¶
Release date: 2021-05-03
Security¶
bpo-43434: Creating
sqlite3.Connectionobjects now also producessqlite3.connectandsqlite3.connect/handleauditing events. Previously these events were only produced bysqlite3.connect()calls. Patch by Erlend E. Aasland.bpo-43998: The
sslmodule sets more secure cipher suites defaults. Ciphers without forward secrecy and with SHA-1 MAC are disabled by default. Security level 2 prohibits weak RSA, DH, and ECC keys with less than 112 bits of security.SSLContextdefaults to minimum protocol version TLS 1.2. Settings are based on Hynek Schlawack’s research.bpo-43882: The presence of newline or tab characters in parts of a URL could allow some forms of attacks.
Following the controlling specification for URLs defined by WHATWG
urllib.parse()now removes ASCII newlines and tabs from URLs, preventing such attacks.bpo-43472: Ensures interpreter-level audit hooks receive the
cpython.PyInterpreterState_Newevent when called through the_xxsubinterpretersmodule.bpo-43362: Fix invalid free in _sha3 module. The issue was introduced in 3.10.0a1. Python 3.9 and earlier are not affected.
bpo-43762: Add audit events for
sqlite3.connect/handle(),sqlite3.Connection.enable_load_extension(), andsqlite3.Connection.load_extension(). Patch by Erlend E. Aasland.bpo-43756: Add new audit event
glob.glob/2to incorporate the new root_dir and dir_fd arguments added toglob.glob()andglob.iglob().bpo-36384:
ipaddressmodule no longer accepts any leading zeros in IPv4 address strings. Leading zeros are ambiguous and interpreted as octal notation by some libraries. For example the legacy functionsocket.inet_aton()treats leading zeros as octal notatation. glibc implementation of moderninet_pton()does not accept any leading zeros. For a while theipaddressmodule used to accept ambiguous leading zeros.bpo-43075: Fix Regular Expression Denial of Service (ReDoS) vulnerability in
urllib.request.AbstractBasicAuthHandler. The ReDoS-vulnerable regex has quadratic worst-case complexity and it allows cause a denial of service when identifying crafted invalid RFCs. This ReDoS issue is on the client side and needs remote attackers to control the HTTP server.bpo-42800: Audit hooks are now fired for frame.f_code, traceback.tb_frame, and generator code/frame attribute access.
bpo-37363: Add audit events to the
http.clientmodule.