Bug report

Bug description:

from tokenize import untokenize, generate_tokens
from io import StringIO

untokenize(generate_tokens(StringIO("f'\\N{EXCLAMATION MARK}'").readline))

ValueError: start (1,22) precedes previous end (1,24)

CPython versions tested on:

3.12

Operating systems tested on:

Windows

Linked PRs

• gh-115154: Fix untokenize handling of unicode named literals #115171
• [3.12] gh-115154: Fix untokenize handling of unicode named literals (GH-115171) #115662