12. Replace any successive whitespace characters with a space.

A different, language-speciﬁc set of transformations would be needed to equivalently normalize non-English text, but due to
our lack of linguistic knowledge to build such normalizers for all languages, we resort to the following basic standardization
for non-English text:

1. Remove any phrases between matching brackets ([, ]).

2. Remove any phrases between matching parentheses ((, )).

4. make the text lowercase.

5. replace any successive whitespace characters with a space.

3. Replace any markers, symbols, and punctuation characters with a space, i.e. when the Unicode category of each

character in the NFKC-normalized string starts with M, S, or P.
RobustSpeechRecognitionviaLarge-ScaleWeakSupervision