NaturalSpeech: End-to-end text to speech synthesis with human-level quality
Nice pitch envelopes. But it&#x27;s a bit uncanny that natural human pitch envelopes encode and express what you understand and intend to convey about the meaning of the words you&#x27;re saying, and what you want to emphasize about each individual word, emotionally. Like how you&#x27;ll say a word you don&#x27;t really mean sarcastically. It can figure out it&#x27;s a question because the sentence ends in a question mark, and it raises the pitch at the end, but it can&#x27;t figure out what the meaning or point of the question is, and which words to emphasize and stress to convey that meaning. (Not a criticism of this excellent work, just pointing out how hard a problem it is!)<p>For example, compare &quot;rebuke and abash&quot;: in the NaturalSpeech, one goes down like she&#x27;s sure and the other goes up like she&#x27;s questioning, where in the recording, they  are both more balanced and emphasized as equally important words in the sentence. And the pause after insolent in &quot;insolent and daring&quot; sounds uneven compared to the recording, which emphasizes the pair of words more equally and tightly.<p>Jiminy Glick interviews (and does an impression of) Jerry Seinfeld:<p><a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=AE2utktZ92Y" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=AE2utktZ92Y</a>