text: Title: [Bug] Performance decay in XTTS-v2
  Body: ### Describe the bug
  
  I noticed a significant decrease in quality and audio similarity when using the hugging space demo for xtts v2.0.3 before that version the quality and similarly between input and output audios was miles better. 
  
  ### To Reproduce
  
  Use hugging face space to compare xtts 2.0.3 with older versions. 
  
  ### Expected behavior
  
  _No response_
  
  ### Logs
  
  _No response_
  
  ### Environment
  
  ```shell
  Hugging face demo for xtts v2.0.3
  ```
  
  
  ### Additional context
  
  _No response_