text: Title: [Bug] training a new model stops with "Decoder stopped with `max_decoder_steps` 10000"
  Body: ### Describe the bug
  
  Hello!
  
  I am running TTS 0.15.6 and try to train a new voice basing on 22,000 wav files. The training process seems to work but stops after a while, sometimes after 30 minutes and sometimes after 2 hours. Please see me log here:
  
  ```
  [...]
     --> STEP: 14
       | > decoder_loss: 16.613059997558594  (17.25351878574916)
       | > postnet_loss: 17.12180519104004  (21.706623349870956)
       | > stopnet_loss: 0.6667962074279785  (0.6582207466874804)
       | > decoder_coarse_loss: 15.918059349060059  (16.576676845550537)
       | > decoder_ddc_loss: 0.0008170512155629694  (0.002927447099604511)
       | > ga_loss: 0.0023095402866601944  (0.006352203565516642)
       | > decoder_diff_spec_loss: 1.2021437883377075  (1.1472604700497218)
       | > postnet_diff_spec_loss: 0.7060739398002625  (0.7125482303755624)
       | > decoder_ssim_loss: 0.8515534400939941  (0.8743813676493508)
       | > postnet_ssim_loss: 0.7912083864212036  (0.8292492159775325)
       | > loss: 13.979524612426758  (15.465778078351702)
       | > align_error: 0.9930884041823447  (0.9810643588259284)
  
  warning: audio amplitude out of range, auto clipped.
  
    --> EVAL PERFORMANCE
       | > avg_loader_time: 0.00717801707131522 (+0.003781165395464216)
       | > avg_decoder_loss: 17.25351878574916 (-1.5459022521972656)
       | > avg_postnet_loss: 21.706623349870956 (-0.7187363760811927)
       | > avg_stopnet_loss: 0.6582207466874804 (-0.1437307809080396)
       | > avg_decoder_coarse_loss: 16.576676845550537 (-1.278356620243617)
       | > avg_decoder_ddc_loss: 0.002927447099604511 (+0.00029547616473532155)
       | > avg_ga_loss: 0.006352203565516642 (-2.3055106534489687e-05)
       | > avg_decoder_diff_spec_loss: 1.1472604700497218 (+0.06803790586335312)
       | > avg_postnet_diff_spec_loss: 0.7125482303755624 (+0.019743638379233208)
       | > avg_decoder_ssim_loss: 0.8743813676493508 (-0.000993796757289389)
       | > avg_postnet_ssim_loss: 0.8292492159775325 (-0.00942203402519226)
       | > avg_loss: 15.465778078351702 (-1.0101798602512932)
       | > avg_align_error: 0.9810643588259284 (-0.0001967931166291237)
  
   | > Synthesizing test sentences.
     > Decoder stopped with `max_decoder_steps` 10000
     > Decoder stopped with `max_decoder_steps` 10000
     > Decoder stopped with `max_decoder_steps` 10000
     > Decoder stopped with `max_decoder_steps` 10000
     > Decoder stopped with `max_decoder_steps` 10000
  ```
  In the past this issue was already reported, but the thread was closed but the issue not fixed. Are there any updates?
  
  ### To Reproduce
  
  ```
  import os
  import sklearn
  
  from TTS.config.shared_configs import BaseAudioConfig
  from trainer import Trainer, TrainerArgs
  from TTS.tts.configs.shared_configs import BaseDatasetConfig, CharactersConfig
  from TTS.tts.configs.tacotron2_config import Tacotron2Config
  from TTS.tts.datasets import load_tts_samples
  from TTS.tts.models.tacotron2 import Tacotron2
  from TTS.utils.audio import AudioProcessor
  from TTS.tts.utils.text.tokenizer import TTSTokenizer
  
  output_path = os.path.dirname(os.path.abspath(__file__))
  
  dataset_config = BaseDatasetConfig(formatter="thorsten", meta_file_train="metadata.csv", path="/home/marc/Desktop/AI/Voice_Cloning3/")
  
  character_config = CharactersConfig(
      characters="ABCDEFGHIJKLMNOPQRSTUVWXYZ!',-.:;?abcdefghijklmnopqrstuvwxyzßäéöü̈‒–—‘’“„ ",
      punctuations="!'(),-.:;? \u2012\u2013\u2014\u2018\u2019",
      pad="_",
      eos="~",
      bos="^",
      phonemes=" a b d e f h i j k l m n o p r s t u v w y z ç ð ø œ ɑ ɒ ɔ ɛ ɡ ɪ ɹ ʃ ʊ ʌ ʏ!!!!!!!?,....:;??!abdefhijklmnoprstuvwxyzçøŋœɐɑɒɔəɛɜɡɪɹɾʃʊʌʏʒː̩̃"
  )
  
  audio_config = BaseAudioConfig(
      stats_path="/home/marc/Desktop/AI/Voice_Cloning3/stats-thorsten-dec2021-22k.npy",
      sample_rate=22050,
      do_trim_silence=True,
      trim_db=60.0,
      signal_norm=False,
      mel_fmin=50,
      spec_gain=1.0,
      log_func="np.log",
      ref_level_db=20,
      preemphasis=0.0,
  )
  
  config = Tacotron2Config(  # This is the config that is saved for the future use
      audio=audio_config,
      batch_size=40,  # BS of 40 and max length of 10s will use about 20GB of GPU memory
      eval_batch_size=16,
      num_loader_workers=4,
      num_eval_loader_workers=4,
      run_eval=True,
      test_delay_epochs=-1,
      r=6,
      gradual_training=[[0, 6, 64], [10000, 4, 32], [50000, 3, 32], [100000, 2, 32]],
      double_decoder_consistency=True,
      epochs=1000,
      text_cleaner="phoneme_cleaners",
      use_phonemes=True,
      phoneme_language="de",
      phoneme_cache_path=os.path.join(output_path, "phoneme_cache"),
      precompute_num_workers=8,
      print_step=25,
      print_eval=True,
      mixed_precision=False,
      test_sentences=[
          "Es hat mich viel Zeit gekostet ein Stimme zu entwickeln, jetzt wo ich sie habe werde ich nicht mehr schweigen.",
          "Sei eine Stimme, kein Echo.",
          "Es tut mir Leid David. Das kann ich leider nicht machen.",
          "Dieser Kuchen ist großartig. Er ist so lecker und feucht.",
          "Vor dem 22. November 1963.",
      ],
      # max audio length of 10 seconds, feel free to increase if you got more than 20GB GPU memory
      max_audio_len=22050 * 10,
      output_path=output_path,
      datasets=[dataset_config],
  )
  ap = AudioProcessor(**config.audio.to_dict())
  
  ap = AudioProcessor.init_from_config(config)
  
  tokenizer, config = TTSTokenizer.init_from_config(config)
  
  train_samples, eval_samples = load_tts_samples(
      dataset_config,
      eval_split=True,
      eval_split_max_size=config.eval_split_max_size,
      eval_split_size=config.eval_split_size,
  )
  
  model = Tacotron2(config, ap, tokenizer, speaker_manager=None)
  
  trainer = Trainer(
      TrainerArgs(), config, output_path, model=model, train_samples=train_samples, eval_samples=eval_samples
  )
  trainer.fit()
  ```
  
  
  ### Expected behavior
  
  _No response_
  
  ### Logs
  
  _No response_
  
  ### Environment
  
  ```shell
  TTS 0.15.6
  Python 3.9.17
  Ubuntu 23.04
  cuda/cudnn originally 11.8 but TTS installed into the conda environment
  nvidia-cublas-cu11       11.10.3.66
  nvidia-cuda-cupti-cu11   11.7.101
  nvidia-cuda-nvrtc-cu11   11.7.99
  nvidia-cuda-runtime-cu11 11.7.99
  nvidia-cudnn-cu11        8.5.0.96
  nvidia-cufft-cu11        10.9.0.58
  nvidia-curand-cu11       10.2.10.91
  nvidia-cusolver-cu11     11.4.0.1
  nvidia-cusparse-cu11     11.7.4.91
  nvidia-nccl-cu11         2.14.3
  nvidia-nvtx-cu11         11.7.91
  
  Hardware AMD 5900X, RTX 4090
  ```
  
  
  ### Additional context
  
  _No response_