You might have to elaborate on what you mean from a successful training.
In a nut shell, during training, the model is predicting the GT at t+1 using GT from 0...t
For inference, since you dont have GT have to iteratively feed in the model output to arrive at 1…t.