I want to use a transformer (encoder and decoder) and use it for the seq 2 seq modeling.
I like to use it as autoregressive model during the inference time.
I know that I should use the targets to the decoder during the training, but then the issue is that when I do it my model overfits and performed well only if I have good targets as the input of the decoder.
I was wondering if there is a trick or rule on how should I select the target for the decoder?
my second question is if the target inputs to the decoder should be exactly similar to the target outputs of the decoder or it is kinda an art to choose the right target input for the decoder?