mariosasko:

And the loss function is related to the final prediction.


Maybe I should add that I have one final prediction for each element of the sequence (since we are trying to predict the next element, for each position in the sequence)