Dear @BramVanroy, thank you for the reply, but num_predict is not the size of vocabulary. It’s the number of predictions to be made for that particular input sentence. seq_len is not the issue because as you pointed out, it can be padded. But I am not sure if the same is true for num_predict, hence this question