I am training a seq2seq model for text to speech task. And I found that when training the same model on a 1080ti and a 2080ti respectively (both with the same default config from the repository, i.e., the same batch size，the same learning rate and so on).
The model on 2080ti can pick up a meaningful alignment while the model on 1080ti can not。Although the loss of the model on 1080ti is descending normally.
I am quite confused，is the difference between GPUs resulting that problem?  I have checked the versions of pytorch to be consistent. The code also has setted a specific random seed. So where is the problem? Anybody had encountered similar problems?