Hi all,
I have a RNN that when I train with cuda 10.1 on google colab or 11.0 on a Quadro P4000 then we get very good results, but when trained with any rtx 30 series card then the gradient always diverge too soon and result is not as good (sometimes even not converging at all)
it’s the same code, same hyper-parameters.
Has anyone encountered the same problem?