In some cases it takes about 40 epochs, other cases it is immediate. I am not sure if it happens when looking at longer “sequence” lengths. In one case, were it failed immediately, the sequences were 1626 and 1633 in length, respectively.
I suspect the issue may be solved with a more up to date cudnn installation. For the environment you ran the code for @ptrblck, is there a conda package for that cudnn pytorch install? My laptop is running a quadro, and has some unique administrative roadblocks to install anything. If there isn’t a conda install, do you have instructions for how to get that going with a conda environment, would it require building from source? Thank you very much in advance for the help.