I noticed incorrect behavior in our project and I’ve done following experiment shows the CUDA result surprisingly inconsistent for identical function and inputs.
It would be appreciated if anyone knows the workaround.
My system:
pytorch 0.4.0
cuda 10.1
python 3.5.2
I knew this is not a recommended combination but our project does not compatible to newer versions of pytorch that we have to stick to an earlier version of pytorch.

image.png643×510 13.7 KB