@ptrblck @pinouchon  Thanks for your advises, but maybe I don’t have time to do such a    time-consuming test， and I don’t have another available GPU for my task.  I will first try to use newer version of software (pytorch 1.1, cuda 10.0, cudnn 7.6) to see if the error happens. It seems that cuda 10.0 works well, but I am not sure. I will post more information here after I do more trials. I hope the information could help to solve such kind of error since it is very hard to find and debug.