I am still encountering the GPU hang problem today, but my case is not Pytorch related.
I’m using Win7 with CUDA 10.2, writing C++ code with CUDA runtime API. Sometimes when I hit Ctrl-C, the GPU hangs and the process is in some sort of zombie state and unkillable, then I have to reboot.
I conjecture that when the host code is submitting a kernel job and the kill signal arrives this will happen, without concrete evidence.  If that’s the case, we might need to catch the kill signal in our code to allow graceful exit of CUDA.