@Andrei_Pokrovsky thank YOU for saving me a whole day!
For whoever have the same issue, the solution works on my env: Pycharm 2019.3/Ubuntu 18.04/conda Pytorch 1.3.1/Python 3.6.8 (need to pip install pydevd)