The problem is now fixed uninstalling the Pytorch and Torchvision, and installing them with:
pip install torch==1.4.0+cu100 torchvision==0.5.0+cu100 -f https://download.pytorch.org/whl/torch_stable.html
Before that it was cu92, and for that, I got multiple random CUDA memory errors.