Are you storing the checkpoints frequently on your drive?
Besides e.g. the pretrained weights from torchvision, PyTorch shouldn’t store anything on the drive, if you have enough RAM.
However, if you are running out of RAM, your OS might use your SSD as the swap file (but again this is not PyTorch-specific).
Could you narrow down, which files are being saved?