torch.load is the culprit here, it loads all data into memory. As I said above datasets already takes care of caching the dataset, so there is no need to use torch.save and torch.load.
If you manually want to save the dataset, have a look at this section 4