I cannot reproduce the issue using this small example:
# 4GB
x = torch.randn(1024**3)

for _ in range(10):
    torch.save(x, "tmp.pt")
    y = torch.load("tmp.pt")

Could you check, if you are hitting the same error using my code?