Yes. I always follow the best practice to save and load the state_dict.
I found a related issue here 67
It says torch.cuda.empty_cache()might help, but in my case I still have OOM.
By the way, I’m using pytorch 0.3.1