Thank you.
Another question, is the issue mentioned in this repo fixed in 1.3?

  
      
      GitHub
  
  
    

csrhddlam/pytorch-checkpoint 6

Contribute to csrhddlam/pytorch-checkpoint development by creating an account on GitHub.


  
  
    
    
  
  


Essentially, the checkpoint function would be slower on multi-GPUs when using nn.DataParallel.