Solved by Shisho_Sama in post #12 
              
              
                OK, here is the answer. 
self.model.load_state_dict(checkpoint['model'].module.state_dict())

actually works and the reason it was failing earlier was that, I instantiated the models differently (assuming the use_se to be false as it was in the original training script) and thus the keys would diffe…