Solved by ptrblck in post #4 
              
              
                The recommended way of storing the state_dict should be working fine or are you seeing any issues with it? As explained in the Serialization semantics, storing and loading the model directly could be breaking in various ways due to the way Python pickles the model.