Solved by ptrblck in post #2 
              
              
                The state_dict contains all parameters and buffers registered to your module (not the architecture or some other code). 
The training attribute is not part of the state_dict and will be set to True in newly initialized models.