Solved by ptrblck in post #2 
              
              
                How did you define your current model? 
If both submodules are instances of nn.Sequential, you could recreate them separately outside of your current model and just load the state_dicts into them. 
If your modules and forward is more complicated, you could still redefine the submodules, but would mo…