Solved by ptrblck in post #7 
              
              
                Your approach could work theoretically, but I would be careful about the overall workflow in your training script. 
Usually you would setup the model and pass all parameters to an optimizer before the first forward pass. 
This won’t work properly in your approach, since not all modules are initializ…