Solved by ptrblck in post #2 
              
              
                While creating an optimizer, you could pass parameters to it. 
In a lot of cases, you would just pass all model parameters to a single optimizer, so both calls will yield the same result (zeroing out the gradients of all parameters). 
However, you could also pass the first half of the model paramete…