Solved by ptrblck in post #20 
              
              
                No, the manual seed is not the issue. I’ve just used it in my first example to show, that the optimizer does not have any problems optimizing a model with unused parameters. 
Even if we copy all parameters between models, the optimizer works identically. 
So back to your original question. The discr…