Hi @justusschock, in my model, I have two loss functions, one is associated with a matrix parameter defined with nn.parameter() and the other with a sequential CNN. In the first one, the loss value is constant during the optimization process, while in the second one no.