Hi,
This is what autograd.grad() 22 is for 
If you add your regularizer to the final loss and call backward on that, then it will compute the gradient of this new function. In particular if you just want to do a weighted sum of the loss and the regularizers, that will work as you expect !