Thanks Andreas,



 andreaskoepf:

you could print out the max-abs values (or a norm) of the


If you don’t mind me asking does that mean taking the max abs val of the norm of all variables that have a requires_grad=True? Or just specific variables/layers with grads?