I have a network that is dealing with some exploding gradients. I want to employ gradient clipping using torch.nn.utils. clip_grad_norm_ 541 but I would like to have an idea of what the gradient norms are before I randomly guess where to clip.
How can I view the norms that are to be clipped?