You can inspect the gradients either by directly printing them after the backward() call:
for name, param in model.named_parameters():
    if param.grad is not None:
        print(param.grad)
        print(param.grad.abs().max())
        ...

or by using hooks via model.layer.param.register_hook().