I tried the following,
for p in model.parameters():
    if p.grad is None:
        print(p.grad)

It seems that no values are ‘None’, so I guess this isn’t a problem. I wanted to check if I have vanishing gradient issues, but I’m not sure how to check for this. Could you recommend a method? I have a huge set of parameters, so if I just print out all the p.grads, I just get overwhelming load of numbers