Solved by ptrblck in post #5 
              
              
                Yes, if you want to print out all gradients, you could use: 
print(model.layer.param.grad)
# or to print all gradients
for name, param in model.named_parameters():
    print(name, param.grad)