Thanks for the update.
Sorry, for not being clear in my previous post, but could you print the params.grad attributes?
The parameters themselves won’t be changed, but their gradients should. Also, the norm before and after would be interesting to see:
print(torch.norm(torch.cat([p.grad.view(-1) for p in model.parameters()])))