OK, this is something I will certainly do when I don’t plan to track autograd, but in here, I just wanted to check if we can track gradients of random initialization:
w = torch.randn(2, 5, requires_grad=True)