@ptrblck, this url 2 has the intriguing text:  " For the weights, we set requires_grad after the initialization, since we don’t want that step included in the gradient." which  I wanted to prove.
Maybe this is not more the case.