Yeah mathematically they do not have a difference. But we are at PyTorch which more of a software engineering field and the document has told us that what are the first and second parameters so it’s a good idea to follow the document.
The actual differences are the grad computing function are not the same.

I have tested it the results(Grad) are the same though.