You could refer to here: http://pytorch.org/docs/master/optim.html 56
In the Note of SGD:

The implementation of SGD with Momentum/Nesterov subtly differs from Sutskever et. al. and implementations in some other frameworks.