I tested it with different seeds and it seems to work:
Epoch: 0, Loss: 2.30485224724
Epoch: 0, Loss: 1.00339114666
Epoch: 0, Loss: 0.672091126442
Epoch: 0, Loss: 0.501866996288
...
Epoch: 0, Loss: 0.158133521676
Test accuracy: 95%

Which PyTorch version are you using?