Solved by ptrblck in post #2 
              
              
                If you’re using nn.CrossEntropy you should remove the last nn.LogSoftmax from your model. 
In case you would like to keep the nn.LogSoftmax layer, you would need to use nn.NLLLoss instead.