Solved by ptrblck in post #2 
              
              
                This might be expected, as the loss and accuracy do not strictly depend on each other. 
I.e. the range of the logits also defines the loss, while only the argmax logit defines the prediction (and thus changes the accuracy) as seen in this small example: 
# setup
criterion = nn.CrossEntropyLoss()

# …