Solved by ptrblck in post #2 
              
              
                Based on your screenshot, it seems the training and validation losses do change. 
However, nn.CrossEntropyLoss expects raw logits, so you should remove the last softmax layer from your model.