Which loss function are you using?
If you are using e.g. nn.CrossEntropyLoss, you should pass the logits directly without applying softmax on them.
Make sure to check the docs and pass the output in the expected value range to your criterion.