LogSoftmax is also not expected as described before. Remove any activation function applied on the output of the model. As you could see in my outputs, the model is training fine with the fixes.
If you get stuck, please post a minimal executable code snippet, which would reproduce the issue.