Without the log term you wouldn’t calculate the entropy, would you?
From the Wikipedia article on Cross entropy 2, you would calculate p(x) * q(x) I think.
I haven’t seen this outcome yet, but are you sure your model learns generally better or could the current hyperparameters be just “bad” for the proper usage of nn.NLLLoss with the log probabilities?