Solved by KFrank in post #2 
              
              
                Hi Zhihan! 

The short, practical answer is because of what you typically do with 
the log-softmax of the logits.  You pass them into a loss function such 
as nll_loss().  (Doing this gives you, in effect, the cross-entropy loss.) 
If you were to pass the raw logits into nll_loss() you would get an 
…