Solved by ptrblck in post #2 
              
              
                Based on the docs, the second argument should be passed as probabilities: 

As with  NLLLoss , the input given is expected to contain  log-probabilities  and is not restricted to a 2D Tensor. The targets are given as  probabilities  (i.e. without taking the logarithm).