nn.CrossEntropyLoss expects logits, so you should return the output of the last layer without any non-linearity.
However, internally nn.CrossEntropyLoss will apply F.log_softmax and nn.NLLLoss as seen here, so you would get the same results.