Thanks @ptrblck  for your care. Well, I used CrossEntropyLoss as I have stated in the OP. The accuracy stays at 50.22% which is worse than NLLLoss but the test loss is a lot better than it. When it comes to current loss, yes, it is changing.