Yes, I am applying F.log_softmax inside the forward function. When I change learning rate from 0.001 to 0.01, now the accuracy changes a little bit but still it is way lower than nn.NLLLoss. So when using nn.CrossEntropyLoss, should I directly return the output inside the forward function?
Regarding my dataset, it is a publicly available facial expression dataset hosted on GitHub, it is not well balanced due to the nature of the context.