OW, everything is strange for me now.
Literally, torch.no_grad should not change the output as it actually just prevents from accumulating gradients not updating weights.
Also, Yes, I used argmax to decide which class has been chosen as softmax returns probabilities of logits.
I really cannot figure much why this is happening.
Have you found any solutions so far?