OH~ I tried to put validation under model.eval() and it worked! There was no difference between on/off. Thank you very much! 
BTW, I also tried to compute the loss over one epoch in case of shuffled and not shuffled with validation not under model.eval(). The loss of off-mode was still higher than that of on-mode. Did that mean my model  wasn’t working properly? What’s the principal of that?