Thanks ptrblck. I was trying with the same. model.eval(). I think I missed something earlier. Earlier was using load_state_dict in a loop and tried model.eval(). Will see if I missed some trick. Thanks again.