You are right. I comment ‘net1.load_state_dict()’, and the memory usage is gone.
So i guess pytorch use GPU2 for load_state_dict() by default?
How can i do the load_state_dict() without usage of irrelevant GPUs?
But why this did not happen on other datasets?