Thanks for offering this information. Since I only have access to one node of the cluster, I asked one of my colleagues to test my code on other nodes. The code works, I believe that the node I used has problems instead of a bug of PyTorch. I will re-check the system of this node to solve this node’s problem.
@ptrblck
I think the node I used has a problem itself instead of pytorch. I do not waste your time reproducing it. Thanks for your help!