Yes but the project that I’m using uses a different branch of pytorch.
I think the writer of the project modified pytorch in order to use multi-gpu. And he also used pytorch-encoding for multi-gpu (https://github.com/zhanghang1989/PyTorch-Encoding).
Therefore, if I want to use the original pytorch, maybe I need to modify entire source code.