Solved by weikunhan in post #4 
              
              
                Thanks for helping! I try to use one node with 2 GPUs, there is no problem. Next, I try to use one node with 3 or 4 GPUs but not work, I found ONLY 2 GPUs is working… 
[image] 
Therefore, I try to understand why I can only use one node with 2 GPUs. The answer is node memory. I use default setting wh…