Thank you!   I know what you said. But in my program, the model is very big, and the x is also very big, the size of x is 32 * 32 * 96 * 28 * 28, type of x is torch.FloatTensor. If x is gathered to one GUP, the GPU would explode