Do you mean you want to share the same CPU model across 4 DDP processes? If so, you can use torch.multiprocessing.Queue 8 to share the model. Does the CPU model participate in training or just inference?