Hi, assume that I’ve choose the batch size = 32 in a single gpu to outperforms other methods. Now I want use dataparallet to split the training data. I have 4 gpus. To get the same results, should I use batch size = 8 for each gpu or batch size = 32 for each gpu?
Thanks a lot.
@ptrblck_de
Thanks a lot