No, each GPU should get a part of the batch without repetition.



 111204:

If not, are there any solution to make the chunks for different GPUS be more flexible.


I’m not sure I understand this question properly. Could you explain a bit, what you mean by “more flexible”?