ptrblck:

If you split the batch, you would have to take care of e.g. batch norm layers, as the running stats will differ.


Yes, with batch norm layers, I tested dummy data. The output is different. Appreciate for your reply!