Solved by Nikronic in post #2 
              
              
                Hi, 
Loss function actually is not aware of batch size, It just responds to its input values which does not matter if you achieve them by using batch size or even directly reading data from storage then stacking them. So, in summary, batch size does not affect on value of loss functions directly. 
B…