Thanks a lot for the explanation!
I believe you are right considering the weight use for batching.
While this isn’t the best case outcome i’m happy to have understood it a little more and will give implementing it a shot in the next few days.
One more thing:
could you elaborate on what you mean by “unreduced loss”?
Thanks again! =)