Not really. I tried some other things like directly summing the losses (and keeping track of the amount of summed items to be able to take the average at the end) but none was clearly faster than the others. In the end it turned out that much smaller batches (20-50) sped up learning for my problem significantly, alleviating the problem.