Thanks a lot for you reply, @tom! This is the kind of feedback I was hoping for. All your points make a lot of sense to me. Admittedly, I don’t quite understand the issue with batch norm, and I’m quite surprised that even one incomplete batch would cause problems.
Again, very useful feedback, thanks a lot!