Hi there,
I run on multiple GPUs with random varying batch sizes.
I found that sometimes the last batch of the epoch is of size 1 and than BatchNorm1D throws an error and stops my run.
I solved locally with try<->except but it seems like a bug to me…