Yup, I go from a batch size of 12 to 24
There are batchnorm layers. I’m using a pretrained SEResNeXt50 from, https://github.com/Cadene/pretrained-models.pytorch 3 as the backbone to a UNet.
Loss increases immediately after the first batch, gets to NaN in 2-3 batches.