@ptrblck ,
Hmm, interesting thought. I hadn’t thought about this. But I think it can also be because of my data and/or using a batch size of 2 or 3 with GroupNorm. Also, my data is extremely complicated. Could that also be the reason?
I am also training using only 2735 images. My belief is that I need more data.