Hey there, a quick question, since I’m also having problems with Mask RCNN not converging, could this be do to the fact that our batch size is 1 and ResNet uses batch normalization in the layers? My batch size is 1 due to hardware limitations and you’re basically feeding the network the same picture over and over, making your batch size 1. Batch normalization progressively deteriorates as batch size goes down and isn’t intuitive with batch size of 1 at all.
Not an expert on this topic by any means so I’m asking here for someone with more knowledge.