@ptrblck you are right,i was using gradient accumulation with filter response normalization and with batch size = 4 and it didn’t perform well,then used same model with batch size = 8 and without gradient accumulation and it worked fine there