I think one of the reason here is the batch normalization layers ,the parameters momentum is 0.01,However ,this example only runs 1820 iterations ,I’m not sure except the pre-trained part(frozen),the running mean of bn layers would estimated correctly…