Hi @ptrblck a little more detail on this - does setting the batch norm layer to eval allow us to train ‘gamma’ and beta parameters? I understand that the eval operation allows us to use the current batch’s mean and variance when fine tuning a pretrained model.