hi @Ismail_Elezi, this doesn’t actually turn off batch norm right? I am looking for a way to train with batch_norm but on inference, I just want to use a batch of one and so I want to turn batchnorm off completely. Do you have a suggestion? @vabh