Hello,
Could you explain what you mean by ‘turn off’ batch norm?
If you set BN to eval mode, it is possible to use a batch size of 1 during inference. This is because during testing the stored running mean and running std are used. These values are not calculated from the batch.