The BatchNorm operation renders the activations for a sample dependent on the activations of other samples in the batch. More precisely, each sample is normalized using the mean and standard deviation of the batch.