Also, some follow up questions:
The batchNorm usually goes BEFORE the activation function (ReLU), correct?
Also, is the argument in the BatchNorm the size of the input, or the number channels, or the batch size? Thanks!