Deep Learning, Image Processing, Convolutional Network, Machine Learning, Artificial Intelligence.
normalization but before the non-linearity. Unlike batch normalization, layer normalization performs precisely the same computation at training and test times. Invariance and equivariance Reflection invariance: we would expect the network to classify that image as an image of a cat, regardless of