Machine Learning, Neural Networks, Information Theory, Deep Learning, Theory Of Neural Networks.
Layer 2 Summary Most every deep neural network acts like an encoder-decoder Most of the training time is spent in compression phase Layers are learned bottom-up Beyond compression phase, more the neural network forgets about the input, the more accurate it gets (wiping out the irrelevant part of