Machine Learning, Neural Networks, Information Theory, Deep Learning, Theory Of Neural Networks.
layers: the Sample Complexity of deep neural network is determined by encoded Mutual Information at Last Hidden Layer the Accuracy is determined by Decoded Mutual Information of Last Hidden Layer Sample Complexity is the number and variety of examples one needs to receive certain accuracy. Mutual