Machine Learning, Neural Networks, Information Theory, Deep Learning, Theory Of Neural Networks.
Information along the Training Phase We calculate Mutual Information between Layer and Input Layer and Output Initial Conditions Initially,weights are randomly initialised. So barely anything is known about the correct output. With successive layers the mutual information about input decreases and