Machine Learning, Neural Networks, Information Theory, Deep Learning, Theory Of Neural Networks.
in the training set) be Y. Now we already know Neural Networks find the underlying function between X and Y. So X can be seen as High-Entropy distribution of Y. High entropy because X contains the information Y but it also a lot of other information. Example: “This boy is good.” contains enough