Artificial Intelligence, Machine Learning, Deep Neural Networks, Technology, Interview.
provide insights on the process of Deep Neural Network training by looking at it through the eye of Information Theory. For their analysis they take small, fully connected neural networks and consider each whole layer as a single random variable. They then calculate the mutual information of each