Artificial Intelligence, Machine Learning, Deep Neural Networks, Technology, Interview.
network goes through a new, much longer phase called Representation Compression, in which the layers in the network continue to increase their mutual information with regards to the labels, but start decreasing their mutual information with regards to the inputs to the network. This is quite