Machine Learning, Information Theory, Digital Communication, Statistical Learning.
recently discovered a new book: Information Theory, Inference and Learning Algorithms, by MacKay, and it made me change my mind. This book first adresses information theory (data compression, noisy-channel coding, …), and then neural networks. And suddenly, Chapter 40 page 483, the two fields are