Philosophy, Information Theory, Energy, Thermodynamics.
entropy refers to energy, let’s look at how it applies to communication and Information Theory. I think this excerpt from Jimmy Soni and Rob Goodman’s biography of Claude Shannon, A Mind at Play, is a great anecdotal story of entropy’s origins: Shannon approached the great man with his idea of