Entropy, Thermodynamics, Machine Learning.
the formula based on Boltzmann’s. We can think of this initial formula: H = k log M ; where M is the number of messages. Furthermore the Macrostate can be compared to the Channel Source, while the Microstate to each word. Given the probability of each word being sent is not the same, we can