Philosophy, Information Theory, Energy, Thermodynamics.
outcomes are a probability function. This implies that casting a die has higher entropy than tossing a coin because each outcome of a die toss (⅙) has a smaller probability than landing on heads or tails (½). Looking at the relationship graphically helps: (Wikipedia) By communicating a result of