@seamusblackley ah, understood. so yeah, similar indeed although the shannon entropy does have the (non-si) unit bits (or dits in decimal). but the idea is a bit different. you want to give "surprise" a measure. a  has 1 bit entropy, a 6-sided fair die 3 bit, etc. 🤔