Math, Statistics, Data Science, Information Theory, Decision Tree.
character has a feature that is shared by very few people, and the answer is yes), the amount of information we gained is higher than an answer with more probability. On the other hand, entropy is related to uncertainty. For example, if we flip a coin, the uncertainty in the outcome is higher with