Machine Learning, Entropy, Information Theory, Python.
of information of observing the output of S is Does the above equation looks familiar ? This is entropy, fundamental measure in Information theory. Entropy is measures of uncertainity in random variable or process.In our example of blue /green balls when we say 0 entropy in case of Box-1, means