Machine Learning, Entropy, Information Theory, Python.
balls the probability will be much smaller and computation becomes more tedious. To simplify multiplication into summation we use logarithmic function to base 2. Logarithm from numbers between 0 to 1 are negetive so negative logarithm is taken. Entropy is the weighted average of log of