Machine Learning, Artificial Intelligence, Data Science.
Y) is the information obtained on the random variable X when Y is observed. However, the mathematical definition below does not sound intuitive. Modified from source But it will be easier with entropy Intuitively, mutual information measures how much information do we gain by knowing X? If knowing