Machine Learning, Decision Tree, Id3 Algorithm, Covid-19.
below, demonstrates the calculation of Information Gain for Fever. # total rows |S| = 14 For v = YES, |Sᵥ| = 8 Entropy(Sᵥ) = - (6/8) * log₂(6/8) - (2/8) * log₂(2/8) = 0.81 For v = NO, |Sᵥ| = 6 Entropy(Sᵥ) = - (2/6) * log₂(2/6) - (4/6) * log₂(4/6) = 0.91 # Expanding the summation in the IG formula: