Machine Learning, Decision Tree, Id3 Algorithm, Covid-19.
IG(S, Fever) = Entropy(S) - (|Sʏᴇꜱ| / |S|) * Entropy(Sʏᴇꜱ) - (|Sɴᴏ| / |S|) * Entropy(Sɴᴏ) ∴ IG(S, Fever) = 0.99 - (8/14) * 0.81 - (6/14) * 0.91 = 0.13 Next, we calculate the IG for the features “Cough” and “Breathing issues”. You can use this free online tool to calculate the Information Gain.