<p>Information gain is a very specific measure in information theory, thus the entropy definition... for sure, the decrease in Gini index can be seen as a proxy for it</p>

CC BY-SA 4.0
2024-02-19T23:49:18.707Z
2024-02-19T23:49:18.707Z
Alberto
<p>Is information gain only calculated using decrease in entropy of a dataset?</p>
<p>If I calculate it using the decrease in Gini Impurity, before and after the split, can it not be considered information gain?</p>

<decision-trees><entropy>
Is information gain only calculated using decrease in entropy of a dataset?
Piyush Miglani
# Is information gain only calculated using decrease in entropy of a dataset?

(Asked by: username_0 on 2024-02-19)

Is information gain only calculated using decrease in entropy of a dataset?

If I calculate it using the decrease in Gini Impurity, before and after the split, can it not be considered information gain?

**Tags:** decision-trees, entropy


---

## 1 answers

### Answer by username_1 on 2024-02-19. Score: 1

Information gain is a very specific measure in information theory, thus the entropy definition... for sure, the decrease in Gini index can be seen as a proxy for it


---

