Answers.Body: <p>Information gain is a very specific measure in information theory, thus the entropy definition... for sure, the decrease in Gini index can be seen as a proxy for it</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-02-19T23:49:18.707Z
Answers.LastActivityDate: 2024-02-19T23:49:18.707Z
Answers.UserDisplayName: Alberto
Body: <p>Is information gain only calculated using decrease in entropy of a dataset?</p>
  <p>If I calculate it using the decrease in Gini Impurity, before and after the split, can it not be considered information gain?</p>
  
Tags: <decision-trees><entropy>
Title: Is information gain only calculated using decrease in entropy of a dataset?
UserDisplayName: Piyush Miglani
ThreadText: # Is information gain only calculated using decrease in entropy of a dataset?
  
  (Asked by: username_0 on 2024-02-19)
  
  Is information gain only calculated using decrease in entropy of a dataset?
  
  If I calculate it using the decrease in Gini Impurity, before and after the split, can it not be considered information gain?
  
  **Tags:** decision-trees, entropy
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2024-02-19. Score: 1
  
  Information gain is a very specific measure in information theory, thus the entropy definition... for sure, the decrease in Gini index can be seen as a proxy for it
  
  
  ---
  
  