Gibbs' inequality


### statement about the [Entropy](https://texonom.com/entropy-35fdf9bb7fdd42edbd4277147ca0ec38) of a discrete [Probability distribution](https://texonom.com/probability-distribution-2d33768bdc43438794829b004dd37804) 
Several other bounds on the entropy of probability distributions are derived from Gibbs' inequality
(KL ≥ 0)




> [Gibbs&#039; inequality](https://en.wikipedia.org/wiki/Gibbs'_inequality)





