Cross Entropy


$$H(p, q) = -\Sigma_x p(x)logq(x)$$
Is also H(p)+KL(p|q) and negative log likelihood
KL-divergence를 minimize하는 것 또한 결국 log likelihood를 maximize하는 것과 같다
### Cross Entropy Notion
|Title|
|:-:|








