Essential Math, Editors Pick, Mathematics, Data Science, Machine Learning.
the cross-entropy is widely used as a loss for binary classification: the log loss. which is the formula of the log loss. Kullback-Leibler Divergence (KL Divergence) Intuitively, the KL divergence is the supplemental amount of information associated with the encoding of the distribution Q(x)