Machine Learning, Deep Learning, Pytorch, Python, Artificial Neural Network.
down as a function of cross entropy. Minimizing the cross-entropy is the same as minimizing KL divergence. KL = — xlog(y/x) = xlog(x) — xlog(y) = Entropy — Cross-entropy When to use it? + Classification + Same can be achieved with cross entropy with lesser computation, so avoid it. Margin Ranking