Machine Learning, Statistics, Monte Carlo, Deep Learning.
divergence determines not only the ‘distance’ between the two considered distributions, but also the gap between p(D|θ) and the ELBO. This gap is often referred to as tightness of the bound. (Blei et al., 2017; Kingma, 2017, pp. 14–18) So, let’s continue and take the log-likelihood, or model