Issues with GAN and VAE models I'm reading this amazing paper on Normalizing Flows https://arxiv.org/pdf/1908.09257.pdf but one sentence kind of bothers me:

GANs and VAEs have demonstrated impressive performance results on
challenging tasks such as learning distributions of natural images.
However, several issues limit their application in practice. Neither
allows for exact evaluation of the probability density of new points.

Maybe I misinterpret it somehow... But can someone explain to me why VAE (or GAN to this matter) cannot evaluate probability density of new points? Isn't it the whole idea of estimating PDF's parameters, so we can evaluate it at any point we want, i.e. new points?
Or do you think the author was making emphasis on "exact evaluation" part?

They're some sort of generative models, learning the PDF so that they can sample from it. This is achieved by having random latent representations and mapping them to the relevant domain. So, you can easily generate new samples, but, this is not the same thing as calculating the probability of that sample. The learnt parameters belong to the neural network, not the PDF itself directly. There is no explicit calculation of the probability. To do that, you may need to resort to Monte Carlo methods.
