Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
objects. When a particular dimension of z is “on” (i.e. equals 1) we know that class is present in the image. To train the discrete VAE, we apply the Gumbel softmax trick instead of the usual Reparameterization trick to differentiate through sampling z. Recall that the VAE loss is: Where Q(z|x) is