Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
sample y from a Gumbel softmax distribution. Otherwise the math looks the same. Schematically, the VAE now looks like: The decoder now takes y as input instead of z. As usual backpropagation is done in two parts: from the discriminative loss D and the KL loss. After we have trained the discrete