Reinforcement Learning, Actor Critic, Deep Learning, Pytorch, Machine Learning.
do not support rsample() and so its actions are not differentiable. The key idea is that we need a discrete distribution that is reparametrizable. There is one such distribution — the GumbelSoftmax distribution. PyTorch does not have this built-in, so I simply extend it from a close cousin which