Reinforcement Learning, Actor Critic, Deep Learning, Pytorch, Machine Learning.
action tensor carries a gradient to be differentiable. This is simple for any continuous distributions which supports a rsample() method. Additionally, continuous actions often needs to be bound within a range, say [-1, 1], so the log prob calculation needs to be bounded as well. The papers (in