Reinforcement Learning, Actor Critic, Deep Learning, Pytorch, Machine Learning.
Appendix C) described a derivative function for doing so. However for discrete action, the papers did not mention anything. As a result I have not seen any implementation which has a simple discrete counterpart to the action rsample() and log prob calculation. Most standard discrete distributions