Hello,
I also implemented the policy gradient algorithm by minimizing the above loss. However, I observe a strange behavior that while the loss decreases, the reward also decreases quickly and log_prob increases. After spending whole day, I still have no idea. What is possible reason for that?
Thanks!