Machine Learning, AI, Reinforcement Learning, Optimization, Neural Networks.
mathematics: the mean of our GaussianActor changes very slowly compared to the standard deviation. Essentially, this is because self.log_sigma is in log-space, and updates to self.log_sigma cause exponentially larger changes to the standard deviation. We can manually increase the learning rate for