Reinforcement Learning, Deep Learning, Artificial Intelligence, Data Science.
like AdamW or RMSProp. For Policy gradient methods, look into methods like PPO that take advantage of the trust region. We need to slow down the changes in input and output to give them a chance for the model to learn and evolve. Overfitting Data v.s. Overfitting Task In DL, we use regularization