Hi,
I am unable to figure it out how PPO is to be implemented with LSTM.
Also,given the main objective of PPO is to have an update near to the current policy…is it same to clip the gradient in A3C to a small value and then expect the results to be same as PPO??
may I get help in how to implement this and if there a correct implementation of ppo+lstm can you please help to share.
Thanks