In fact, my implementation only solves the invertpendulum environment. I am searching for any help, but the paper is not clearly describing the pseudocode (a lot of sub-steps and hyperparameters are not detailed either in DPPO paper and PPO_clip paper). Besides, the only implementation I found is the official TF implementation 23 by John Schulman, which I almost rigorously translated into Pytorch, without success.
Unfortunately for me, I can’t even try the TF implementation, since python3 version of mujoco seems incompatible with my machine . It could have at least provided me with some helpful expectation, like what looks like a “working” learning curve.
If any one has some useful documentation or an implementation that works (any language/library) of any close algorithm (TRPO, A2C), please tell me