Hi @AjayTalati, It’s really nice to see someone also work on this, I’ve also implemented  continuous a3c and got some result on mujoco envs, you can check this out: https://github.com/andrewliao11/pytorch-a3c-mujoco 294