Hi @Kaixhin, i was just wondering if your TRPO/ACER implementation is open-source?
If not, in the mean time, there’s a couple of other PyTorch implementations if anyone’s interested in TRPO,

  
      
      GitHub
  
  
    

mjacar/pytorch-trpo 17

PyTorch Implementation of Trust Region Policy Optimization (TRPO) - mjacar/pytorch-trpo


  
  
    
    
  
  



  
      
      GitHub
  
  
    

ikostrikov/pytorch-trpo 10

PyTorch implementation of Trust Region Policy Optimization - ikostrikov/pytorch-trpo


  
  
    
    
  
  


Best regards,
Ajay