I did this a month ago and I didn’t push the repo as I thought it was not that useful.
But if someone wants to explore deeper architectures than a simple linear model and run ars-based policy search (https://arxiv.org/abs/1803.07055 1), or even try Open-AI evolution strategies (https://arxiv.org/abs/1703.03864), this “optimizer” may save a bunch of lines.

  
      
      GitHub
  
  
    

alexis-jacq/Pytorch_Policy_Search_Optimizer 11

Pytorch_Policy_Search_Optimizer - A tool for optimizing RL policy modules based on random search