Answers.Body: <p>I have written a tutorial on using OpenAI Spinning Up in a image-based PyBullet + Gym environment <a href="https://www.etedal.net/2020/04/pybullet-panda_3.html" rel="nofollow noreferrer">here</a></p>
  
  <p>In order to be able to use spinup for an image-based environment I had to fork it <a href="https://github.com/mahyaret/spinningup" rel="nofollow noreferrer">here</a> and add CNN to PPO's core.py</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-25T14:58:22.413Z
Answers.LastActivityDate: 2020-04-25T14:58:22.413Z
Answers.UserDisplayName: Mahyar
Body: <p>I am using pytorch version of <a href="https://spinningup.openai.com/en/latest/algorithms/ppo.html#documentation-pytorch-version" rel="nofollow noreferrer">PPO</a> and I have image input that I need to process with convolutional neural networks, are there any examples on how to set up the network? I know that <a href="https://stable-baselines.readthedocs.io/en/master/" rel="nofollow noreferrer">stable baselines</a>  support this to some extend, but I had better performance with spinning up so I would prefer to keep using these. </p>
  
Tags: <reinforcement-learning><open-ai>
Title: OpenAI spinning up convolutional networks with PPO
UserDisplayName: Visgean Skeloru
ThreadText: # OpenAI spinning up convolutional networks with PPO
  
  (Asked by: username_0 on 2020-02-23)
  
  I am using pytorch version of [PPO](https://spinningup.openai.com/en/latest/algorithms/ppo.html#documentation-pytorch-version) and I have image input that I need to process with convolutional neural networks, are there any examples on how to set up the network? I know that [stable baselines](https://stable-baselines.readthedocs.io/en/master/) support this to some extend, but I had better performance with spinning up so I would prefer to keep using these.
  
  **Tags:** reinforcement-learning, open-ai
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-04-25. Score: 0
  
  I have written a tutorial on using OpenAI Spinning Up in a image-based PyBullet + Gym environment [here](https://www.etedal.net/2020/04/pybullet-panda_3.html)
  
  In order to be able to use spinup for an image-based environment I had to fork it [here](https://github.com/mahyaret/spinningup) and add CNN to PPO's core.py
  
  
  ---
  
  