<p>I have written a tutorial on using OpenAI Spinning Up in a image-based PyBullet + Gym environment <a href="https://www.etedal.net/2020/04/pybullet-panda_3.html" rel="nofollow noreferrer">here</a></p>

<p>In order to be able to use spinup for an image-based environment I had to fork it <a href="https://github.com/mahyaret/spinningup" rel="nofollow noreferrer">here</a> and add CNN to PPO's core.py</p>

CC BY-SA 4.0
2020-04-25T14:58:22.413Z
2020-04-25T14:58:22.413Z
Mahyar
<p>I am using pytorch version of <a href="https://spinningup.openai.com/en/latest/algorithms/ppo.html#documentation-pytorch-version" rel="nofollow noreferrer">PPO</a> and I have image input that I need to process with convolutional neural networks, are there any examples on how to set up the network? I know that <a href="https://stable-baselines.readthedocs.io/en/master/" rel="nofollow noreferrer">stable baselines</a>  support this to some extend, but I had better performance with spinning up so I would prefer to keep using these. </p>

<reinforcement-learning><open-ai>
OpenAI spinning up convolutional networks with PPO
Visgean Skeloru
# OpenAI spinning up convolutional networks with PPO

(Asked by: username_0 on 2020-02-23)

I am using pytorch version of [PPO](https://spinningup.openai.com/en/latest/algorithms/ppo.html#documentation-pytorch-version) and I have image input that I need to process with convolutional neural networks, are there any examples on how to set up the network? I know that [stable baselines](https://stable-baselines.readthedocs.io/en/master/) support this to some extend, but I had better performance with spinning up so I would prefer to keep using these.

**Tags:** reinforcement-learning, open-ai


---

## 1 answers

### Answer by username_1 on 2020-04-25. Score: 0

I have written a tutorial on using OpenAI Spinning Up in a image-based PyBullet + Gym environment [here](https://www.etedal.net/2020/04/pybullet-panda_3.html)

In order to be able to use spinup for an image-based environment I had to fork it [here](https://github.com/mahyaret/spinningup) and add CNN to PPO's core.py


---

