Cart-Pole Balancing
Score
TRPO
Continuous Control
4869.8
Inverted Pendulum
Score
TRPO
Continuous Control
247.2
Mountain Car
Score
TRPO
Continuous Control
-61.7
Acrobot
Score
TRPO
Continuous Control
-326
Double Inverted Pendulum
Score
TRPO
Continuous Control
4412.4
Swimmer
Score
TRPO
Continuous Control
96
Hopper
Score
TRPO
Continuous Control
1183.3
2D Walker
Score
TRPO
Continuous Control
1353.8
Half-Cheetah
Score
TRPO
Continuous Control
1914
Ant
Score
TRPO
Continuous Control
730.2
Simple Humanoid
Score
TRPO
Continuous Control
269.7
Full Humanoid
Score
TRPO
Continuous Control
287
Cart-Pole Balancing (limited sensors)
Score
TRPO
Continuous Control
960.2
Inverted Pendulum (limited sensors)
Score
TRPO
Continuous Control
4.5
Mountain Car (limited sensors)
Score
TRPO
Continuous Control
-64.2
Acrobot (limited sensors)
Score
TRPO
Continuous Control
-83.3
Cart-Pole Balancing (noisy observations)
Score
TRPO
Continuous Control
606.2
Inverted Pendulum (noisy observations)
Score
TRPO
Continuous Control
10.4
Mountain Car (noisy observations)
Score
TRPO
Continuous Control
-60.2
Acrobot (noisy observations)
Score
TRPO
Continuous Control
-149.6
Cart-Pole Balancing (system identifications)
Score
TRPO
Continuous Control
980.3
Inverted Pendulum (system identifications)
Score
TRPO
Continuous Control
14.1
Mountain Car (system identifications)
Score
TRPO
Continuous Control
-61.6
Acrobot (system identifications)
Score
TRPO
Continuous Control
-170.9
Swimmer + Gathering
Score
TRPO
Continuous Control
0
Ant + Gathering
Score
TRPO
Continuous Control
-0.4
Swimmer + Maze
Score
TRPO
Continuous Control
0
Ant + Maze
Score
TRPO
Continuous Control
0