Understanding the gap between simulation andreality is critical for reinforcement learning with legged robots, which are largely trained in simulation. However, recent workhas resulted in sometimes conflicting conclusions with regardto which factors are important for success, including therole of dynamics randomization. In this paper, we aim toprovide clarity and understanding on the role of dynamicsrandomization in learning robust locomotion policies for theLaikago quadruped robot. Surprisingly, in contrast to priorwork with the same robot model, we find that direct sim-to-real transfer is possible without dynamics randomizationor on-robot adaptation schemes. We conduct extensive abla-tion studies in a sim-to-sim setting to understand the keyissues underlying successful policy transfer, including otherdesign decisions that can impact policy robustness. We furtherground our conclusions via sim-to-real experiments with variousgaits , speeds, and stepping frequencies. Additional Details: URL
Understanding the gap between simulation and reality is critical for reinforcement learning with legged robots, which are largely trained in simulation. However, recent work has resulted in sometimes conflicting conclusions with regard to which factors are important for success, including the role of dynamics randomization. In this paper, we aim to provide clarity and understanding on the role of dynamics randomization in learning robust locomotion policies for the Laikago quadruped robot. Surprisingly, in contrast to prior work with the same robot model, we find that direct sim-to-real transfer is possible without dynamics randomization or on-robot adaptation schemes. We conduct extensive ablation studies in a sim-to-sim setting to understand the key issues underlying successful policy transfer, including other design decisions that can impact policy robustness. We further ground our conclusions via sim-to-real experiments with various gaits , speeds, and stepping frequencies. Additional Details: URL
R
andreality
and reality
R
workhas
work has
R
regardto
regard to
R
therole
the role
R
toprovide
to provide
R
dynamicsrandomization
dynamics randomization
R
theLaikago
the Laikago
R
priorwork
prior work
R
randomizationor
randomization or
R
abla-tion
ablation
R
keyissues
key issues
R
otherdesign
other design
R
furtherground
further ground
R
variousgaits
various gaits