Robotics, Reinforcement Learning, Machine Learning, Computer Vision, Simulation.
communicating frames to the RL policy, and the policy communicating actions to the robot controller had to be taken into account as well. The robot we used (Franka Emika Panda, more details in part 2) used an internal control loop of 1kHz, which means that even with the 300 fps feedback capture,