The invention relates to remotely controlling robotic platforms based on multi-modal sensory data. Provided are methods and systems for remotely controlling of robotic platforms in confined spaces or other like spaces not suitable for direct human operation. The control is achieved using multi-modal sensory data, which includes at least two sensory response types, such as a binocular stereoscopic vision type, a binaural stereophonic audio type, a force-reflecting haptic manipulation type, a tactile type, and the like. The multi-modal sensory data is obtained by a robotic platform positioned in a confined space and transmitted to a remote control station outside of the confined space, where it is used to generate a representation of the confined space. The multi-modal sensory data may be used to provide multi-sensory high-fidelity telepresence for an operator of the remote control station and allow the operator to provide more accurate user input. This input may be transmitted to the robotic platform to perform various operations within the confined space.
Remotely controlling robotic platforms based on multi-modal sensory data