A LeapMotion sensor based controller has been investigated to track the movement of the operator hands.  Kalman filtering (KF) algorithm is employed to fuse the position signals from the LeapMotion sensor with the velocity signals from the Kinect camera sensor, respectively. 
LeapMotion
A Kinect V2 camera is able to measure the corresponding motion velocities in x, y, z directions after our investigated post-processing algorithm is fulfilled. 
Kinect V2
Unreal Engine 4 is used to create an AR environment for the user to monitor the control process immersively. 
Unreal Engine 4
An Augmented Reality Based Human-Robot Interaction Interface Using Kalman Filter Sensor Fusion.In this paper, the application of Augmented Reality (AR) for the control and adjustment of robots has been developed, with the aim of making interaction and adjustment of robots easier and more accurate from a remote location.  Kalman filtering (KF) algorithm is employed to fuse the position signals from the LeapMotion sensor with the velocity signals from the Kinect camera sensor, respectively. 
Kalman Filter
The fused/optimal data are sent to teleoperate a Baxter robot in real-time by User Datagram Protocol (UDP). 
Baxter Robot
The fused/optimal data are sent to teleoperate a Baxter robot in real-time by User Datagram Protocol (UDP). 
User Datagram Protocol (UDP)