A Method of Interaction with AR Object Using Hand Gesture and Arm Movement Recognition in Augmented Reality Advertising
Gesture based user interfaces are more intuitive than touch screen based user interfaces when manipulating 3D objects in mobile augmented reality (AR) so they can provide users with more natural interaction with the AR. Instead of the existing touch screen based interface, in this paper, we proposed and implemented a user interface that utilizes hand gestures and arm movements as an interaction method Received (April 7, 2017) Review Result (April 21, 2017) Accepted (April 28, 2017) Published (June 30, 2017) 24252 Dept. Electronic Engineering, Hallym Univ. Hallymdaehak gil 1, Chunchon, Korea email kevin@hallym.ac.kr 24252 Dept. Electronic Engineering, Hallym Univ. Hallymdaehak gil 1, Chunchon, Korea email m14107@hallym.ac.kr 04763 Dept. Electronic Engineering, Hanyang. Wangsimri ro, Seongdong gu, Seoul Korea email jijung@hanyang.ac.kr 4 (Corresponding Author) 242252 Dept. Electronic Engineering, Hallym Univ. Hallymdaehak gil 1, Chunchon, Korea email spark@hallym.ac.kr A Method of Interaction with AR Object Using Hand Gesture and Arm Movement Recognition in Augmented Reality Advertising Copyright c 2017 HSST 818 between user and 3D advertisement contents in AR advertising. In order to recognize hand gestures and arm movements, we used signals from multiple sensors on wearable arm band in combination such as electromyography sensors, acceleration sensors, gyro sensors, and magnetic sensor. We extended our existing CARDA assets by adding an interface to track hand gestures and arm movements. In order to implement a user interface that gives the user the feeling of manipulating objects in the real world, we defined gestures for object manipulation based on the gestures of rotation, zooming, and object selection collected from 30 persons and implemented the gesture interaction of the 3D object with the user.