X-axis and Y-axis sensor arrays detect hand motion. The array data are processed by a trained model gesture recognizer to discriminate between grab and touch gestures. Touch gestures are further processed using touch point classifier, Hidden Markov Model and peak detector to discriminate between single point touch and multiple point touch. A Kalman tracker analyzes the trajectories of the X and Y axis data to determine how to associate X and Y axis data into ordered pairs corresponding to the touch points. The system resolves ambiguities inherent in certain sensor arrays and will also detect grab and drop gestures where the detected hand is sometimes out of sensor range during the gestural sequence.
SYSTEM AND METHOD FOR GRAB AND DROP GESTURE RECOGNITION