PROBLEM TO BE SOLVED: To provide a method of recognizing emotion of a human being and behavior thereof.SOLUTION: A method for recognizing behavior includes the steps of: capturing at least one video data stream on a subject; extracting body skeleton data from the video data stream; computing feature extractions on the extracted body skeleton data to generate a plurality of three-dimensional delta units for each frame of the extracted body skeleton data; generating a plurality of histogram sequences for each frame by projecting the plurality of three-dimensional delta units for each frame to a spherical coordinate system having a plurality of spherical bins; generating an energy map for each of the plurality of histogram sequences by mapping the plurality of spherical bins with respect to time; applying an algorithm of Histogram of Oriented Gradients (HOG) to the plurality of energy maps to generate a single column vector; and classifying the single column vector as behavior and/or emotion.
METHOD AND SYSTEM FOR EMOTION AND BEHAVIOR RECOGNITION