The invention relates to a method of visual voice recognition by following-up the local deformations of a set of points of interest of the speaker's mouth. The method comprises steps of: a) for each point of interest of each image, calculating a local gradient descriptor and a local movement descriptor; b) forming microstructures of n points of interest, each defined by a tuple of order n, with n>=1; c) determining, for each tuple of a vector of structured visual characteristics (d0 . . . d3 . . . ) based on the local descriptors; d) for each tuple, mapping this vector by a classification algorithm selecting a single codeword among a set of codewords forming a codebook (CB); e) generating an ordered time series of the codewords (a0 . . . a3 . . . ) for the successive images of the video sequence; and f) measuring, by means of a function of the String Kernel type, the similarity of the time series of codewords with another time series of codewords coming from another speaker.
Method of visual voice recognition by following-up the local deformations of a set of points of interest of the speaker's mouth