A method for encoding a facial movement of a new face based on a voice and a 2-dimensional (2D) image signals in a 3-dimensional (3D) model-based coding system is provided. An adaptive 3D model is generated 10 from initial data of the new face based on a basic 3D model 14 of a common face of a human being; and a basic pattern 18 for the 2D image signal is produced by a rotation correlation between the 2D image signal 16 and the adaptive 3D model 10. One or more feature regions of the new face from the 2D image signal are compared 20-28 with the basic pattern so that a plurality of transformation parameters are detected. The transformation parameters are modified 36 based on the voice signal.
Encoding facial movement in a 3D model-based image coding system