Disclosed in the present invention are a gray level and depth information based multi-layer fusion multi-modal face recognition device and method, the method mainly comprising the steps of: recognizing gray level information of a human face; recognizing depth information of the human face; normalizing the gray level information and the depth information of the human face, and on the basis of normalized matching scores, acquiring a matching score fused multi-modally by adopting a fusion approach to achieve multi-modal face recognition. In the solution of the present invention, a multi-modal system collects two-dimensional gray level information and three-dimensional depth information, takes advantages from the two-dimensional gray level information and the three-dimensional depth information, and overcomes inherent shortcomings of a single-modal system (such as illumination for gray level images and expressions for depth images) via the fusion approach, thereby effectively improving the performance of the face recognition system and bringing more accurate and rapid face recognition.
GRAY LEVEL AND DEPTH INFORMATION BASED MULTI-LAYER FUSION MULTI-MODAL FACE RECOGNITION DEVICE AND METHOD