Disclosed are an apparatus for recognizing user emotion to allow natural conversation based on a state of user, a method thereof, and a robot system using the apparatus. An image photographing unit of the apparatus photographs an external image, and a face recognizing unit recognizes a face image from the image photographed by the image photographing unit. An emotion recognizing unit learns an emotion corresponding to the face image by using a neural network model, and recognizes the emotion corresponding to the face image recognized by the face recognizing unit by using the learning results, herein, the emotion recognizing unit transmits the face image inputted from the face recognizing unit to an external cloud server serving as a server capable of learning by using the neural network model so as to perform the emotion learning corresponding to the face image, transmits the face image inputted from the face recognizing unit to the cloud server to request to recognize the emotion corresponding to the face image, and then receives the emotion recognition result transmitted from the cloud server and outputs the result to the outside.
ROBOT SYSTEM