An augmented reality-based hand interaction apparatus and method using image information. The augmented reality-based hand interaction apparatus using image information includes an object recognition module configured to extract feature points from an input color image, recognize an object which is a target of interest based on the extracted feature points, and estimate a three-dimensional (3D) posture of the recognized object, and an interaction module configured to extract 3D mesh information from an input depth image, match 3D coordinates of the extracted 3D mesh information with 3D coordinates of the object recognized by the object recognition module to extract 3D position information of the recognized object in 3D space, and detect whether or not an augmented 3D object and the recognized object collide with each other based on relative positional relationship information between the recognized object and the augmented 3D object.
Augmented reality-based hand interaction apparatus and method using image information