PROBLEM TO BE SOLVED: To provide a method, a system and a product for recognizing one or more objects in a scene and locating a position.SOLUTION: Images and/or video of a scene are captured. Using the audio recorded in the scene, the object search of the captured scene is narrowed. In order to limit the search area in the captured image/video, the direction of arrival (DOA) of the sound is determined and used. A key point signature is selected based on the type of sound identified in the recorded audio. The keypoint signature corresponds to a particular object that the system is configured to recognize. Objects in the scene are recognized using shift invariant feature transformation (SIFT) analysis, which compares the keypoint identified in the captured scene to the selected keypoint signature.SELECTED DRAWING: Figure 2
OBJECT RECOGNITION USING MULTIMODAL MATCHING METHOD