PURPOSE: A combined stereo camera and stereo display interaction are provided to connect a VR(Virtual Reality) client to an AR(Augmented Reality) client by maintaining a dynamic and spatial correlation between a VR application and an AR application. CONSTITUTION: A plurality of trackers(312~318) tracks motions of a user based on captured images. An event generator(308) generates an event stream related to the motions of the user. The event processor maps the event stream in state changes of a virtual word. One or more three dimensional display units(320) display models of a real word scene. One or more AR clients display information overlapped on the video steam of the real world scene. [Reference numerals] (300) System; (302) User; (304) Three dimensional camera; (306) Calibrator; (308) Event generator; (310) Mapper; (312) Eye tracker; (314) Hand tracker; (316) Head tracker; (318) Body tracker; (320) 3D display; (AA) Tracking module
COMBINED STEREO CAMERA AND STEREO DISPLAY INTERACTION