A system for combining virtual images with images of the real world. A range scanner (101) determines the shape and distance of real-world objects (102) within a field of interest (103) to the observer using the apparatus. Virtual masking objects (106), which are simplified computer models of real-world objects, are derived from the range data (104). Virtual entities (108) that are not present in the real world are simulated in an electronic computer (107). Images of the virtual entities (108) and the virtual masking objects (106) are combined into masked virtual images. The masked virtual images show the portions of virtual entities (108) that would be visible if these entities (108) actually existed in the real world. The masked virtual images and images (114) of the real world scene are combined (110) in such a manner that the virtual images appear to be obscured, when appropriate for their simulated, virtual location by real-world objects (102). The resulting combined image is presented in an electronic or optical display (111).
SYSTEM FOR COMBINING VIRTUAL IMAGES WITH REAL-WORLD SCENES