A system and process for computing motion or depth estimates from multiple images. This is generally accomplished by associating a depth or motion map with each input image (or some subset of the images equal or greater than two), rather that computing a single map for all the images as has been done in the past. This ensures consistency between the estimates associated with different images. More particularly, a three-part cost function is minimized, which consists of an intensity (or color) compatibility constraint (708 & 716), a motion/depth compatibility constraint (712 & 718), and a flow smoothness constraint (738). In addition, a visibility term is added to the intensity (or color) compatibility and motion/depth compatibility constraints (714 - 722) to prevent the matching of pixels into areas that are occluded.
A MULTI-VIEW APPROACH TO MOTION AND STEREO