The present invention relates to the technical field of digital image processing. Disclosed is a virtual viewpoint synthesis method based on local image segmentation. According to the method, input left and right images are mapped to a virtual viewpoint for fusion to obtain a synthesized image; smooth denoising is performed on a rough and noisy depth map by utilizing object segmentation information of a scene; in a process of viewpoint synthesis, a shielding problem is resolved by segmentation of a local region; in the case that the depth map has a relatively large defect, it can be ensured that subjective quality of viewpoint synthesis is not significantly reduced, and geometrical information of the scene is kept to the best extent possible so as to generate real immersion; the disadvantage of significant reduction in synthesis quality of an existing method due to the fact that an error and noise exist in scene depth information is overcome; the method has relatively high robustness for the error in the scene depth map information. The present invention can be used for a video monitoring system, image processing software and the like.
VIRTUAL VIEWPOINT SYNTHESIS METHOD BASED ON LOCAL IMAGE SEGMENTATION