Disclosed is a system and method of image-based space detection. The system includes an image selection module, a 3-layer detection mechanism and an optimization module. At least one image processing area that may affect space-status judgment is selected from plural image processing areas. The 3-layer detection mechanism having an observation layer, a labeling layer, and a semantic layer observes the information about the selected image processing area, associates with a local classification model, and adjacent local constraint model and a global semantics model to completely describe the probability distribution of the links among the three layers, and provide global label constraint information. The optimization module analyzes the probability distribution and global label constraint information, and generates an image-based optimized space detection result.
System and method of image-based space detection