[31], [32]. This representation uniﬁes the problems of
contour detection and hierarchical image segmentation:
*
##
#
Fig. 3. Duality between a UCM and a region tree :
Schematic view of the dual representation of a segmentation hierarchy as a region dendrogram and as an
ultrametric contour map.
a threshold at level iin the UCM produces the segmentationSi.
Figure 3 schematizes these concepts. First, the lower
left corner shows the probability of boundary of a UCM.
One of the main properties of a UCM is that when we
threshold the contour strength at a certain value, we
obtain a closed boundary map, and thus a partition.
Thresholding at different i, therefore, we obtain the
so-called merging-sequence partitions (left column in
Figure 3); named after the fact that a step in this sequence
corresponds to merging the set of regions sharing the
boundary of strength exactly i.
For instance, the boundary between the wheels and
the ﬂoor has strength 1, thus thresholding the contour
above1makes the wheels merge with the ﬂoor. If we
represent the regions in a partition as nodes of a graph,
we can then represent the result of merging them as their
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik