SC [22] 0.705 0.734 0.331 0.384 0.579 0.647 0.799 0.851 1.637 1.460
SF [34] 0.725 0.744 0.370 0.420 0.600 0.660 0.810 0.854 1.557 1.390
Comb. 0.725 0.757 0.371 0.408 0.611 0.670 0.813 0.862 1.548 1.367
TABLE 1
BSDS500 val set. Control experiments for single-scale
(top) and multiscale (bottom) hierarchical segmentation
with different input contour detectors
but omitted the strength transfer to the ﬁnest superpixels
before combining them. The ﬁrst ablated version produces interpolation artifacts and smooths away details,
while the second one suffers from misalignment. Both
fail to improve performance over the single-scale result,
which provides additional empirical support for our
multiscale approach. We also observed a small degradation in performance when forcing the input contour
detector to use only the original image resolution, which
indicates the advantages of considering multiscale information at all stages of processing.
Since there are no drastic changes in our results when
taking as input the different individual cues or their combination, in the sequel we use the version with structured
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik