based on segmentation. Starting with the superpixels
of [21] for a variety of color spaces, they produce a set of
segmentation hierarchies by region merging, which are
used to produce a set of object proposals. While we also
take advantage of different hierarchies to gain diversity,
we leverage multiscale information rather than different
3
color spaces.
Recently, two works proposed to train a cascade of
classiﬁers to learn which sets of regions should be
merged to form objects. Ren and Shankhnarovich [29]
produce full region hierarchies by iteratively merging
pairs of regions and adapting the classiﬁers to different
scales. Weiss and Taskar [30] specialize the classiﬁers also
to size and class of the annotated instances to produce
object proposals.
Malisiewicz and Efros [4] took one of the ﬁrst steps
towards combinatorial grouping, by running multiple
segmenters with different parameters and merging up
to three adjacent regions. In [8], another step was taken
by considering hierarchical segmentations at three different scales and combining pairs and triplets of adjacent
regions from the two coarser scales to produce object
proposals.
The most recent wave of object proposal algorithms
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik