Index Terms —Image segmentation, object proposals, normalized cuts.
F
1 I NTRODUCTION
TWOparadigms have shaped the ﬁeld of object recognition in the last decade. The ﬁrst one, popularized
by the Viola-Jones face detection algorithm [1], formulates object localization as window classiﬁcation. The basic scanning-window architecture, relying on histograms
of gradients and linear support vector machines, was
introduced by Dalal and Triggs [2] in the context of
pedestrian detection and is still at the core of seminal
object detectors on the PASCAL challenge such as Deformable Part Models [3].
The second paradigm relies on perceptual grouping to
provide a limited number of high-quality and categoryindependent object proposals, which can then be described with richer representations and used as input to
more sophisticated learning methods. Examples in this
family are [4], [5]. Recently, this approach has dominated
the PASCAL segmentation challenge [6], [7], [8], [9], improved object detection [10], ﬁne-grained categorization
[11] and proven competitive in large-scale classiﬁcation
[12].
Since the power of this second paradigm is critically
dependent on the accuracy and the number of object
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik