second. In contrast to these approaches, we focus on
the ﬁner-grained task of pixel-accurate object extraction,
rather than on window selection. However, by just taking the bounding box around our segmented proposals,
our results are also state of the art as window proposals.
Among the methods that produce segmented proposals, Carreira and Sminchisescu [18] hypothesize a set of
placements of fore- and background seeds and, for each
conﬁguration, solve a constrained parametric min-cut
(CPMC) problem to generate a pool of object hypotheses.
Endres and Hoiem [19] base their category-independent
object proposals on an iterative generation of a hierarchy
of regions, based on the contour detector of [20] and
occlusion boundaries of [28]. Kim and Grauman [17]
propose to match parts of the shape of exemplar objects,
regardless of their class, to detected contours by [20].
They infer the presence and shape of a proposal object
by adapting the matched object to the computed superpixels.
Uijlings et al. [12] present a selective search algorithm
based on segmentation. Starting with the superpixels
of [21] for a variety of color spaces, they produce a set of
segmentation hierarchies by region merging, which are
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik