increasing thus the likelihood of having complete objects
in the pool of proposals. Our approach has therefore
the ﬂexibility to adapt to speciﬁc applications and types
of objects, and can produce proposals at any trade-off
between their number and their accuracy.
3 T HESEGMENTATION ALGORITHM
Consider a segmentation of the image into regions that
partition its domain S=fSigi. A segmentation hierarchy
is a family of partitions fS;S1;:::;SLgsuch that: (1)
Sis the ﬁnest set of superpixels , (2)SLis the complete
domain, and (3) regions from coarse levels are unions of
regions from ﬁne levels. A hierarchy where each level Si
is assigned a real-valued index ican be represented by a
dendrogram, a region tree where the height of each node
is its index. Furthermore, it can also be represented as an
ultrametric contour map (UCM), an image obtained by
weighting the boundary of each pair of adjacent regions
in the hierarchy by the index at which they are merged
[31], [32]. This representation uniﬁes the problems of
contour detection and hierarchical image segmentation:
*
##
#
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik