R5R6
(b)
R9
R7
R1R2R3R4R8
R5R6
(c)
Fig. 6. Object segmentation as combinatorial optimization : Examples of objects (b), (c), formed by selecting regions from a hierarchy (a).
Since hierarchies are built taking only low-level features into account, and do not use semantic information,
objects will usually not be optimally represented using a
single region in the hierarchy. As an example, Figure 6(c)
shows the optimum representation of the car, consisting
of three regions.
A sensible approach to create object proposals is therefore to explore the set of n-tuples of regions. The main
idea behind MCG is to explore this set efﬁciently, taking
advantage of the region tree representation, via the fastcomputation of region neighbors.
The whole set of tuples, however, is huge, and so it
is not feasible to explore it exhaustively. Our approach
ranks the proposals using the height of their regions in
the tree (UCM strength) and explores the tree from the
top, but only down to a certain threshold. To speed the
process up, we design a top-down algorithm to compute
the region neighbors and thus only compute them down
to a certain depth in the tree.
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik