represent the regions in a partition as nodes of a graph,
we can then represent the result of merging them as their
parent in a tree. The result of sweeping all ivalues
can therefore be represented as a region tree, whose root
is the region representing the whole image (right part
of Figure 3). Given that each merging is associated with
a contour strength, the region tree is in fact a region
dendogram.
As an example, in the gPb-ucm algorithm of [20],
brightness, color and texture gradients at three ﬁxed disk
sizes are ﬁrst computed. These local contour cues are
globalized using spectral graph-partitioning, resulting in
the gPb contour detector. Hierarchical segmentation is
then performed by iteratively merging adjacent regions
based on the average gPb strength on their common
boundary. This algorithm produces therefore a tree of
regions at multiple levels of homogeneity in brightness,
color and texture, and the boundary strength of its UCM
can be interpreted as a measure of contrast.
Coarse-to-ﬁne is a powerful processing strategy in
computer vision. We exploit it in two different ways
to develop an efﬁcient, scalable and high-performance
segmentation algorithm: (1) To speed-up spectral graph
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik