but our squaring-and-decimation procedure means that
we do not depend on long-range connections between
pixels.
3.2 Aligning Segmentation Hierarchies
In order to leverage multi-scale information, our approach combines segmentation hierarchies computed
independently at multiple image resolutions. However, since subsampling an image removes details and
smooths away boundaries, the resulting UCMs are misaligned, as illustrated in the second panel of Fig. 2. In this
section, we propose an algorithm to align an arbitrary
segmentation hierarchy to a target segmentation and,
in Sect. 5, we show its effectiveness for multi-scale
segmentation.
The basic operation is to “snap” the boundaries of a
segmentationR=fRigito a segmentation S=fSjgj, as
illustrated in Fig. 4. For this purpose, we deﬁne L(Sj),
5
the new label of a region Sj2S, as the majority label of
its pixels inR:
L(Sj) = arg max
ijSj\Rij
jSjj(1)
We call the segmentation deﬁned by this new labeling of
all the regions of Stheprojection ofRontoSand denote
it by(R;S).
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik