Pseudocode for our algorithm, which we call
“DNCuts” (Downsampled Normalized Cuts) is given in
Algorithm 1, where Ais our afﬁnity matrix and dis
the number of times that our squaring-and-decimation
operation is applied. Our algorithm repeatedly applies
our joint squaring-and-decimation procedure, computes
1. The Matlab-like notation A[:; i]indicates keeping the columns of
matrix Awhose indices are in the set i.Algorithm 1 dncuts (A;d;k )
1:A0 A
2:fors= [1;2;:::;d ]do
3:is pixel decimate (As1)
4:Bs As1[ :; is]
5:Cs diag (Bs~1)1Bs
6:As CT
sBs
7:end for
8:Xd ncuts (Ad;k)
9:fors= [d;d1;:::; 1]do
10:Xs1 CsXs
11:end for
12:return whiten (X0)
Fig. 4. Example of segmentation projection . In order to
“snap” the boundaries of a segmentation R(left) to those
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik