to develop an efﬁcient, scalable and high-performance
segmentation algorithm: (1) To speed-up spectral graph
partitioning and (2) To create aligned segmentation hierarchies.
4
3.1 Fast Downsampled Eigenvector Computation
The normalized cuts criterion is a key globalization
mechanism of recent high-performance contour detectors such as [20], [22]. Although powerful, such spectral
graph partitioning has a signiﬁcant computational cost
and memory footprint that limit its scalability. In this
section, we present an efﬁcient normalized cuts approximation which in practice preserves full performance for
contour detection, while having low memory requirements and providing a 20speed-up.
Given a symmetric afﬁnity matrix A, we would like
to compute the ksmallest eigenvectors of the Laplacian
ofA. Directly computing such eigenvectors can be very
costly even with sophisticated solvers, due to the large
size ofA. We therefore present a technique for efﬁciently
approximating the eigenvector computation by taking
advantage of the multiscale nature of our problem: A
models afﬁnities between pixels in an image, and images
naturally lend themselves to multiscale or pyramid-like
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik