[11] and proven competitive in large-scale classiﬁcation
[12].
Since the power of this second paradigm is critically
dependent on the accuracy and the number of object
proposals, an increasing body of research has delved
J. Pont-Tuset and F. Marques are with the Department of Signal Theory
and Communications, Universitat Polit` ecnica de Catalunya, BarcelonaTech
(UPC), Spain. E-mail: fjordi.pont,ferran.marques g@upc.edu
P . Arbel´ aez is with the Department of Biomedical Engineering, Universidad de los Andes, Colombia. E-mail: pa.arbelaez@uniandes.edu.co
J. T. Barron, and J. Malik are with the Department of Electrical
Engineering and Computer Science, University of California at Berkeley,
Berkeley, CA 94720. E-mail: fbarron,malikg@eecs.berkeley.edu
* The ﬁrst two authors contributed equally
Fig. 1. Top: original image, instance-level ground truth
from COCO and our multiscale hierarchical segmentation. Bottom: our best object proposals among 150.
into the problem of their generation [13], [14], [15], [12],
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik