space of our multiscale regions (Sect. 5).arXiv:1503.00848v4  [cs.CV]  1 Mar 2016
2
F ixed-Scale
Segmentation R escaling &
A lignment C ombination  R es oluti on 
C ombinatorial
Grouping
 
I mage P yramid  Segmentati on P yramid  Al i gned  H iera rchies  Object Proposals  
 Multiscale Hierarchy
Fig. 2. Multiscale Combinatorial Grouping . Starting from a multiresolution image pyramid, we perform hierarchical
segmentation at each scale independently. We align these multiple hierarchies and combine them into a single
multiscale segmentation hierarchy. Our grouping component then produces a ranked list of object proposals by
efﬁciently exploring the combinatorial space of these regions.
We conduct a comprehensive and large-scale empirical
validation. On the BSDS500 (Sect. 4) we report signiﬁcant
progress in contour detection and hierarchical segmentation. On the VOC2012, SBD, and COCO segmentation
datasets (Sect. 6), our proposals obtain overall state-ofthe-art accuracy both as segmented proposals and as
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik