move to PASCAL, SBD, and COCO in Section 6 (e.g. see
Fig. 9).
Ground-Truth Hierarchy : In order to gain further
insights, we transfer the strength of each ground-truth
segmentation to our highest-resolution superpixels SN
and construct a combined hierarchy. This approximation to the semantic hierarchy, Ground-Truth Hierarchy
(GTH) in Fig. 5, is an upper-bound for our approach as
both share the same boundary locations and the only
difference is their strength. Since the strength of GTHis proportional to the number of subjects marking it, it
provides naturally the correct semantic ordering, where
outer object boundaries are stronger than internal parts.
Recently, Maire et al. [38] developed an annotation
tool where the user encodes explicitly the “perceptual
strength” of each contour. Our approach provides an
alternative where the semantic hierarchy is reconstructed
by sampling ﬂat annotations from multiple subjects.
5 O BJECT PROPOSAL GENERATION
The image segmentation algorithm presented in the
previous sections builds on low-level features, so its
regions are unlikely to represent accurately complete
objects with heterogeneous parts. In this context, object
proposal techniques create a set of hypotheses, possibly
overlapping, which are more likely to represent full
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik