Scale 1.0
Scale 0.5
Multi-Scale
Fig. 10. Region distribution learnt by the Pareto front
optimization on SegVOC12.
The improvement of considering the combination of
all 1-region proposals ( ) from the 3 scales and the
MCG-UCM-Our with respect to the raw MCG-UCM-Our
( ) is signiﬁcant, which corroborates the gain in diversity obtained from hierarchies at different scales. In turn,
the addition of 2- and 3-region proposals ( and )
noticeably improves the achievable quality. This shows
that hierarchies do not get full objects in single regions,
which makes sense given that they are built using lowlevel features only. The improvement when adding 4tuples ( ) is marginal at the number of proposals we
are considering. When analyzing the equal distribution
of proposals from the four scales ( ), we see that the
less proposals we consider, the more relevant the Pareto
optimization becomes. At the selected working point, the
gain of the Pareto optimization is 2 points.
Figure 10 shows the distribution of proposals from
each of the scales combined in the Pareto front. We
see that the coarse scale (0.5) is the most picked at
low number of proposals, and the rest come into play
when increasing their number, since one can afford more
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik