our proposed learning strategy on the full 16 ranked lists
takes about 20 seconds to compute on the training set of
SegVOC12, while the singleton-limited full combination
takes 4 days (the full combination would take months).
Combinatorial Grouping : We now evaluate the
Pareto front optimization strategy in the training set of
SegVOC12. As before, we extract the lists of proposals
from the three scales and the multiscale hierarchy, for
singletons, pairs, triplets, and 4-tuples of regions, leading
to 16 lists, ranked by the minimum UCM strength of the
regions forming each proposal.
Figure 8 shows the Pareto front evolution of Jiwith
respect to the number of proposals for up to 1, 2, 3, and
4 regions per proposal (4, 8, 12, and 16 lists, respectively)
at training and testing time on SegVOC12. As baselines,
we plot the raw singletons from MCG-UCM-Our, gPbUCM, and Quadtree; as well as the uniform combination
of scales.103104105020406080100
Number of proposalsRegion distribution percentageScale 2.0
Scale 1.0
Scale 0.5
Multi-Scale
Fig. 10. Region distribution learnt by the Pareto front
optimization on SegVOC12.
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik