process up, we design a top-down algorithm to compute
the region neighbors and thus only compute them down
to a certain depth in the tree.
To further improve the results, we not only consider
then-tuples from the resulting MCG-UCM-Our hierarchy, but also the rest of hierarchies computed at different
scales. As we will show in the experiments, diversity
signiﬁcantly improves the proposal results.
Parameter Learning via Pareto Front Optimization :
MCG takes a set of diverse hierarchies and computes the
n-tuples up to a certain UCM strength. We can interpret
then-tuples from each hierarchy as a ranked list of Ni
proposals that are put together to create the ﬁnal set of
Npproposals.
At training time, we would like to ﬁnd, for different values of Np, the number of proposals from each
ranked list Nisuch that the joint pool of Npproposals
has the best achievable quality. We frame this learning
problem as a Pareto front optimization [39], [40] with
two conﬂicting objective functions: number of proposals
and achievable quality. At test time, we select a working
point on the Pareto front, represented by the
Ni
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik