objects with heterogeneous parts. In this context, object
proposal techniques create a set of hypotheses, possibly
overlapping, which are more likely to represent full
object instances.
Our approach to object proposal generation is to
combinatorially look for sets of regions from our segmentation hierarchies that merged together are likely
to represent complete objects. In this section, we ﬁrst
describe the efﬁcient computation of certain region descriptors on a segmentation tree. Then, we describe how
we use these techniques to efﬁciently explore the sets of
merged regions from the hierarchy. Finally, we explain
how we train the parameters of our algorithm for object
proposals and how we rank the candidates by their
probability of representing an object.
Fast computation of descriptors : Let us assume, for
instance, we want to compute the area of all regions
in the hierarchy. Intuitively, working strictly on the
merging-sequence partitions, we would need to scan all
pixels in all partitions. On the other hand, working on
the region tree allows us to scan the image only once to
compute the area of the leaves, and then propagate the
area to all parents as the addition of the areas of their
children.
As a drawback, the algorithms become intricate in
terms of coding and necessary data structures. Take, for
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik