of the two pixel sets over the size of their union.
9
To compute the overall quality for the whole database,
we ﬁrst select the best proposal for each annotated
instance with respect to J. The Jaccard index at instance
level (Ji) is then deﬁned as the mean best overlap for all
the ground-truth instances in the database, also known
as Best Spatial Support score (BSS) [4] or Average Best
Overlap (ABO) [12].
Computing the mean of the best overlap on all objects,
as done by Ji, hides the distribution of quality among
different objects. As an example, Ji= 0:5can mean
that the algorithm covers half the objects perfectly and
completely misses the other half, or can also mean that
all the objects are covered exactly at J= 0:5. This
information might be useful to decide which algorithm
to use. Computing a histogram of the best overlap would
provide very rich information, but then the resulting
plot would be 3D (number of proposals, bins, and bin
counts). Alternatively, we propose to plot different percentiles of the histogram.
Interestingly, a certain percentile of the histogram
of best overlaps consists in computing the number of
objects whose best overlap is above a certain Jaccard
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik