Objects in Context (COCO) [43]. They all consist of
images with annotated objects of different categories.
Table 2 summarizes the number of images and object
instances in each database.
Number of Number of Number of
Classes Images Objects
SegVOC12 20 2 913 9 847
SBD 20 12 031 32 172
COCO 80 123 287 910 983
TABLE 2
Sizes of the databases
Regarding the performance metrics, we measure the
achievable quality with respect to the number of proposals, that is, the quality we would have if an oracle
selected the best proposal among the pool. This aligns
with the fact that object proposals are a preprocessing
step for other algorithms that will represent and classify
them. We want, therefore, the achievable quality within
the proposals to be as high as possible, while reducing
the number of proposals to make the ﬁnal system as fast
as possible.
As a measure of quality of a speciﬁc proposal with
respect to an annotated object, we consider the Jaccard
indexJ, also known as overlap or intersection over
union; which is deﬁned as the size of the intersection
of the two pixel sets over the size of their union.
9
To compute the overall quality for the whole database,
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik