Art: Although focused in providing segmented object
proposals, MCG may also be used to provide boxes
proposals, by taking the bounding box of the segmented
proposals and deduplicating them. We add the state
of the art in boxes proposals [26], [27], [25], and [16]
to the comparison. Figure 12 shows the recall values
of the boxes results when compared to the bounding
boxes of the annotated objects, for three different Jaccard
thresholds.
While many of the techniques speciﬁcally tailored to
boxes proposals are competitive at J= 0:5, their perfor-mance drops signiﬁcantly at higher Jaccard thresholds.
Despite being tailored to segmented proposals, MCG
clearly outperforms the state of the art if you look
for precise localization of the bounding boxes. Again,
SCG is very competitive, especially taking its speed into
account.
MCG and SCG Time per Image : Table 3 shows
the time per image of the main steps of our approach,
from the raw image to the contours, the hierarchical
segmentation, and the proposal generation. All times are
computed using a single core on a Linux machine. Our
full MCG takes about 25 s. per image to compute the
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik