8:end for
9:return UCM
Observe that the routines sampleHierarchy and
extractBoundary can be computed efﬁciently because
they involve only thresholding operations and connected
components labeling. The complexity is thus dominated
by rescaleSegmentation in Step 4, a nearest neighbor
interpolation, and the projection in Step 5, which are
computedKtimes.
3.3 Multiscale Hierarchical Segmentation
Single-scale segmentation : We consider as input
the following local contour cues: (1) brightness, color and
texture differences in half-disks of three sizes [33], (2)
sparse coding on patches [22], and (3) structured forest
contours [34]. We globalize the contour cues independently using our fast eigenvector gradients of Sect. 3.1,
combine global and local cues linearly, and construct
an UCM based on the mean contour strength. We tried
learning weights using gradient ascent on the F-measure
on the training set [20], but evaluating the ﬁnal hierarchies rather than open contours. We observed that this
objective favors the quality of contours at the expense of
regions and obtained better overall results by optimizing
the Segmentation Covering metric [20].
We propose a unified approach for bottom-up hierarchical image segmentation
and object proposal generation for recognition, called Multiscale Combinatorial
Grouping (MCG). For this purpose, we first develop a fast normalized cuts
algorithm. We then propose a high-performance hierarchical segmenter that makes
effective use of multiscale information. Finally, we propose a grouping
strategy that combines our multiscale regions into highly-accurate object
proposals by exploring efficiently their combinatorial space. We also present
Single-scale Combinatorial Grouping (SCG), a faster version of MCG that
produces competitive proposals in under five second per image. We conduct an
extensive and comprehensive empirical validation on the BSDS500, SegVOC12, SBD,
and COCO datasets, showing that MCG produces state-of-the-art contours,
hierarchical regions, and object proposals.
Jordi Pont-Tuset Pablo Arbelaez Jonathan T. Barron Ferran Marques Jitendra Malik