Note that the eigenvectors contain soft segmentation information. Because H FL boundaries predict object-level
contours with high conﬁdence, the eigenvectors often capture regions corresponding to objects. We visualize a few
selected eigenvectors in Figure 8. In the experimental section, we demonstrate that our proposed features make the
output produced by DeepLab-CRF more spatially coherent
and improve the segmentation accuracy according to one of
the metrics.
We also note that our proposed features are applicable to any generic method that incorporates CRF. For instance, even if DeepLab-CRF used an improved DeepLab
network architecture, our features would still be beneﬁcial
because they contribute directly to the CRF part and not the
DeepLab network part of the system.
4.2.1 Semantic Segmentation Results
In this section, we present semantic segmentation results
on the SBD [11] and also Pascal VOC 2007 [8] datasets,
which both provide ground truth segmentations for 20Pascal VOC classes. We evaluate the results in terms of two
metrics. The ﬁrst metric measures the accuracy in terms of
pixel intersection-over-union averaged per pixel (PP-IOU)
across the 20 classes. According to this metric, the accuracy
is computed on a per pixel basis. As a result, the images that
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani