(per pixel) and PI-IOU (per image) evaluation metrics. We denote the original DeepLab-CRF system and our proposed
modiﬁcation as DL-CRF and DL-CRF+H FL, respectively. According to the PP-IOU metric, our proposed features (DLCRF+H FL) yield almost equivalent results as the original DeepLab-CRF system. However, based on PI-IOU metric, our
proposed features improve the mean accuracy by 3%and1:9%on SBD and VOC 2007 datasets respectively.
ity matrix connecting every pair of pixels iandjthat have
distance 5or less from each other.
After building a boundary-based afﬁnity matrix Wwe
setDii=P
i6=jWijand compute eigenvectors vof the
generalized eigenvalue system:
(DW)v=Dv
We then resize the eigenvectors vto the original image
dimensions, and use them as additional features to the CRF
part of DeepLab-CRF system. In our experiments, we use
the16eigenvectors corresponding to the smallest eigenvalues, which results in 16extra feature channels.
Note that the eigenvectors contain soft segmentation information. Because H FL boundaries predict object-level
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani