variants of our method. Denoted by H FL-FC8 is the variant for which we label H FL boundaries with the outputs
from the last layer (FC8) of the pretrained FCN. We denote
with H FL-CRF the result of labeling our boundaries with
the output from the DeepLab-CRF [5]. Among these two
variants, we show that the latter one produces better results.
This is expected since the CRF framework enforces spatial
coherence in the semantic segments.
In Figure 7, we present some of the qualitative results
produced by our method. We note that even with multiple
objects in the image, our method successfully recognizes
and localizes boundaries of each of the classes.
4.2. Semantic Segmentation
For the semantic segmentation task, we propose to
enhance the DeepLab-CRF [5] with our predicted H FL
boundaries. DeepLab-CRF is a system comprised of a Fully
Convolutional Network (described in Section 4.1) and a
dense CRF applied on top of FCN predictions.
Speciﬁcally, in the CRF, the authors propose to use
a Gaussian kernel and a bilateral term including position
and color terms as the CRF features (see [5]). While in
most cases the proposed scheme works well, DeepLab-CRF
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani