high conﬁdence.4. High-Level Vision Applications
In this section, we describe our proposed Low-for-High
pipeline: using low-level boundaries to aid a number of
high-level vision tasks. We focus on the tasks of semantic
boundary labeling, semantic segmentation and object proposal generation. We show that using H FL boundaries improves the performance of state-of-the-art methods in each
of these high-level vision tasks.
4.1. Semantic Boundary Labeling
The task of semantic boundary labeling requires not only
to predict the boundaries but also to associate a speciﬁc
object class to each of the boundaries. This implies that
given our predicted boundaries we also need to label them
with object class information. We approach this problem
by adopting the ideas from the recent work on Fully Convolutional Networks (FCN) [19]. Given an input image,
we concurrently feed it to our boundary-predicting network
(described in Section 3), and also through the FCN that was
pretrained for 20Pascal VOC classes and the background
class. While our proposed network produces H FL boundaries, the FCN model predicts class probabilities for each
of the pixels. We can then merge the two output maps as
follows. For a given boundary point we consider a 99
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani