used most heavily by our edge predictor. However, we can
gain a better insight by replacing the nonlinear function with
a simple linear model. In Fig. 6 we show the weight magnitudes of a simple linear regression model (we stress that
this linear model is used only for feature visualization purposes). From this Figure, we observe that many important
features are located in the deepest layers of the VGG network. As shown in [7], these layers encode high-level object information, which conﬁrms our hypothesis that highlevel information is useful for boundary detection.
Finally, we present some qualitative results achieved by
our method in Figure 5. These examples illustrate the effective advantage that H FL boundaries provide over another
state-of-the-art edge detection system, the SE system [6].
Speciﬁcally, observe the parts of the image where there is a
boundary that separates an object from the background but
where the color change is pretty small. Notice that because
the SE boundary detection is based on low-level color and
texture features, it captures these boundaries with very low
conﬁdence. In comparison, because H FL boundaries rely
on object-level features, it detects these boundaries with
high conﬁdence.4. High-Level Vision Applications
In this section, we describe our proposed Low-for-High
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani