second), which shows that our algorithm is faster than prior
approaches based on deep learning [27, 10, 16, 3].
Figure 5: Qualitative results on the BSDS benchmark. The
ﬁrst column of images represent input images. The second
column illustrates SE [6], while the third column depicts
HFL boundaries. Notice that SE boundaries are predicted
with low conﬁdence if there is no signiﬁcant change in color
between the object and the background. Instead, because
our model is deﬁned in terms of object-level features, it can
predict object boundaries with high conﬁdence even if there
is no signiﬁcant color variation in the scene.
aries that are marked by only one or two human annotators. These “orphan” boundaries comprise around 30% of
BSDS500 dataset but most of them are considered uninformative. However, the standard evaluation benchmark rewards the methods that predict these boundaries. To resolve
500 1000 1500 2000 2500 3000 3500 4000 4500 5000 5500024x 10−3Weight Magnitude
Feature Map Number (Sorted in the Order from Early to Deep Layers)Figure 6: We train a linear regression model and visualize
its weight magnitudes in order to understand which features
are used most heavily in the boundary prediction (this linear
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani