candidate point, we ﬁnd its correspondence in each of the
feature maps and perform feature interpolation. This yields
a5504 -dimensional feature vector for each candidate point.
We feed each of these vectors to two fully connected layers
and store the predictions to produce a ﬁnal boundary map.
the complicated multi-scale and bifurcated architecture of
DeepEdge. Additionally, unlike DeepEdge, our system can
run in near-real time.
In comparison to prior approaches, we offer several contributions. First, we propose to use object-level information to predict boundaries. We argue that such an approach
leads to semantic boundaries, which are more consistent
with humans reasoning. Second, we avoid feature engineering by learning boundaries from human-annotated data.
Finally, we demonstrate excellent results for both low-level
and high-level vision tasks. For the boundary detection task,
our proposed H FL boundaries outperform all of the prior
methods according to both F-score metrics. Additionally,
we show that because H FL boundaries are based on objectlevel features, they can be used to improve performance in
the high-level vision tasks of semantic boundary labeling,
semantic segmentation, and object proposal generation.
3. Boundary Detection
In this section, we describe our proposed architecture
and the speciﬁc details on how we predict H FL boundaries
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani