3.3. Feature Interpolation
Similarly to [26, 12, 19], we perform feature interpolation in deep layers. After the up-sampled image passes
through all 16convolutional layers, for each selected candidate contour point we ﬁnd its corresponding point in the
feature maps. Due to the dimension differences in convo-lutional maps these correspondences are not exact. Thus
we perform feature interpolation by ﬁnding the four nearest
points and averaging their activation values. This is done
in each of the 5504 feature maps. Thus, this results in a
5504 -dimensional vector for each candidate point.
We note that the interpolation of convolutional feature
maps is the crucial component that enables our system to
predict the boundaries efﬁciently. Without feature interpolation, our method would need to independently process
the candidate edge points by analyzing a small image patch
around each point, as for example done in DeepEdge [3]
which feeds one patch at a time through a deep network.
However, when the number of candidate points is large
(e.g., DeepEdge considers about 15K points at each of 4 different scales), their patches overlap signiﬁcantly and thus a
large amount of computation is wasted by recalculating ﬁlter response values over the same pixels. Instead, we can
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani