the original input image to a larger dimension (for example
11001100 ). The up-sampling is done to minimize the loss
of information due to the input shrinkage caused by pooling
at the different layers. Afterwards, we feed the up-sampled
image through 16convolutional layers of the VGG net.
We use the VGG net as our model because it has been
trained to recognize a large number of object classes (the
1000 categories of the ImageNet dataset [24]) and thus encodes object-level features that apply to many classes. To
preserve speciﬁc location information we utilize only the
16convolutional layers of the VGG net. We don’t use fully
connected layers because they don’t preserve spatial information, which is crucial for accurate boundary detection.
We visualize some of the selected convolutional maps in
Figure 2. Note the high activation values around the various objects in the images, which conﬁrms our hypothesis
that the VGG net encodes object speciﬁc information in its
convolutional feature maps.
3.3. Feature Interpolation
Similarly to [26, 12, 19], we perform feature interpolation in deep layers. After the up-sampled image passes
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani