single scale setting.
4.3. Advantages of Higher-Level Features
In this section, we examine the validity of our earlier
claim that higher-level object-features enhance contour detection accuracy. In Table 3, we present individual contour
detection results using features from the different convolutional layers of KNet . Note that the 4thconvolutional layer
produces the most effective features when considering one
layer at a time. From our earlier discussion we know that
the4thconvolutional layer encodes higher-level object information related to shape and speciﬁc object parts. This
indicates that object speciﬁc cues are particularly beneﬁcial
for contour detection accuracy.
We also observe that by incorporating features from all
Input Image
 Canny Edges
 Raw DeepEdges
 Thresholded DeepEdges
 Ground Truth Edges
Figure 6: Qualitative results produced by our method. Notice how our method learns to distinguish between strong and
weak contours. For instance, in the last row of predictions, contours corresponding to zebra stripes are assigned much lower
probabilities than contours that correspond to the actual object boundaries separating the zebras from the background.
Conv. Layers ODS OIS AP
1st0.66 0.68 0.69
2nd0.71 0.74 0.76
Contour detection has been a fundamental component in many image segmentation
and object detection systems. Most previous work utilizes low-level features
such as texture or saliency to detect contours and then use them as cues for a
higher-level task such as object detection. However, we claim that recognizing
objects and predicting contours are two mutually related tasks. Contrary to
traditional approaches, we show that we can invert the commonly established
pipeline: instead of detecting contours with low-level cues for a higher-level
recognition task, we exploit object-related features as high-level cues for
contour detection.
  We achieve this goal by means of a multi-scale deep network that consists of
five convolutional layers and a bifurcated fully-connected sub-network. The
section from the input layer to the fifth convolutional layer is fixed and
directly lifted from a pre-trained network optimized over a large-scale object
classification task. This section of the network is applied to four different
scales of the image input. These four parallel and identical streams are then
attached to a bifurcated sub-network consisting of two independently-trained
branches. One branch learns to predict the contour likelihood (with a
classification objective) whereas the other branch is trained to learn the
fraction of human labelers agreeing about the contour presence at a given point
(with a regression criterion).
  We show that without any feature engineering our multi-scale deep learning
approach achieves state-of-the-art results in contour detection.
Gedas Bertasius Jianbo Shi Lorenzo Torresani