method. In Figure 6 we show for each input image example, the set of candidate points produced by the Canny edge
detector, the un-thresholded predictions of our method, the
thresholded predictions, and the ground truth contour map
computed as an average of the multiple manual annotations.
To generate the thresholded predictions, we use a probability threshold of 0:5.
Note that our method successfully distinguishes between
strong and weak contours. Speciﬁcally, observe that in the
last row of Figure 6, our method assigns lower probability
to contours corresponding to zebra stripes compared to the
contours of the actual object boundary separating the zebras
from the background. Thus, in the thresholded version of
the prediction, the weak contours inside the zebra bodies
are removed and we obtain contour predictions that look
very similar to the ground truth.
Due to locality of our method, it may be beneﬁcial
to apply spectral methods [21, 30] or conditional randomﬁelds [27] on top of our method to further improve its performance.
4.7. Computational Cost
In its current form, our method requires about 60KKNet
evaluations ( 15Kper scale) to extract the features. Based
on the runtimes reported in [14], if executed on a GPU our
Contour detection has been a fundamental component in many image segmentation
and object detection systems. Most previous work utilizes low-level features
such as texture or saliency to detect contours and then use them as cues for a
higher-level task such as object detection. However, we claim that recognizing
objects and predicting contours are two mutually related tasks. Contrary to
traditional approaches, we show that we can invert the commonly established
pipeline: instead of detecting contours with low-level cues for a higher-level
recognition task, we exploit object-related features as high-level cues for
contour detection.
  We achieve this goal by means of a multi-scale deep network that consists of
five convolutional layers and a bifurcated fully-connected sub-network. The
section from the input layer to the fifth convolutional layer is fixed and
directly lifted from a pre-trained network optimized over a large-scale object
classification task. This section of the network is applied to four different
scales of the image input. These four parallel and identical streams are then
attached to a bifurcated sub-network consisting of two independently-trained
branches. One branch learns to predict the contour likelihood (with a
classification objective) whereas the other branch is trained to learn the
fraction of human labelers agreeing about the contour presence at a given point
(with a regression criterion).
  We show that without any feature engineering our multi-scale deep learning
approach achieves state-of-the-art results in contour detection.
Gedas Bertasius Jianbo Shi Lorenzo Torresani