pooling scheme, training objective). This will cast additional insight into the factors that critically contribute to the
high accuracy of our system.
4.1. Comparison with Other Methods
We compare the results produced by our approach and
previously proposed contour detection methods. Table 1
summarizes the results. We note that our algorithm achieves
contour detection accuracy that is higher or equal to stateof-the-art results according to two of the three metrics.
Fig. 1 shows the precision and recall curve for the methods considered in our comparison. It also lists the F-score
for each method (in the legend). We observe that there is the
accuracy margin separating our approach from prior techniques. In particular, for low-recall our method achieves almost perfect precision rate. It also produces state-of-the-art
F-score.
4.2. Single Scale versus Multiple Scales
In this section we study the beneﬁts of a multi-scale architecture. Results in Table 2 report accuracy for different numbers and choices of scales. The ﬁrst four rows in
the table illustrate the results achieved using a single-scale
approach. Speciﬁcally, these four cases show performance
obtained when training and testing our system with an input
Contour detection has been a fundamental component in many image segmentation
and object detection systems. Most previous work utilizes low-level features
such as texture or saliency to detect contours and then use them as cues for a
higher-level task such as object detection. However, we claim that recognizing
objects and predicting contours are two mutually related tasks. Contrary to
traditional approaches, we show that we can invert the commonly established
pipeline: instead of detecting contours with low-level cues for a higher-level
recognition task, we exploit object-related features as high-level cues for
contour detection.
  We achieve this goal by means of a multi-scale deep network that consists of
five convolutional layers and a bifurcated fully-connected sub-network. The
section from the input layer to the fifth convolutional layer is fixed and
directly lifted from a pre-trained network optimized over a large-scale object
classification task. This section of the network is applied to four different
scales of the image input. These four parallel and identical streams are then
attached to a bifurcated sub-network consisting of two independently-trained
branches. One branch learns to predict the contour likelihood (with a
classification objective) whereas the other branch is trained to learn the
fraction of human labelers agreeing about the contour presence at a given point
(with a regression criterion).
  We show that without any feature engineering our multi-scale deep learning
approach achieves state-of-the-art results in contour detection.
Gedas Bertasius Jianbo Shi Lorenzo Torresani