network for top-down contour detection. In the past, contour detection has been approached as a bottom-up task
where low-level features are engineered ﬁrst, then contour
detection is performed, and ﬁnally contours may be used
as cues for object detection. However, due to a close relationship between object and contour detection tasks, we
proposed to invert this pipeline and perform contour detection in a top-down fashion. We demonstrated how to use
higher-level object cues to predict contours and showed that
considering higher-level object-features leads to a substantial gain in contour detection accuracy.
Additionally, we demonstrated that our multi-scale architecture is beneﬁcial to contour prediction as well. By
considering multiple scales, our method incorporates local
and global information around the candidate contour points,
which leads to signiﬁcantly better contour detection results.
Furthermore, we showed that independent optimization of
contour classiﬁcation and regression objectives improves
contour prediction accuracy as well. As our experiments indicate, DeepEdge achieves higher average precision results
compared to any prior or concurrent work.
In conclusion, our results suggest that pure CNN systems can be applied successfully to contour detection and
possibly to many other low-level vision tasks.
6. Acknowledgements
Contour detection has been a fundamental component in many image segmentation
and object detection systems. Most previous work utilizes low-level features
such as texture or saliency to detect contours and then use them as cues for a
higher-level task such as object detection. However, we claim that recognizing
objects and predicting contours are two mutually related tasks. Contrary to
traditional approaches, we show that we can invert the commonly established
pipeline: instead of detecting contours with low-level cues for a higher-level
recognition task, we exploit object-related features as high-level cues for
contour detection.
  We achieve this goal by means of a multi-scale deep network that consists of
five convolutional layers and a bifurcated fully-connected sub-network. The
section from the input layer to the fifth convolutional layer is fixed and
directly lifted from a pre-trained network optimized over a large-scale object
classification task. This section of the network is applied to four different
scales of the image input. These four parallel and identical streams are then
attached to a bifurcated sub-network consisting of two independently-trained
branches. One branch learns to predict the contour likelihood (with a
classification objective) whereas the other branch is trained to learn the
fraction of human labelers agreeing about the contour presence at a given point
(with a regression criterion).
  We show that without any feature engineering our multi-scale deep learning
approach achieves state-of-the-art results in contour detection.
Gedas Bertasius Jianbo Shi Lorenzo Torresani