evaluations ( 15Kper scale) to extract the features. Based
on the runtimes reported in [14], if executed on a GPU our
method would take about 5 minutes and could be made
faster using the approach described in [12].
An alternative way to dramatically reduce the runtime of
DeepEdge is to interpolate the entries of the feature maps
produced by applying the KNet to the full image rather than
to individual patches. Such an approach would reduce the
number of CNN evaluations needed from 60Kto4(one
for each scale), which would allow our method to run in
real time even on CPUs. We note that interpolation of features in deep layers has been used successfully in several
recent vision papers [29, 11, 19]. Thus, we believe that such
an approach could yield nearly equivalent contour detection
accuracy, up to a small possible degradation caused by interpolation.
Since in this work we were primarily interested in studying the effective advantage enabled by object-level features
in contour detection, we have not invested any effort in optimizing the implementation of our method. This will be one
of our immediate goals in the future.
5. Conclusions
In this work, we presented a multi-scale bifurcated deep
network for top-down contour detection. In the past, contour detection has been approached as a bottom-up task
Contour detection has been a fundamental component in many image segmentation
and object detection systems. Most previous work utilizes low-level features
such as texture or saliency to detect contours and then use them as cues for a
higher-level task such as object detection. However, we claim that recognizing
objects and predicting contours are two mutually related tasks. Contrary to
traditional approaches, we show that we can invert the commonly established
pipeline: instead of detecting contours with low-level cues for a higher-level
recognition task, we exploit object-related features as high-level cues for
contour detection.
  We achieve this goal by means of a multi-scale deep network that consists of
five convolutional layers and a bifurcated fully-connected sub-network. The
section from the input layer to the fifth convolutional layer is fixed and
directly lifted from a pre-trained network optimized over a large-scale object
classification task. This section of the network is applied to four different
scales of the image input. These four parallel and identical streams are then
attached to a bifurcated sub-network consisting of two independently-trained
branches. One branch learns to predict the contour likelihood (with a
classification objective) whereas the other branch is trained to learn the
fraction of human labelers agreeing about the contour presence at a given point
(with a regression criterion).
  We show that without any feature engineering our multi-scale deep learning
approach achieves state-of-the-art results in contour detection.
Gedas Bertasius Jianbo Shi Lorenzo Torresani