ensure we are roughly considering the same spatial extent
of the original image at each layer.
As illustrated in Fig. 5, during the training the weights
in the convolutional layers are ﬁxed and only the weights in
the fully connected layers of the two branches are learned.
To train our model we use the learning rate of 0:1, the
dropout fraction of 0:5,50number of epochs, and the size
of the batch equal to 100.
As described earlier, to train classiﬁcation and regression branches we sample 80;000examples with binary labels. We also generate continuous labels for these 80;000
examples. In addition, we sample a hold-out dataset of size
40;000. This hold-out dataset is used for the hard-positive
mining step [22].
For the ﬁrst 25epochs we train classiﬁcation and regression branches independently on the original 80;000sample training dataset. After the ﬁrst 25epochs, we test both
branches on the hold-out dataset and detect false negative
predictions made by each branch. We then use these false
negative examples along with the same number of randomly
selected true negative examples to augment our original
80;000training dataset. For the remaining 25epochs, we
train both branches on this augmented dataset.
Contour detection has been a fundamental component in many image segmentation
and object detection systems. Most previous work utilizes low-level features
such as texture or saliency to detect contours and then use them as cues for a
higher-level task such as object detection. However, we claim that recognizing
objects and predicting contours are two mutually related tasks. Contrary to
traditional approaches, we show that we can invert the commonly established
pipeline: instead of detecting contours with low-level cues for a higher-level
recognition task, we exploit object-related features as high-level cues for
contour detection.
  We achieve this goal by means of a multi-scale deep network that consists of
five convolutional layers and a bifurcated fully-connected sub-network. The
section from the input layer to the fifth convolutional layer is fixed and
directly lifted from a pre-trained network optimized over a large-scale object
classification task. This section of the network is applied to four different
scales of the image input. These four parallel and identical streams are then
attached to a bifurcated sub-network consisting of two independently-trained
branches. One branch learns to predict the contour likelihood (with a
classification objective) whereas the other branch is trained to learn the
fraction of human labelers agreeing about the contour presence at a given point
(with a regression criterion).
  We show that without any feature engineering our multi-scale deep learning
approach achieves state-of-the-art results in contour detection.
Gedas Bertasius Jianbo Shi Lorenzo Torresani