improvement we report here (from 59:8%to63:7%) all the more impressive.
Turning to qualitative results, we provide visual comparisons between DeepLab and DeepLab-CRF
in Fig. 7. Employing a fully connected CRF signiﬁcantly improves the results, allowing the model
to accurately capture intricate object boundaries.
Multi-Scale features We also exploit the features from the intermediate layers, similar to Hariharan et al. (2014a); Long et al. (2014). As shown in Tab. 1 (a), adding the multi-scale features to our
7
Published as a conference paper at ICLR 2015
Method kernel size input stride receptive ﬁeld # parameters mean IOU (%) Training speed (img/sec)
DeepLab-CRF-7x7 77 4 224 134.3M 67.64 1.44
DeepLab-CRF 44 4 128 65.1M 63.74 2.90
DeepLab-CRF-4x4 44 8 224 65.1M 67.14 2.90
DeepLab-CRF-LargeFOV 33 12 224 20.5M 67.64 4.84
Table 2: Effect of Field-Of-View. We show the performance (after CRF) and training speed on the
Deep Convolutional Neural Networks (DCNNs) have recently shown state of the
art performance in high level vision tasks, such as image classification and
object detection. This work brings together methods from DCNNs and
probabilistic graphical models for addressing the task of pixel-level
classification (also called "semantic image segmentation"). We show that
responses at the final layer of DCNNs are not sufficiently localized for
accurate object segmentation. This is due to the very invariance properties
that make DCNNs good for high level tasks. We overcome this poor localization
property of deep networks by combining the responses at the final DCNN layer
with a fully connected Conditional Random Field (CRF). Qualitatively, our
"DeepLab" system is able to localize segment boundaries at a level of accuracy
which is beyond previous methods. Quantitatively, our method sets the new
state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching
71.6% IOU accuracy in the test set. We show how these results can be obtained
efficiently: Careful network re-purposing and a novel application of the 'hole'
algorithm from the wavelet community allow dense computation of neural net
responses at 8 frames per second on a modern GPU.
Liang-Chieh Chen George Papandreou Iasonas Kokkinos Kevin Murphy Alan L. Yuille