input stride = 4. This model yields performance of 67:64% on the ‘val’ set, but it is relatively slow
(1:44images per second during training). We have improved model speed to 2:9images per second
by reducing the kernel size to 44. We have experimented with two such network variants with
different FOV sizes, DeepLab-CRF and DeepLab-CRF-4x4; the latter has large FOV ( i.e., large
input stride) and attains better performance. Finally, we employ kernel size 33and input stride =
12, and further change the ﬁlter sizes from 4096 to 1024 for the last two layers. Interestingly, the
resulting model, DeepLab-CRF-LargeFOV , matches the performance of the expensive DeepLabCRF-7x7. At the same time, it is 3:36times faster to run and has signiﬁcantly fewer parameters
(20.5M instead of 134.3M).
The performance of several model variants is summarized in Tab. 1, showing the beneﬁt of exploiting
multi-scale features and large FOV .
Figure 4: Incorporating multi-scale features improves the boundary segmentation. We show the
Deep Convolutional Neural Networks (DCNNs) have recently shown state of the
art performance in high level vision tasks, such as image classification and
object detection. This work brings together methods from DCNNs and
probabilistic graphical models for addressing the task of pixel-level
classification (also called "semantic image segmentation"). We show that
responses at the final layer of DCNNs are not sufficiently localized for
accurate object segmentation. This is due to the very invariance properties
that make DCNNs good for high level tasks. We overcome this poor localization
property of deep networks by combining the responses at the final DCNN layer
with a fully connected Conditional Random Field (CRF). Qualitatively, our
"DeepLab" system is able to localize segment boundaries at a level of accuracy
which is beyond previous methods. Quantitatively, our method sets the new
state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching
71.6% IOU accuracy in the test set. We show how these results can be obtained
efficiently: Careful network re-purposing and a novel application of the 'hole'
algorithm from the wavelet community allow dense computation of neural net
responses at 8 frames per second on a modern GPU.
Liang-Chieh Chen George Papandreou Iasonas Kokkinos Kevin Murphy Alan L. Yuille