
 (14)
Effect of the superpixel potentials on the derivatives∂L
∂Qt(Xi=l)were negligible.
Therefore, we ignored them in our calculations.
B Additional Experimental Results
Table 5 presents more detailed results of our method, and that of other state-of-the-art
techniques, on the PASCAL VOC 2012 test set. In particular, we present the accuracy
for every class in the VOC test set. Note that our per-class accuracy improves over our
baseline, CRF-RNN [10], for all of the 20 classes in PASCAL VOC.
Figure 6 shows more sample results of our system, compared to our baseline, CRFas-RNN [10]. Figure 7 shows examples of failure cases of our method. Figure 8 examines
the effect of each of our potentials. Finally, Figure 9 shows a qualitative comparison
between the output of our system and other current methods on the PASCAL VOC 2012
test set.
20 Arnab et al.Table 5: Comparison of the mean Intersection over Union (IoU) accuracy of our approach and other state-of-the-art methods on the Pascal
VOC 2012 test set. Scores for other methods were taken from the original authors’ publications.
Methods trained with
COCOMean
We address the problem of semantic segmentation using deep learning. Most
segmentation systems include a Conditional Random Field (CRF) to produce a
structured output that is consistent with the image's visual features. Recent
deep learning approaches have incorporated CRFs into Convolutional Neural
Networks (CNNs), with some even training the CRF end-to-end with the rest of
the network. However, these approaches have not employed higher order
potentials, which have previously been shown to significantly improve
segmentation performance. In this paper, we demonstrate that two types of
higher order potential, based on object detections and superpixels, can be
included in a CRF embedded within a deep network. We design these higher order
potentials to allow inference with the differentiable mean field algorithm. As
a result, all the parameters of our richer CRF model can be learned end-to-end
with our pixelwise CNN classifier. We achieve state-of-the-art segmentation
performance on the PASCAL VOC benchmark with these trainable higher order
potentials.
Anurag Arnab Sadeep Jayasumana Shuai Zheng Philip Torr