ground-truth bounding box is greater than 0.5. Here, we consider different overlap thresholds
between the predicted and ground-truth segments, since higher overlap thresholds require the
segmentations to be more precise and are therefore better indicators of segmentation performance. We also quote the APr
volmeasure, which is the mean APrscore for overlap thresholds
ranging from 0 .1 to 0 .9 in increments of 0 .1 [13]. The detailed annotations in the VOC 2012
dataset allows us to reliably evaluate the AProf our method at high overlap thresholds.
We ﬁrst trained a network for semantic segmentation, in a similar manner to [27] and
[37]. Although the trained models from these two authors have been made publicly available,
we could not use them since they had been trained on part of the VOC validation set. We
ﬁrst trained a fully convolutional network [27] (ﬁnetuned from VGG-16 trained on ImageNet
[32]) using VOC 2012 training data, augmented with images from the Semantic Boundaries
Dataset [13] which do not overlap with the VOC Validation set, and the Microsoft COCO
dataset [26].
Traditional Scene Understanding problems such as Object Detection and
Semantic Segmentation have made breakthroughs in recent years due to the
adoption of deep learning. However, the former task is not able to localise
objects at a pixel level, and the latter task has no notion of different
instances of objects of the same class. We focus on the task of Instance
Segmentation which recognises and localises objects down to a pixel level. Our
model is based on a deep neural network trained for semantic segmentation. This
network incorporates a Conditional Random Field with end-to-end trainable
higher order potentials based on object detector outputs. This allows us to
reason about instances from an initial, category-level semantic segmentation.
Our simple method effectively leverages the great progress recently made in
semantic segmentation and object detection. The accurate instance-level
segmentations that our network produces is reflected by the considerable
improvements obtained over previous work.
Anurag Arnab Philip H. S. Torr