Dataset [13] which do not overlap with the VOC Validation set, and the Microsoft COCO
dataset [26].
To this pretrained network, we added the Higher Order CRF, and ﬁnetuned with a learning rate of 10−11using only VOC 2012 data which is ﬁnely annotated. The learning rate is
8 ARNAB AND TORR: BOTTOM-UP INSTANCE SEGMENTATION
Table 1: Comparison of instance segmentation performance against baselines on the VOC
2012 Validation Set of 1449 images. We report the APrmeasure at different IoU thresholds.
Method APrat 0.5 APrat 0.6 APrat 0.7 APr
vol
Baseline without detection potentials 54.6 48.5 41.8 50.0
Baseline with detection potentials,
butYvariables ignored57.5 51.6 44.5 52.4
Full system with detection potentials,
and recalibrated detection scores from
Yvariables58.3 52.4 45.4 53.1
low since the loss was not normalised by the number of pixels in the training image. When
training our Higher Order CRF, we use the publicly available Faster-RCNN object detection
framework [28]. The semantic segmentation performance on the VOC validation set is a
Traditional Scene Understanding problems such as Object Detection and
Semantic Segmentation have made breakthroughs in recent years due to the
adoption of deep learning. However, the former task is not able to localise
objects at a pixel level, and the latter task has no notion of different
instances of objects of the same class. We focus on the task of Instance
Segmentation which recognises and localises objects down to a pixel level. Our
model is based on a deep neural network trained for semantic segmentation. This
network incorporates a Conditional Random Field with end-to-end trainable
higher order potentials based on object detector outputs. This allows us to
reason about instances from an initial, category-level semantic segmentation.
Our simple method effectively leverages the great progress recently made in
semantic segmentation and object detection. The accurate instance-level
segmentations that our network produces is reflected by the considerable
improvements obtained over previous work.
Anurag Arnab Philip H. S. Torr