the considerable improvements obtained over previous work at high APrIoU thresholds.
1 Introduction
Object detection and semantic segmentation have been two of the most popular Scene Understanding problems within the Computer Vision community. Great advances have been made
in recent years due to the adoption of deep learning and Convolutional Neural Networks
[19, 22, 32]. In this paper, we focus on the problem of Instance Segmentation . Instance
Segmentation lies at the intersection of Object Detection – which localises different objects
at a bounding box level, but does not segment them – and Semantic Segmentation – which
determines the object-class label of each pixel in the image, but has no notion of different
instances of the same class. As shown in Figure 1, the task of instance segmentation localises
objects to a pixel level.
Many recent instance segmentation works have built on the “Simultaneous Detection
and Segmentation” (SDS) approach of Hariharan et al. [13]. These methods [4, 5, 13, 14]
generate object proposals [1], classify each proposal into an object category, and then reﬁne
the bounding box proposal into a segmentation of the primary object the proposal contains.
However, because these methods localise an object before segmenting it, they are restricted
Traditional Scene Understanding problems such as Object Detection and
Semantic Segmentation have made breakthroughs in recent years due to the
adoption of deep learning. However, the former task is not able to localise
objects at a pixel level, and the latter task has no notion of different
instances of objects of the same class. We focus on the task of Instance
Segmentation which recognises and localises objects down to a pixel level. Our
model is based on a deep neural network trained for semantic segmentation. This
network incorporates a Conditional Random Field with end-to-end trainable
higher order potentials based on object detector outputs. This allows us to
reason about instances from an initial, category-level semantic segmentation.
Our simple method effectively leverages the great progress recently made in
semantic segmentation and object detection. The accurate instance-level
segmentations that our network produces is reflected by the considerable
improvements obtained over previous work.
Anurag Arnab Philip H. S. Torr