into our test sets for instance segmentation.
4.2. Evaluation Metrics
We report the mean Average Precision over regions
(APr) as deﬁned by [ 19]. The difference between APrand
the AP metric used in object detection [ 14] is that the Intersection over Union (IoU) is computed over predicted and
ground-truth regions instead of bounding boxes. Furthermore, the standard AP metric uses an IoU threshold of 0.5
to determine whether a prediction is correct or not. Here,
we use a variety of IoU thresholds since larger thresholds
require more precise segmentations. Additionally, we report theAPr
volwhich is the average of the APrfor 9 IoU
thresholds ranging from 0.1 to 0.9 in increments of 0.1.
However, we also observe that the APrmetric requires
an algorithm to produce a ranked list of segments and their
object class. It does not require, nor evaluate, the ability ofTable 1: The effect of the different CRF unary potentials,
and end-to-end training with them, on the VOC 2012 Validation Set.
APr
APr
volmatch
IoU 0.5 0.7 0.9
Box Term
(piecewise)60.0 47.3 21.2 54.9 42.6
Box+Global
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr