MPA 3-scale [ 37]62.1 56.6 47.4 36.1 18.5 56.5
Ours 61.7 55.5 48.6 39.5 25.1 57.5
labellings. The “Shape” term’s improvement in the APr
volis
primarily due to an improvement in the APrat low thresholds. By using shape priors, we are able to recover instances
which were occluded and missed out. End-to-end training
also improves results at all APrthresholds. Training with
just the “Box” term shows a modest improvement in the
APr
volof 1.3%. Training with the “Global” and “Shape”
terms shows larger improvements of 2.1% and 2.3% respectively. This may be because the “Box” term only considers
the semantic segmentation at parts of the image covered by
object detections. Once we include the “Global” term, we
consider the semantic segmentation over the entire image
for the detected class. Training makes more efﬁcient use of
images, and error gradients are more stable in this case.
4.4. Results on VOC Validation Set
We then compare our best instance segmentation model
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr