images, and error gradients are more stable in this case.
4.4. Results on VOC Validation Set
We then compare our best instance segmentation model
to recent methods on the VOC Validation Set in Tab. 2. The
fact that our algorithm achieves the highest APrat thresholds above 0.7 indicates that our method produces more detailed and accurate segmentations.
At an IoU threshold of 0.9, our improvement over the
previous state-of-the-art (MPA [ 37]) is 6.6%, which is a
relative improvement of 36%. Unlike [ 37,19,8], our
network performs an initial semantic segmentation which
may explain our more accurate segmentations. Other
segmentation-based approaches, [ 3,33] are not fully endto-end trained. We also achieve the best APr
volof 57.5%.
The relatively small difference in APr
volto MPA [ 37] despite large improvements at high IoU thresholds indicates
that MPA performs better at low IoU thresholds. Proposalbased methods, such as [ 37,19] are more likely to perform
better at low IoU thresholds since they output more proposals than actual instances in an image (SDS evaluates 2000
proposals per image). Furthermore, note that whilst MPA
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr