APrresults at thresholds of 0.5, 0.7 and 0.9.
Section Bshows more detailed results on the SBD
dataset. Table 6shows our mean APrresults at thresholds from 0.5 to 0.9, whilst Tables 10and11show per-class
APrresults at thresholds of 0.7 and 0.5 respectively.
Input image Semantic Segmentation Instance Segmentation Ground truth
Figure 7: Success cases of our method. First and second row: Our algorithm can leverage good initial semantic segmentations, and detections, to produce an instance segmentation. Third row: Notice that we have ignored three false-positive
detections. Additionally, the red bounding box does not completely encompass the person, but our algorithm is still able to
associate pixels “outside-the-box” with the correct detection (also applies to row 2). Fourth row: Our system is able to deal
with the heavily occluded sheep, and ignore the false-positive detection. Fifth row: We have not been able to identify one
bicycle on the left since it was not detected, but otherwise have performed well. Sixth row: Although subjective, the train has
not been annotated in the dataset, but both our initial semantic segmentation and object detection networks have identiﬁed it.
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr