column shows the input image, and the results of our object detector which are another input to our network. FCIS does not
use these detections, but does internally produce proposals which are not shown. Best viewed in colour.
Input image Semantic Segmentation Instance Segmentation
Figure 11: Sample results on the Cityscapes dataset The above images show how our method can handle the large numbers
of instances present in the Cityscapes dataset. Unlike other recent approaches, our algorithm can deal with objects that are
not continuous – such as the car in the ﬁrst row which is occluded by a pole. Best viewed in colour.
A. Detailed results on the VOC dataset
Figure 12shows a visualisation of the AProbtained by
our method for each class across nine different thresholds.
Each “column” of Fig. 12corresponds to the APrfor each
class at a given IoU threshold. It is therefore an alternate
representation for the results tables (Tables 7to9). We can
see that our method struggles with classes such as “bicycle”, “chair”, “dining table” and “potted plant”. This may
be explained by the fact that current semantic segmentation
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr