are not shown. Best viewed in colour.
Input image MNC [ 12] Ours Ground truth
Figure 9 continued: Comparison to MNC [ 12]The above examples show that our method produces more precise segmentations than MNC, that adhere to the boundaries of the objects. However, in Rows 3, 4 and 5, we see that MNC is able
to segment instances that our method misses out. In Row 3 , our algorithm does not segment the baby, although there is a
detection for it. This suggests that our shape prior which was formulated to overcome such occlusions could be better. As
MNC processes individual instances, it does not have a problem with dealing with small, occluding instances. In Row 4 ,
MNC has again identiﬁed a person that our algorithm could not. However, this is because we did not have a detection for
this person. In Row 5 , MNC has segmented the horses on the right better than our method. The ﬁrst column shows the input
image, and the results of our object detector which are another input to our network. MNC does not use these detections, but
does internally produce box-based proposals which are not shown. We used the publicly available code, models and default
parameters of MNC to produce this ﬁgure. Best viewed in colour.
Input image FCIS [ 31] Ours
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr