parameters of MNC to produce this ﬁgure. Best viewed in colour.
Input image FCIS [ 31] Ours
Figure 10: Comparison to FCIS [ 31]The above images compare our method to the concurrent work, FCIS [ 31], which was
trained on COCO [ 35] and won the COCO 2016 challenge. Unlike proposal-based methods such as FCIS, our method can
handle false-positive detections and poor bounding-box localisation. Furthermore, as our method reasons globally about the
image, one pixel can only be assigned to a single instance, which is not the case with FCIS. Our method also produces more
precise segmentations, as it includes a differentiable CRF, and it is based off a semantic segmentation network. The results of
FCIS are obtained from their publicly available results on the COCO test set ( https://github.com/daijifeng001/
TA-FCN ). Note that FCIS is trained on COCO, and our model is trained on Pascal VOC which does not have as many classes
as COCO, such as “umbrella” and “suitcase” among others. As a result, we are not able to detect these objects. The ﬁrst
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr