0 otherwise(3)
As shown in Fig. 3, this potential performs well when the
initial semantic segmentation is good. It is robust to false
positive detections, unlike methods which reﬁne bounding
boxes [ 8,19,20] since the detections are considered in light
of our initial semantic segmentation, Q. Together with the
pairwise term (Sec. 3.2.4 ), occlusions between objects of
the same class can be resolved if there are appearance differences in the different instances.
3.2.2 Global Term
This term does not rely on bounding boxes, but only the segmentation prediction at a particular pixel, Qi. It encodes the
intuition that if we only know there are dpossible instances
of a particular object class, and have no further localisation information, each instance is equally probable, and this
potential is proportional to the semantic segmentation conﬁdence for the detected object class at that pixel:
ψGlobal (Vi=k) =Qi(lk). (4)
As shown in Fig. 4, this potential overcomes cases where
the bounding box does not cover the entire extent of the object, as it assigns probability mass to a particular instance
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr