forward pass through our network. We have also improved
substantially on the APr
volmeasure (3.4%) compared to
other works which have reported it. We also used the publicly available source code1, model and default parameters
of MNC [ 12] to evaluate the “Matching IoU”. Our method
improves this by 8.3%. This metric is a stricter measure of
segmentation performance, and our method, which is based
on an initial semantic segmentation and includes a CRF as
part of training therefore performs better.
4.6. Improvement in Semantic Segmentation
Finetuning our network for instance segmentation, with
the loss described in Sec. 3.4improves semantic segmentation performance on both the VOC and SBD dataset, as
shown in Tab. 4. The improvement is 0.9% on VOC, and
1% on SBD. The tasks of instance segmentation and semantic segmentation are highly related – in fact, instance
segmentation can be thought of as a more speciﬁc case of
semantic segmentation. As a result, ﬁnetuning for one task
improves the other.
1https://github.com/daijifeng001/MNC
Table 4: Semantic Segmentation performance before and
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr