improves the other.
1https://github.com/daijifeng001/MNC
Table 4: Semantic Segmentation performance before and
after ﬁnetuning for Instance Segmentation on the VOC and
SBD Validation Sets
DatasetMean IoU [%] before
Instance ﬁnetuningMean IoU [%] after
Instance ﬁnetuning
VOC 74.2 75.1
SBD 71.5 72.5
4.7. Results on Cityscapes
Finally, we evaluate our algorithm on the Cityscapes
road-scene understanding dataset [ 9]. This dataset consists
of 2975 training images, and the held-out test set consisting
of 1525 images are evaluated on an online server. None of
the 500 validation images were used for training. We use
an initial semantic segmentation subnetwork that is based
on the ResNet-101 architecture [ 59], and all of the instance
unary potentials described in Sec. 3.2.
As shown in Tab. 5, our method sets a new state-of-theart on Cityscapes, surpassing concurrent work [ 21] and the
best previous published work [ 49] by signiﬁcant margins.
Table 5: Results on Cityscapes Test Set. Evaluation metrics and results of competing methods obtained from the
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr