be suited for measuring the APrat such high thresholds.
Additionally, the training data is not as good for training
our system which includes a CRF and is therefore able to
delineate sharp boundaries. Finally, as the SBD dataset has
5732 validation images (compared to the 1449 in VOC), it
leaves less data for pretraining our initial semantic segmen2http://host.robots.ox.ac.uk:8080/leaderboard/
displaylb.php?challengeid=11&compid=6tation module. This may hinder our network in being able
to produce precise segmentations.
Table 6: Comparison of Instance Segmentation performance at multiple APrthesholds on the VOC 2012 Validation Set
MethodAPr
APr
vol0.5 0.6 0.7 0.8 0.9
Ours (piecewise) 59.1 51.9 42.1 29.4 12.0 52.3
Ours (end-to-end ) 62.0 54.0 44.8 32.3 13.8 55.4
Tables 10and11show per-class instance segmentation
results on the SBD dataset, at IoU thresholds of 0.7 and
0.5 respectively. We can only compare results at these two
thresholds since these are the only thresholds which other
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr