Uhrig et al. [28] 12.5% 11.7% 22.5% 3.3% 5.9% 3.2% 6.9% 5.1%
Ours 15.5% 14.1% 31.5% 22.5% 27.0% 22.9% 13.9% 8.0%
Table 2: Cityscapes instance segmentation class speciﬁc test set AP scores using metrics deﬁned in [6].
2048x1024 pixels. Unlike other commonly used datasets
for instance segmentation (e.g., Pascal VOC [8], BSDS500
[17], and CVPPP [19]) Cityscapes has a large number of
scenes involving dozens of instances with large degrees of
occlusions at vastly different scales. Eight of the semantically labelled categories have instance-level labelling. We
refer the reader to Table 3 for a summary of the statistics of
the object instances in this dataset. Note that while the car
andpeople classes have signiﬁcant numbers of instances,
the other six classes are rather uncommon. As a result, the
rare classes have far less training data, and are thus much
more challenging. We use the ofﬁcial training, validation,
and testing set splits, with 2975, 500, and 1525 images, respectively.
Most contemporary approaches to instance segmentation use complex pipelines
involving conditional random fields, recurrent neural networks, object
proposals, or template matching schemes. In our paper, we present a simple yet
powerful end-to-end convolutional neural network to tackle this task. Our
approach combines intuitions from the classical watershed transform and modern
deep learning to produce an energy map of the image where object instances are
unambiguously represented as basins in the energy map. We then perform a cut at
a single energy level to directly yield connected components corresponding to
object instances. Our model more than doubles the performance of the
state-of-the-art on the challenging Cityscapes Instance Level Segmentation
task.
Min Bai Raquel Urtasun