PSPNet [34] 80.2% 21.2%
Table 4: Comparison of instance segmentation performance
on the validation set with various semantic segmentation
sources. Semantic segmentation IoU Class scores [6] are
also provided.
For all other classes, we use a random ordering. Note that
sophisticated ranking techniques can be used to further
improve the score. However, the segmentation quality
remains this same. This again highlights a shortcoming of
using AP as the metric.
In addition to AP, we report the mean weighted coverage
score introduced in [26] on the validation set. This metric
enforces a single instance label per pixel, and is therefore
more suitable for evaluating our approach. We hope that
future work will likewise report this score when applicable.
Method Average Person Rider Car Truck Bus Train Motorcycle Bicycle
Ours 20.50% 15.50% 13.80% 33.10% 23.60% 39.90% 17.40% 11.90% 8.80%
Ours + Ordering 21.24% 15.50% 13.80% 33.10% 27.10% 45.20% 14.50% 11.90% 8.80%
Most contemporary approaches to instance segmentation use complex pipelines
involving conditional random fields, recurrent neural networks, object
proposals, or template matching schemes. In our paper, we present a simple yet
powerful end-to-end convolutional neural network to tackle this task. Our
approach combines intuitions from the classical watershed transform and modern
deep learning to produce an energy map of the image where object instances are
unambiguously represented as basins in the energy map. We then perform a cut at
a single energy level to directly yield connected components corresponding to
object instances. Our model more than doubles the performance of the
state-of-the-art on the challenging Cityscapes Instance Level Segmentation
task.
Min Bai Raquel Urtasun