Ours + Oracle Ordering 27.58% 20.60% 18.70% 40.10% 31.50% 50.60% 28.30% 17.40% 13.40%
Table 5: Comparison of AP scores with various instance ordering techniques using the validation set.
Comparison to the state-of-the-art: We show the instance segmentation test set scores in Table 1. Additionally, we show the class-speciﬁc AP scores in Table 2. It is
evident that we achieve a large improvement over the stateof-the-art in all semantic classes. Moreover, we do not use
depth information to train our model, unlike [28].
Analysis of the intermediate training target: Our ﬁnal
network is the result of the end-to-end ﬁne-tuning of two
pre-trained sub-networks (DN and WTN). Fig. 4 (f) shows
the output of the DN after ﬁnetuning. It is evident that the
ﬁne-tuned model retained the direction prediction as an intermediate task. This suggests that the intermediate training
target is effective.
Inﬂuence of semantic segmentation: While we elected
to use PSPNet [34] as our semantic segmentation source, we
additionally demonstrate that our method is able to use other
Most contemporary approaches to instance segmentation use complex pipelines
involving conditional random fields, recurrent neural networks, object
proposals, or template matching schemes. In our paper, we present a simple yet
powerful end-to-end convolutional neural network to tackle this task. Our
approach combines intuitions from the classical watershed transform and modern
deep learning to produce an energy map of the image where object instances are
unambiguously represented as basins in the energy map. We then perform a cut at
a single energy level to directly yield connected components corresponding to
object instances. Our model more than doubles the performance of the
state-of-the-art on the challenging Cityscapes Instance Level Segmentation
task.
Min Bai Raquel Urtasun