to use PSPNet [34] as our semantic segmentation source, we
additionally demonstrate that our method is able to use other
sources. Table 4 shows the use of LRR [9] for semantic segmentation. Using the same pre-trained DN and DTN models, we perform end-to-end ﬁne-tuning using LRR as semantic segmentation. We note that the performance of our
model improves with better semantic segmentation. Thus,
future advances in segmentic segmentation methods can
further improve the performance of our approach.
Conﬁdence score estimate: As mentioned, the AP score
calculated by the Cityscapes benchmark requires a conﬁdence score for each instance. For the fbus,truck ,traing
set, we produce a weak ranking based on semantic segmentation softmax conﬁdence. Instances of all other classes are
randomly ranked. Table 5 explores the impact of various ordering schemes. We compare our ordering with random for
all semantic classes, as well as optimal ordering using oracle IoU. We see that ordering using oracle IoU can increase
our model’s performance by 6.34%. Note, however, that
this has no impact on the actual quality of proposed object
instances, which remain the same. This shows the necessity
Most contemporary approaches to instance segmentation use complex pipelines
involving conditional random fields, recurrent neural networks, object
proposals, or template matching schemes. In our paper, we present a simple yet
powerful end-to-end convolutional neural network to tackle this task. Our
approach combines intuitions from the classical watershed transform and modern
deep learning to produce an energy map of the image where object instances are
unambiguously represented as basins in the energy map. We then perform a cut at
a single energy level to directly yield connected components corresponding to
object instances. Our model more than doubles the performance of the
state-of-the-art on the challenging Cityscapes Instance Level Segmentation
task.
Min Bai Raquel Urtasun