concatenation. This encourages the network to consider the
output of each branch. We use the ADAM optimizer to train
the network for 20 epochs with a batch size of 4, with a constant learning rate of 1e-5 and L2 weight penalty of 1e-5.
Watershed Network pre-training: The network is
trained using a modiﬁed cross-entropy loss
lwatershed =X
p2P objKX
k=1wpck(tp;klog yp;k+tp;klogyp;k)where tp;kis the k-th element of pixel p’s one-hot target
vector, yp;kis the k-th channel of the network output at p,
wpis a coefﬁcient to adjust the importance of smaller objects (as deﬁned in the DN pre-training section), and ckis
a scaling constant speciﬁc to each discretization class. Because the single energy level cut occurs at just above zero
energy (i.e., near object instance boundaries), an accurate
estimation of pixels at low energy levels is of crucial importance. Thus, the set fckgis selected to be in increasing order. In this case, any errors of low energy levels are assigned
a greater level of penalty, which encourages the network to
Most contemporary approaches to instance segmentation use complex pipelines
involving conditional random fields, recurrent neural networks, object
proposals, or template matching schemes. In our paper, we present a simple yet
powerful end-to-end convolutional neural network to tackle this task. Our
approach combines intuitions from the classical watershed transform and modern
deep learning to produce an energy map of the image where object instances are
unambiguously represented as basins in the energy map. We then perform a cut at
a single energy level to directly yield connected components corresponding to
object instances. Our model more than doubles the performance of the
state-of-the-art on the challenging Cityscapes Instance Level Segmentation
task.
Min Bai Raquel Urtasun