regions from further instance generation. Additionally, [23]
extracts image features similar to [28] and employs a fairly
complex pipeline including a ConvLSTM structure to direct
a bounding box generation network followed by a segmentation network that extracts individual instances.CNN: [15] leverages only a CNN trained to provide multiple outputs to simultaneously predict instance numbers,
bounding box coordinates, and category conﬁdence scores
for each pixel. This is followed by generic clustering algorithms to group the resulting output into instance-wise labels. Additionally, [13] proposed deep convolutional neural
network that learns the underlying shapes of objects, and
performs multiple unconstrained inference steps to reﬁne
regions corresponding to an object instance while ignoring
neighboring pixels that do not belong to the primary object.
Proposal + recursion: [14] proposed a novel method
that recursively reﬁnes proposals.
In contrast, in this paper we propose a novel approach
which combines the strengths of modern deep neural networks with the power of the watershed transform. Our
model is simple, fast, accurate, and inherently handles an
arbitrary number of instances per image with ease.
3. A Review on the Watershed Transform
We start our discussion with a review of the watershed
Most contemporary approaches to instance segmentation use complex pipelines
involving conditional random fields, recurrent neural networks, object
proposals, or template matching schemes. In our paper, we present a simple yet
powerful end-to-end convolutional neural network to tackle this task. Our
approach combines intuitions from the classical watershed transform and modern
deep learning to produce an energy map of the image where object instances are
unambiguously represented as basins in the energy map. We then perform a cut at
a single energy level to directly yield connected components corresponding to
object instances. Our model more than doubles the performance of the
state-of-the-art on the challenging Cityscapes Instance Level Segmentation
task.
Min Bai Raquel Urtasun