arbitrary number of instances per image with ease.
3. A Review on the Watershed Transform
We start our discussion with a review of the watershed
transform, a well studied method in mathematical morphology. This technique is built on the fact that any greyscale
image can be considered as a topographic surface. If we
ﬂood this surface from its minima while building barriers
to prevent the merging of the waters coming from different sources, we effectively partition the image into different
components or regions. These components are called catchment basins. The barriers or watershed lines then represent
the boundaries between the different basins (i.e., boundaries
between regions).
This process is illustrated in the ﬁrst row of Fig. 2 for
a one dimensional energy function. In this case, the watershed transform results in seven components, which are
illustrated in different colors. Note that the traditional watershed transform tends to produce an over-segmentation of
the image due to spurious small ridges which produce separate components. In this example, although there are 3
main components, the watershed transform over-segments
the image because of small perturbations in the energy.
Several algorithms have been developed to estimate the
components. [3] proposed an algorithm that iteratively ﬁlls
the watershed landscape from each local minimum, adding
dams wherever two neighbouring bodies of water meet.
Most contemporary approaches to instance segmentation use complex pipelines
involving conditional random fields, recurrent neural networks, object
proposals, or template matching schemes. In our paper, we present a simple yet
powerful end-to-end convolutional neural network to tackle this task. Our
approach combines intuitions from the classical watershed transform and modern
deep learning to produce an energy map of the image where object instances are
unambiguously represented as basins in the energy map. We then perform a cut at
a single energy level to directly yield connected components corresponding to
object instances. Our model more than doubles the performance of the
state-of-the-art on the challenging Cityscapes Instance Level Segmentation
task.
Min Bai Raquel Urtasun