learning rate of 10−8, momentum of 0.9 and batch size of
20. The learning rate is low since we do not normalise the
loss by the number of pixels. This is so that images with
more pixels contribute a higher loss. The normalised learning rate is approximately 2×10−3. When training our instance segmentation network as well, we lower the learning
rate to 10−12and use a batch size of 1 instead. Decreasing the batch size gave empirically better results. We also
clipped gradients (a technique common in training RNNs
[40]) withℓ2norms above 109. This threshold was set by
observing “normal” gradient magnitudes during training.
The relatively high magnitude is due to the fact that our
loss is not normalised. In our complete network, we have
two CRF inference modules which are RNNs (one each in
the semantic- and instance-segmentation subnetworks), and
gradient clipping facilitated successful training.
3.6. Discussion
Our network is able to compute a semantic and instance
segmentation of the input image in a single forward pass.
We do not require any post-processing, such as the patch
aggregation of [ 37], “mask-voting” of [ 12], “superpixel
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr