equal dimension. Additionally, during training, we can consider the shape priors Tas parameters of our “shape term”
layer and backpropagate through to the matched exemplar
t∗to update it. In practice, we initialised these parameters
(a) Without shape term (b) With Shape term
Figure 5: The “Shape” unary potential (b) helps us to distinguish between the green and purple sheep, which the other
two unary potentials cannot. Input detections are overlaid
on the images.
with the shape priors described in [ 50]. This consists of
roughly 250 shape templates for each of ﬁve different aspect ratios. These were obtained by clustering foreground
masks of object instances from the training set.
Here, we have only matched a single shape template to
a proposed instance. This method could be extended in future to matching multiple templates to an instance, in which
case each shape exemplar would correspond to a part of the
object such as in DPM [ 15].
3.2.4 Pairwise term
The pairwise term consists of densely-connected Gaussian
potentials [ 26] and encourages appearance and spatial consistency. The weights governing the importance of these
terms are also learnt via backpropagation, as in [ 60]. We
Semantic segmentation and object detection research have recently achieved
rapid progress. However, the former task has no notion of different instances
of the same object, and the latter operates at a coarse, bounding-box level. We
propose an Instance Segmentation system that produces a segmentation map where
each pixel is assigned an object class and instance identity label. Most
approaches adapt object detectors to produce segments instead of boxes. In
contrast, our method is based on an initial semantic segmentation module, which
feeds into an instance subnetwork. This subnetwork uses the initial
category-level segmentation, along with cues from the output of an object
detector, within an end-to-end CRF to predict instances. This part of our model
is dynamically instantiated to produce a variable number of instances per
image. Our end-to-end approach requires no post-processing and considers the
image holistically, instead of processing independent proposals. Therefore,
unlike some related work, a pixel cannot belong to multiple instances.
Furthermore, far more precise segmentations are achieved, as shown by our
state-of-the-art results (particularly at high IoU thresholds) on the Pascal
VOC and Cityscapes datasets.
Anurag Arnab Philip H. S Torr