32.0 AP on test , almost a 6 point improvement over the
fine -only counterpart. This indicates the important role
the amount of training data plays. It also suggests that
methods on Cityscapes might be inﬂuenced by their lowshot learning performance. We show that using COCO pretraining is an effective strategy on this dataset.
Finally, we observed a bias between the val andtest
AP, as is also observed from the results of [23, 4, 29]. We
found that this bias is mainly caused by the truck ,bus,
and train categories, with the fine -only model having
val/test AP of 28.8/22.8, 53.5/32.2, and 33.0/18.6, respectively. This suggests that there is a domain shift on
these categories, which also have little training data. COCO
pre-training helps to improve results the most on these categories; however, the domain shift persists with 38.0/30.1,
57.5/40.9, and 41.2/30.9 val/test AP, respectively. Note
that for the person andcarcategories we do not see any
such bias ( val/test AP are within1point).
Example results on Cityscapes are shown in Figure 8.
9
description backbone AP AP 50 AP75 APbbAPbb
We present a conceptually simple, flexible, and general framework for object
instance segmentation. Our approach efficiently detects objects in an image
while simultaneously generating a high-quality segmentation mask for each
instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a
branch for predicting an object mask in parallel with the existing branch for
bounding box recognition. Mask R-CNN is simple to train and adds only a small
overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to
generalize to other tasks, e.g., allowing us to estimate human poses in the
same framework. We show top results in all three tracks of the COCO suite of
challenges, including instance segmentation, bounding-box object detection, and
person keypoint detection. Without bells and whistles, Mask R-CNN outperforms
all existing, single-model entries on every task, including the COCO 2016
challenge winners. We hope our simple and effective approach will serve as a
solid baseline and help ease future research in instance-level recognition.
Code has been made available at: https://github.com/facebookresearch/Detectron
Kaiming He Georgia Gkioxari Piotr Dollár Ross Girshick