by 10 at 100k and 120k iterations. This improves APkpby
about 1 point. Replacing ResNet-50 with ResNet-101 and
ResNeXt-101 increases APkpto 66.1 and 67.3, respectively.
With a recent method called data distillation [35], we are
able to exploit the additional 120k unlabeled images provided by COCO. In brief, data distillation is a self-training
strategy that uses a model trained on labeled data to predict annotations on unlabeled images, and in turn updates
the model with these new annotations. Mask R-CNN provides an effective framework for such a self-training strategy. With data distillation, Mask R-CNN APkpimprove by
1.8 points to 69.1. We observe that Mask R-CNN can beneﬁt from extra data, even if that data is unlabeled .
By using the same test-time augmentation as used for
instance segmentation, we further boost APkpto 70.4.
10
Acknowledgements: We would like to acknowledge Ilija
Radosavovic for contributions to code release and enhanced
results, and the Caffe2 team for engineering support.
References
[1] M. Andriluka, L. Pishchulin, P. Gehler, and B. Schiele. 2D
We present a conceptually simple, flexible, and general framework for object
instance segmentation. Our approach efficiently detects objects in an image
while simultaneously generating a high-quality segmentation mask for each
instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a
branch for predicting an object mask in parallel with the existing branch for
bounding box recognition. Mask R-CNN is simple to train and adds only a small
overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to
generalize to other tasks, e.g., allowing us to estimate human poses in the
same framework. We show top results in all three tracks of the COCO suite of
challenges, including instance segmentation, bounding-box object detection, and
person keypoint detection. Without bells and whistles, Mask R-CNN outperforms
all existing, single-model entries on every task, including the COCO 2016
challenge winners. We hope our simple and effective approach will serve as a
solid baseline and help ease future research in instance-level recognition.
Code has been made available at: https://github.com/facebookresearch/Detectron
Kaiming He Georgia Gkioxari Piotr Dollár Ross Girshick