of mask and class prediction, and results in a severe loss
in mask AP (5.5 points). This suggests that once the instance has been classiﬁed as a whole (by the box branch),
it is sufﬁcient to predict a binary mask without concern for
the categories, which makes the model easier to train.
Class-Speciﬁc vs. Class-Agnostic Masks: Our default instantiation predicts class-speciﬁc masks, i.e., one mmmask per class. Interestingly, Mask R-CNN with classagnostic masks ( i.e., predicting a single mmoutput regardless of class) is nearly as effective: it has 29.7 mask AP
vs. 30.3 for the class-speciﬁc counterpart on ResNet-50-C4.
This further highlights the division of labor in our approach
which largely decouples classiﬁcation and segmentation.
RoIAlign: An evaluation of our proposed RoIAlign layer is
shown in Table 2c. For this experiment we use the ResNet50-C4 backbone, which has stride 16. RoIAlign improves
AP by about 3 points over RoIPool, with much of the gain
coming at high IoU (AP 75). RoIAlign is insensitive to
We present a conceptually simple, flexible, and general framework for object
instance segmentation. Our approach efficiently detects objects in an image
while simultaneously generating a high-quality segmentation mask for each
instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a
branch for predicting an object mask in parallel with the existing branch for
bounding box recognition. Mask R-CNN is simple to train and adds only a small
overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to
generalize to other tasks, e.g., allowing us to estimate human poses in the
same framework. We show top results in all three tracks of the COCO suite of
challenges, including instance segmentation, bounding-box object detection, and
person keypoint detection. Without bells and whistles, Mask R-CNN outperforms
all existing, single-model entries on every task, including the COCO 2016
challenge winners. We hope our simple and effective approach will serve as a
solid baseline and help ease future research in instance-level recognition.
Code has been made available at: https://github.com/facebookresearch/Detectron
Kaiming He Georgia Gkioxari Piotr Dollár Ross Girshick