SGN’s 25.0 [29]. Both DIN and SGN use fine +coarse
data. Compared to the best entry using fine data only
(17.4 AP), we achieve a 50% improvement.
For the person andcarcategories, the Cityscapes dataset
exhibits a large number of within -category overlapping instances (on average 6 people and 9 cars per image). We
argue that within-category overlap is a core difﬁculty of instance segmentation. Our method shows massive improvement on these two categories over the other best entries (relative40% improvement on person from 21.8 to 30.5 and
20% improvement on carfrom 39.4 to 46.9), even though
our method does not exploit the coarse data.
A main challenge of the Cityscapes dataset is training
models in a low-data regime, particularly for the categories
oftruck ,bus, and train , which have about 200-500 traincar:1.00car:0.98
car:0.98 car:0.95 car:0.81car:0.52person:1.00person:1.00person:1.00
person:1.00 person:1.00person:1.00person:1.00
person:1.00 person:1.00person:1.00
We present a conceptually simple, flexible, and general framework for object
instance segmentation. Our approach efficiently detects objects in an image
while simultaneously generating a high-quality segmentation mask for each
instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a
branch for predicting an object mask in parallel with the existing branch for
bounding box recognition. Mask R-CNN is simple to train and adds only a small
overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to
generalize to other tasks, e.g., allowing us to estimate human poses in the
same framework. We show top results in all three tracks of the COCO suite of
challenges, including instance segmentation, bounding-box object detection, and
person keypoint detection. Without bells and whistles, Mask R-CNN outperforms
all existing, single-model entries on every task, including the COCO 2016
challenge winners. We hope our simple and effective approach will serve as a
solid baseline and help ease future research in instance-level recognition.
Code has been made available at: https://github.com/facebookresearch/Detectron
Kaiming He Georgia Gkioxari Piotr Dollár Ross Girshick