Importance of Frame-Level Instance Masks. As described in our main draft, we use frame-level instance masks
for instance-speciﬁc feature computation. To investigate theBackbone Network mAP AP@75
ResNet-50 40.0 42.9
ResNet-101 42.5 45.6
ResNeXt-101-64x4d 44.3 48.3
STSN [5]-ResNeXt-101-64x4d 46.6 51.2
Table 4: We study the effect of frame-level instance masks
to our system’s performance. We evaluate our method’s
accuracy when using instance masks obtained from Mask
R-CNN with several different backbones. Our results indicate that frame-level instance masks obtained from stronger
models lead to better video instance segmentation results.
contribution of these masks to the performance of our system, we experiment with masks obtained from several different Mask R-CNN models. In Table 4, we present our
results for this ablation. Our results indicate that framelevel instance masks obtained from stronger models allow
us to achieve better video instance segmentation performance. Thus, we expect that future improvements in image
instance segmentation will further beneﬁt our method.
5.3. Qualitative Results
In Figure 7, we compare our predicted clip-level instance
We introduce a method for simultaneously classifying, segmenting and tracking
object instances in a video sequence. Our method, named MaskProp, adapts the
popular Mask R-CNN to video by adding a mask propagation branch that propagates
frame-level object instance masks from each video frame to all the other frames
in a video clip. This allows our system to predict clip-level instance tracks
with respect to the object instances segmented in the middle frame of the clip.
Clip-level instance tracks generated densely for each frame in the sequence are
finally aggregated to produce video-level object instance segmentation and
classification. Our experiments demonstrate that our clip-level instance
segmentation makes our approach robust to motion blur and object occlusions in
video. MaskProp achieves the best reported accuracy on the YouTube-VIS dataset,
outperforming the ICCV 2019 video instance segmentation challenge winner
despite being much simpler and using orders of magnitude less labeled data
(1.3M vs 1B images and 860K vs 14M bounding boxes).
Gedas Bertasius Lorenzo Torresani