or increasing depth or width. The following comparison
can also be viewed as with reference to 2 FLOPs of the
ResNet-101 baseline. We compare the following variants
that have15 billion FLOPs. (i) Going deeper to 200 layers. We adopt the ResNet-200 [15] implemented in [11].
(ii)Going wider by increasing the bottleneck width. (iii)
Increasing cardinality by doubling C.
Table 4 shows that increasing complexity by 2 consistently reduces error vs. the ResNet-101 baseline (22.0%).
But the improvement is small when going deeper (ResNet200, by 0.3%) or wider (wider ResNet-101, by 0.7%).
On the contrary, increasing cardinality Cshows muchsetting top-1 err (%) top-5 err (%)
1complexity references:
ResNet-101 164d 22.0 6.0
ResNeXt-101 324d 21.2 5.6
2complexity models follow:
ResNet- 200[15] 164d 21.7 5.8
ResNet-101, wider 1100d 21.3 5.7
ResNeXt-101 264d 20.7 5.5
ResNeXt-101 644d 20.4 5.3
We present a simple, highly modularized network architecture for image
classification. Our network is constructed by repeating a building block that
aggregates a set of transformations with the same topology. Our simple design
results in a homogeneous, multi-branch architecture that has only a few
hyper-parameters to set. This strategy exposes a new dimension, which we call
"cardinality" (the size of the set of transformations), as an essential factor
in addition to the dimensions of depth and width. On the ImageNet-1K dataset,
we empirically show that even under the restricted condition of maintaining
complexity, increasing cardinality is able to improve classification accuracy.
Moreover, increasing cardinality is more effective than going deeper or wider
when we increase the capacity. Our models, named ResNeXt, are the foundations
of our entry to the ILSVRC 2016 classification task in which we secured 2nd
place. We further investigate ResNeXt on an ImageNet-5K set and the COCO
detection set, also showing better results than its ResNet counterpart. The
code and models are publicly available online.
Saining Xie Ross Girshick Piotr Dollár Zhuowen Tu Kaiming He