increasing from 1 to 32 while keeping complexity, the error
rate keeps reducing. Furthermore, the 32 4d ResNeXt also
has a much lower training error than the ResNet counterpart, suggesting that the gains are notfrom regularization
but from stronger representations .
Similar trends are observed in the case of ResNet-101
(Fig. 5 right, Table 3 bottom), where the 32 4d ResNeXt101 outperforms the ResNet-101 counterpart by 0.8%. Although this improvement of validation error is smaller than
that of the 50-layer case, the improvement of training error is still big (20% for ResNet-101 and 16% for 32 4d
ResNeXt-101, Fig. 5 right). In fact, more training data
will enlarge the gap of validation error, as we show on an
ImageNet-5K set in the next subsection.
Table 3 also suggests that with complexity preserved , increasing cardinality at the price of reducing width starts
to show saturating accuracy when the bottleneck width is
6With BN, for the equivalent form in Fig. 3(a), BN is employed after
aggregating the transformations and before adding to the shortcut.
0 1 02 03 04 05 06 07 08 09 0
epochs1520253035404550top-1 error (%)ResNet-50 (1 x 64d) train
We present a simple, highly modularized network architecture for image
classification. Our network is constructed by repeating a building block that
aggregates a set of transformations with the same topology. Our simple design
results in a homogeneous, multi-branch architecture that has only a few
hyper-parameters to set. This strategy exposes a new dimension, which we call
"cardinality" (the size of the set of transformations), as an essential factor
in addition to the dimensions of depth and width. On the ImageNet-1K dataset,
we empirically show that even under the restricted condition of maintaining
complexity, increasing cardinality is able to improve classification accuracy.
Moreover, increasing cardinality is more effective than going deeper or wider
when we increase the capacity. Our models, named ResNeXt, are the foundations
of our entry to the ILSVRC 2016 classification task in which we secured 2nd
place. We further investigate ResNeXt on an ImageNet-5K set and the COCO
detection set, also showing better results than its ResNet counterpart. The
code and models are publicly available online.
Saining Xie Ross Girshick Piotr Dollár Zhuowen Tu Kaiming He