evaluate the error on the single 224 224 center crop from
an image whose shorter side is 256.
Our models are realized by the form of Fig. 3(c). We
perform batch normalization (BN) [17] right after the con5The marginally smaller number of parameters and marginally higher
FLOPs are mainly caused by the blocks where the map sizes change.volutions in Fig. 3(c).6ReLU is performed right after each
BN, expect for the output of the block where ReLU is performed after the adding to the shortcut, following [14].
We note that the three forms in Fig. 3 are strictly equivalent, when BN and ReLU are appropriately addressed as
mentioned above. We have trained all three forms and
obtained the same results. We choose to implement by
Fig. 3(c) because it is more succinct and faster than the other
two forms.
5. Experiments
5.1. Experiments on ImageNet-1K
We conduct ablation experiments on the 1000-class ImageNet classiﬁcation task [33]. We follow [14] to construct
50-layer and 101-layer residual networks. We simply replace all blocks in ResNet-50/101 with our blocks.
Notations . Because we adopt the two rules in Sec. 3.1, it is
We present a simple, highly modularized network architecture for image
classification. Our network is constructed by repeating a building block that
aggregates a set of transformations with the same topology. Our simple design
results in a homogeneous, multi-branch architecture that has only a few
hyper-parameters to set. This strategy exposes a new dimension, which we call
"cardinality" (the size of the set of transformations), as an essential factor
in addition to the dimensions of depth and width. On the ImageNet-1K dataset,
we empirically show that even under the restricted condition of maintaining
complexity, increasing cardinality is able to improve classification accuracy.
Moreover, increasing cardinality is more effective than going deeper or wider
when we increase the capacity. Our models, named ResNeXt, are the foundations
of our entry to the ILSVRC 2016 classification task in which we secured 2nd
place. We further investigate ResNeXt on an ImageNet-5K set and the COCO
detection set, also showing better results than its ResNet counterpart. The
code and models are publicly available online.
Saining Xie Ross Girshick Piotr Dollár Zhuowen Tu Kaiming He