only be preserved approximately, but the difference of the
complexity is minor and does not bias our results.
4. Implementation details
Our implementation follows [14] and the publicly available code of fb.resnet.torch [11]. On the ImageNet
dataset, the input image is 224 224 randomly cropped
from a resized image using the scale and aspect ratio augmentation of [38] implemented by [11]. The shortcuts are
identity connections except for those increasing dimensions
which are projections (type B in [14]). Downsampling of
conv3, 4, and 5 is done by stride-2 convolutions in the 3 3
layer of the ﬁrst block in each stage, as suggested in [11].
We use SGD with a mini-batch size of 256 on 8 GPUs (32
per GPU). The weight decay is 0.0001 and the momentum
is 0.9. We start from a learning rate of 0.1, and divide it by
10 for three times using the schedule in [11]. We adopt the
weight initialization of [13]. In all ablation comparisons, we
evaluate the error on the single 224 224 center crop from
an image whose shorter side is 256.
Our models are realized by the form of Fig. 3(c). We
We present a simple, highly modularized network architecture for image
classification. Our network is constructed by repeating a building block that
aggregates a set of transformations with the same topology. Our simple design
results in a homogeneous, multi-branch architecture that has only a few
hyper-parameters to set. This strategy exposes a new dimension, which we call
"cardinality" (the size of the set of transformations), as an essential factor
in addition to the dimensions of depth and width. On the ImageNet-1K dataset,
we empirically show that even under the restricted condition of maintaining
complexity, increasing cardinality is able to improve classification accuracy.
Moreover, increasing cardinality is more effective than going deeper or wider
when we increase the capacity. Our models, named ResNeXt, are the foundations
of our entry to the ILSVRC 2016 classification task in which we secured 2nd
place. We further investigate ResNeXt on an ImageNet-5K set and the COCO
detection set, also showing better results than its ResNet counterpart. The
code and models are publicly available online.
Saining Xie Ross Girshick Piotr Dollár Zhuowen Tu Kaiming He