grouped convolutions in the form of Fig. 3(c) are helpful for
easing implementation.
3.4. Model Capacity
Our experiments in the next section will show that
our models improve accuracy when maintaining the model
complexity and number of parameters. This is not only interesting in practice, but more importantly, the complexity
and number of parameters represent inherent capacity of
models and thus are often investigated as fundamental properties of deep networks [8].
When we evaluate different cardinalities Cwhile preserving complexity, we want to minimize the modiﬁcation
of other hyper-parameters. We choose to adjust the width of
cardinality C 1 2 4 8 32
width of bottleneck d 64 40 24 14 4
width of group conv. 64 80 96 112 128
Table 2. Relations between cardinality and width (for the template
of conv2), with roughly preserved complexity on a residual block.
The number of parameters is 70k for the template of conv2. The
number of FLOPs is 0.22 billion (# params 5656 for conv2).
the bottleneck ( e.g., 4-d in Fig 1(right)), because it can be
isolated from the input and output of the block. This strategy introduces no change to other hyper-parameters (depth
or input/output width of blocks), so is helpful for us to focus
We present a simple, highly modularized network architecture for image
classification. Our network is constructed by repeating a building block that
aggregates a set of transformations with the same topology. Our simple design
results in a homogeneous, multi-branch architecture that has only a few
hyper-parameters to set. This strategy exposes a new dimension, which we call
"cardinality" (the size of the set of transformations), as an essential factor
in addition to the dimensions of depth and width. On the ImageNet-1K dataset,
we empirically show that even under the restricted condition of maintaining
complexity, increasing cardinality is able to improve classification accuracy.
Moreover, increasing cardinality is more effective than going deeper or wider
when we increase the capacity. Our models, named ResNeXt, are the foundations
of our entry to the ILSVRC 2016 classification task in which we secured 2nd
place. We further investigate ResNeXt on an ImageNet-5K set and the COCO
detection set, also showing better results than its ResNet counterpart. The
code and models are publicly available online.
Saining Xie Ross Girshick Piotr Dollár Zhuowen Tu Kaiming He