channels are 4-dimensional. The grouped convolutional
layer concatenates them as the outputs of the layer. The
block in Fig. 3(c) looks like the original bottleneck residual block in Fig. 1(left), except that Fig. 3(c) is a wider but
sparsely connected module.
3An informal but descriptive proof is as follows. Note the equality:
A1B1+A2B2= [A1; A2][B1;B2]where [;]is horizontal concatenation and [ ; ]is vertical concatenation. Let Aibe the weight of the last layer
andBibe the output response of the second-last layer in the block. In the
case of C= 2, the element-wise addition in Fig. 3(a) is A1B1+A2B2,
the weight of the last layer in Fig. 3(b) is [A1; A2], and the concatenation
of outputs of second-last layers in Fig. 3(b) is [B1;B2].
4In a group conv layer [24], input and output channels are divided into
Cgroups, and convolutions are separately performed within each group.
equivalent
64, 3x3, 4 64, 3x3, 4 64, 3x3, 4
....total 32
paths
We present a simple, highly modularized network architecture for image
classification. Our network is constructed by repeating a building block that
aggregates a set of transformations with the same topology. Our simple design
results in a homogeneous, multi-branch architecture that has only a few
hyper-parameters to set. This strategy exposes a new dimension, which we call
"cardinality" (the size of the set of transformations), as an essential factor
in addition to the dimensions of depth and width. On the ImageNet-1K dataset,
we empirically show that even under the restricted condition of maintaining
complexity, increasing cardinality is able to improve classification accuracy.
Moreover, increasing cardinality is more effective than going deeper or wider
when we increase the capacity. Our models, named ResNeXt, are the foundations
of our entry to the ILSVRC 2016 classification task in which we secured 2nd
place. We further investigate ResNeXt on an ImageNet-5K set and the COCO
detection set, also showing better results than its ResNet counterpart. The
code and models are publicly available online.
Saining Xie Ross Girshick Piotr Dollár Zhuowen Tu Kaiming He