size ( e.g., pool 32), and the output feature map size ( e.g., map size 5555). LRN represents Local Response
Normalization. The padding is adjusted to produce the expected output feature map size.
3 SPP- NET FOR IMAGE CLASSIFICATION
3.1 Experiments on ImageNet 2012 Classiﬁcation
We train the networks on the 1000-category training
set of ImageNet 2012. Our training algorithm follows
the practices of previous work [3], [4], [36]. The images are resized so that the smaller dimension is 256,
and a 224224 crop is picked from the center or the
four corners from the entire image1. The data are augmented by horizontal ﬂipping and color altering [3].
Dropout [3] is used on the two fully-connected layers.
The learning rate starts from 0.01, and is divided by 10
(twice) when the error plateaus. Our implementation
is based on the publicly available code of cuda-convnet
[3] and Caffe [35]. All networks in this paper can be
trained on a single GeForce GTX Titan GPU (6 GB
memory) within two to four weeks.
3.1.1 Baseline Network Architectures
The advantages of SPP are independent of the convolutional network architectures used. We investigate
Existing deep convolutional neural networks (CNNs) require a fixed-size
(e.g., 224x224) input image. This requirement is "artificial" and may reduce
the recognition accuracy for the images or sub-images of an arbitrary
size/scale. In this work, we equip the networks with another pooling strategy,
"spatial pyramid pooling", to eliminate the above requirement. The new network
structure, called SPP-net, can generate a fixed-length representation
regardless of image size/scale. Pyramid pooling is also robust to object
deformations. With these advantages, SPP-net should in general improve all
CNN-based image classification methods. On the ImageNet 2012 dataset, we
demonstrate that SPP-net boosts the accuracy of a variety of CNN architectures
despite their different designs. On the Pascal VOC 2007 and Caltech101
datasets, SPP-net achieves state-of-the-art classification results using a
single full-image representation and no fine-tuning.
  The power of SPP-net is also significant in object detection. Using SPP-net,
we compute the feature maps from the entire image only once, and then pool
features in arbitrary regions (sub-images) to generate fixed-length
representations for training the detectors. This method avoids repeatedly
computing the convolutional features. In processing test images, our method is
24-102x faster than the R-CNN method, while achieving better or comparable
accuracy on Pascal VOC 2007.
  In ImageNet Large Scale Visual Recognition Challenge (ILSVRC) 2014, our
methods rank #2 in object detection and #3 in image classification among all 38
teams. This manuscript also introduces the improvement made for this
competition.
Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun