retrieval [37], an image representation, rather than a
classiﬁcation score, is required for similarity ranking.
A full-image representation can be preferred.
3.1.5 Multi-view Testing on Feature Maps
Inspired by our detection algorithm (described in
the next section), we further propose a multi-view
testing method on the feature maps. Thanks to the
ﬂexibility of SPP , we can easily extract the features
from windows (views) of arbitrary sizes from the
convolutional feature maps.
On the testing stage, we resize an image so
min(w;h) =swheresrepresents a predeﬁned scale
(like 256). Then we compute the convolutional feature maps from the entire image. For the usage of
7
method test scales test views top-1 val top-5 val top-5 test
Krizhevsky et al. [3] 1 10 40.7 18.2
Overfeat (fast) [5] 1 - 39.01 16.97
Overfeat (fast) [5] 6 - 38.12 16.27
Overfeat (big) [5] 4 - 35.74 14.18
Howard (base) [36] 3 162 37.0 15.8
Howard (high-res) [36] 3 162 36.8 16.2
Existing deep convolutional neural networks (CNNs) require a fixed-size
(e.g., 224x224) input image. This requirement is "artificial" and may reduce
the recognition accuracy for the images or sub-images of an arbitrary
size/scale. In this work, we equip the networks with another pooling strategy,
"spatial pyramid pooling", to eliminate the above requirement. The new network
structure, called SPP-net, can generate a fixed-length representation
regardless of image size/scale. Pyramid pooling is also robust to object
deformations. With these advantages, SPP-net should in general improve all
CNN-based image classification methods. On the ImageNet 2012 dataset, we
demonstrate that SPP-net boosts the accuracy of a variety of CNN architectures
despite their different designs. On the Pascal VOC 2007 and Caltech101
datasets, SPP-net achieves state-of-the-art classification results using a
single full-image representation and no fine-tuning.
  The power of SPP-net is also significant in object detection. Using SPP-net,
we compute the feature maps from the entire image only once, and then pool
features in arbitrary regions (sub-images) to generate fixed-length
representations for training the detectors. This method avoids repeatedly
computing the convolutional features. In processing test images, our method is
24-102x faster than the R-CNN method, while achieving better or comparable
accuracy on Pascal VOC 2007.
  In ImageNet Large Scale Visual Recognition Challenge (ILSVRC) 2014, our
methods rank #2 in object detection and #3 in image classification among all 38
teams. This manuscript also introduces the improvement made for this
competition.
Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun