CNN-based methods can also be applied to shallow methods, and result in an analogous performance boost. Source
code and models to reproduce the experiments in the paper is made publicly available.
F
1 I NTRODUCTION
PERHAPS the single most important design
choice in current state-of-the-art image classiﬁcation and object recognition systems is the choice
of visual features, or image representation. In fact,
most of the quantitative improvements to image
understanding obtained in the past dozen years can
be ascribed to the introduction of improved representations, from the Bag-of-Visual-Words (BoVW) [1],
[2] to the (Improved) Fisher Vector (IFV) [3]. A
common characteristic of these methods is that
they are largely handcrafted . They are also relatively
simple, comprising dense sampling of local image
patches, describing them by means of visual descriptors such as SIFT, encoding them into a highdimensional representation, and then pooling over
the image. Recently, these handcrafted approaches
have been substantially outperformed by the introduction of the latest generation of Convolutional
Neural Networks (CNNs) [4] to the computer vision
ﬁeld. These networks have a substantially more
sophisticated structure than standard representations, comprising several layers of non-linear feature extractors, and are therefore said to be deep
The latest generation of Convolutional Neural Networks (CNN) have achieved
impressive results in challenging benchmarks on image recognition and object
detection, significantly raising the interest of the community in these
methods. Nevertheless, it is still unclear how different CNN methods compare
with each other and with previous state-of-the-art shallow representations such
as the Bag-of-Visual-Words and the Improved Fisher Vector. This paper conducts
a rigorous evaluation of these new techniques, exploring different deep
architectures and comparing them on a common ground, identifying and disclosing
important implementation details. We identify several useful properties of
CNN-based representations, including the fact that the dimensionality of the
CNN output layer can be reduced significantly without having an adverse effect
on performance. We also identify aspects of deep and shallow methods that can
be successfully shared. In particular, we show that the data augmentation
techniques commonly applied to CNN-based methods can also be applied to shallow
methods, and result in an analogous performance boost. Source code and models
to reproduce the experiments in the paper is made publicly available.
Ken Chatfield Karen Simonyan Andrea Vedaldi Andrew Zisserman