setting compared to the best result of [12].
Computation starts by upscaling the image Iby a
factor of 2 [23], followed by SIFT features extraction
with a stride of 3 pixels at 7 different scales withp
2
scale increments. These features are square-rooted
as suggested by [24], and decorrelated and reduced
in dimension from 128Dto80Dusing PCA. A
GMM with K= 256 components is learnt from features sampled from the training images. Hence the
Fisher Vector FV(I)has dimension 2KD= 40;960.
Before use in classiﬁcation, the vector is signedsquare-rooted and l2-normalised (square rooting
correspond to the Hellinger’s kernel map [25]). As
in [12], square-rooting is applied twice, once to the
raw encodings, and once again after sum pooling
and normalisation. In order to capture weak geometrical information, the IFV representation is used
in a spatial pyramid [26]. As in [12], the image is
divided into 11,31, and 22spatial subdivisions
and corresponding IFVs are computed and stacked
with an overall dimension of 82KD= 327;680
elements.
The latest generation of Convolutional Neural Networks (CNN) have achieved
impressive results in challenging benchmarks on image recognition and object
detection, significantly raising the interest of the community in these
methods. Nevertheless, it is still unclear how different CNN methods compare
with each other and with previous state-of-the-art shallow representations such
as the Bag-of-Visual-Words and the Improved Fisher Vector. This paper conducts
a rigorous evaluation of these new techniques, exploring different deep
architectures and comparing them on a common ground, identifying and disclosing
important implementation details. We identify several useful properties of
CNN-based representations, including the fact that the dimensionality of the
CNN output layer can be reduced significantly without having an adverse effect
on performance. We also identify aspects of deep and shallow methods that can
be successfully shared. In particular, we show that the data augmentation
techniques commonly applied to CNN-based methods can also be applied to shallow
methods, and result in an analogous performance boost. Source code and models
to reproduce the experiments in the paper is made publicly available.
Ken Chatfield Karen Simonyan Andrea Vedaldi Andrew Zisserman