ﬁne-tuning.
3
2.4 Commonalities
We now turn to what is in common across the
scenarios.
2.4.1 Data augmentation
Data augmentation is a method applicable to shallow and deep representations, but that has been
so far mostly applied to the latter [13], [19]. By
augmentation we mean perturbing an image Iby
transformations that leave the underlying class unchanged ( e.g. cropping and ﬂipping) in order to
generate additional examples of the class. Augmentation can be applied at training time, at test time,
or both. The augmented samples can either be taken
as-is or combined to form a single feature, e.g. using
sum/max-pooling or stacking.
2.4.2 Linear predictors
All the representations (I)in the three scenarios
are used to construct linear predictorshw;(I)ifor
each class to be recognized. These predictors are
learnt using Support Vector Machines (SVM) by
ﬁtting wto the available training data by minimizing an objective function balancing a quadratic
regularizer and the hinge-loss. The parameter C
in the SVM, trading-off regularizer and loss, is
determined using an held-off validation subset of
The latest generation of Convolutional Neural Networks (CNN) have achieved
impressive results in challenging benchmarks on image recognition and object
detection, significantly raising the interest of the community in these
methods. Nevertheless, it is still unclear how different CNN methods compare
with each other and with previous state-of-the-art shallow representations such
as the Bag-of-Visual-Words and the Improved Fisher Vector. This paper conducts
a rigorous evaluation of these new techniques, exploring different deep
architectures and comparing them on a common ground, identifying and disclosing
important implementation details. We identify several useful properties of
CNN-based representations, including the fact that the dimensionality of the
CNN output layer can be reduced significantly without having an adverse effect
on performance. We also identify aspects of deep and shallow methods that can
be successfully shared. In particular, we show that the data augmentation
techniques commonly applied to CNN-based methods can also be applied to shallow
methods, and result in an analogous performance boost. Source code and models
to reproduce the experiments in the paper is made publicly available.
Ken Chatfield Karen Simonyan Andrea Vedaldi Andrew Zisserman