performance [31], so the effective dimensionality of FCand FV-CNN is likely comparable. We veriﬁed that by
PCA-reducing FV to 4096 dimensions and observing only
a marginal reduction in classiﬁcation performance in the
PASCAL VOC object recognition task described below. In
addition to VGG-M, the recent state-of-the art VGG-VD
(very deep with 19 layers) model of Simonyan and Zisserman [39] is also evaluated.
Due to the similarity between FV-CNN and the dense
SIFT FV descriptors used for texture recognition in [7],
the latter is evaluated as well. Since SIFT descriptors
are smaller (128-dimensional) than the convolutional ones
(512-dimensional), a larger number of Gaussian components (256) are used to obtain FV descriptors with a comparable dimensionality. The SIFT descriptors support is
3232pixels at the base scale.
In order to make results comparable to [7], we use
the same settings whenever possible. FV-CNN and DSIFT compute features after rescaling the image by factors
3The deﬁnition of AP was changed in later versions of the benchmark.
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi