Learning details. The region descriptors (FC-CNN, FVCNN, and D-SIFT) are classiﬁed using 1-vs-rest Support
Vector Machine (SVM) classiﬁers. Prior to learning, descriptors are L2normalised and the learning constant set
toC= 1. This is motivated by the fact that, after data
normalisation, the exact choice of Chas a negligible effect
on performance. Furthermore, the accuracy of the 1-vs-rest
classiﬁcation scheme is improved by recalibrating the SVM
scores after training, by scaling the SVM weight vector and
bias such that the median scores of the negative and positive
training samples for each class are mapped respectively to
the values1and1.
4.1. Region recognition: textures
This and the following section evaluate region recognition assuming that the ground-truth region Ris known (Table 1), for example because it ﬁlls the entire image. This
section focuses on textures (materials and perceptual attributes), while the next on objects and scenes.
Texture recognition without clutter. This experimentevaluates the performance of FC-CNN, FV-CNN, D-SIFT,
and their combinations in standard texture recognition
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi