Sect. 4.1 evaluates the classiﬁcation task by assessing how
well regions can be classiﬁed given that their true extent is
known and Sect. 4.3 evaluates both classiﬁcation and segmentation . The rest of the section introduces the evaluation
benchmarks and technical details of the representations.
Datasets. The evaluation considers three texture recognition benchmarks other than OS (Sect. 2). The ﬁrst one is the
Flickr Material Dataset (FMD) [37], a recent benchmark
containing 10 material classes. The second one is the Describable Texture Datasets (DTD) [7], which contains texture images jointly annotated with 47 describable attributes
drawn from the psychological literature. Both FMD and
DTD contain images “in the wild”, i.e. collected in uncontrolled conditions. However, differently from OS, these images are uncluttered. The third texture dataset is KTH-TIPS2b[5, 17], containing a number of example images for each
of four samples of 11 material categories. For each material, images of one sample are used for training and the
remaining for testing.
Object categorisation is evaluated in the PASCAL VOC
2007 [10] dataset, containing 20 object categories, any
combination of which may be associated to any of the
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi