Acknowledgements M. Cimpoi was supported by ERC
grant VisRec no. 228180 and the XRCE UAC grant. S. Maji
acknowledges a faculty startup grant from UMass, Amherst.References
[1] E. H. Adelson. On seeing stuff: The perception of materials by humans and machines. SPIE , 4299, 2001. 1
[2] M. Amadasun and R. King. Textural features corresponding to textural properties. Systems, Man, and Cybernetics , 19(5), 1989. 1
[3] P. Arbel ´aez, J. Pont-Tuset, J. T. Barron, F. Marques, and J. Malik.
Multiscale combinatorial grouping. CVPR, 2014. 4, 5, 7
[4] S. Bell, P. Upchurch, N. Snavely, and K. Bala. Opensurfaces: A
richly annotated catalog of surface appearance. In Proc. SIGGRAPH ,
2013. 2
[5] B. Caputo, E. Hayman, and P. Mallikarjuna. Class-speciﬁc material
categorisation. In ICCV , 2005. 1, 4
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi