Texture recognition without clutter. This experimentevaluates the performance of FC-CNN, FV-CNN, D-SIFT,
and their combinations in standard texture recognition
benchmarks such as FMD, KTH-TIPS-2, and DTD. FCCNN is roughly equivalent to the DeCAF method used
in [7] for this data as regions ﬁll images; however, while the
performance of our FC-CNN is similar in KTH ( 70%),
it is substantially better in FMD ( 60:7%!70:4%accuracy) and DTD ( 54:8%!58:7%). This likely is caused by
the improved underlying CNN, an advantage which is more
obvious in FMD and DTD that are closer to object recognition than KTH. FV-CNN performs within 2%in FMD and
KTH but substantially better for DTD ( 58:7%!66:6%).
D-SIFT is comparable in performance to FC-CNN in DTD
and KTH, but substantially worse ( 70:4%!59:2%) in
FMD. Our conclusion is that, even when textures ﬁll the
input image as in these benchmarks, orderless pooling in
FV-CNN and D-SIFT can be either the same or substantially better than the pooling operated in the fully-connected
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi