textures to objects (Sect. 4). In textures, we evaluate material and describable attributes recognition and segmentation
on new datasets derived from OpenSurfaces (Sect. 2). When
used with linear SVMs, FV-CNN improves the state of the
art on texture recognition by a signiﬁcant margin. Like textures, scenes are also weakly structured and a bag-of-words
representation is effective. FV-CNN obtains 81.1% accuracy on the MIT indoor scenes dataset [34], signiﬁcantly
outperforming the current state-of-the-art of 70.8% [47].
What is remarkable is that, where [47] ﬁnds that CNNs
trained on scene recognition data perform better than CNNs
trained on an object domain (ImageNet), when used in FV-CNN not only is there an overall performance improvement, but the domain-speciﬁc advantage is entirely removed
(Tab. 3). This indicates that FV-CNN are in fact better at domain transfer. Our method also matches the previous best in
PASCAL VOC 2007 classiﬁcation dataset providing measurable boost over CNNs and closely approaches competitor methods on CUB 2010-2011 datasets when ground-truth
object bounding boxes are given.
FV-CNN can be used for describing regions by simply
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi