input image as in these benchmarks, orderless pooling in
FV-CNN and D-SIFT can be either the same or substantially better than the pooling operated in the fully-connected
layers by FC-CNN.
Combining FC- and FV-CNN improves performance in
all datasets by 13%. While this combination is already signiﬁcantly above the state-of-the-art in DTD and
FMD ( +2:6%=11:2%), the method of [7] still outperforms
these descriptors in KTH. However, replacing VGG-M with
VGG-VD signiﬁcantly improves the performance in all
cases – a testament to the power of deep features. In particular, the best method FC+FV-CNN-VD, improves the state
of the art by at least 6%in all datasets. Interestingly, this is
obtained by using a single low-level feature type as FC- and
FV-CNN build on the same convolutional features. Adding
D-SIFT results in at most 1%improvement, and in some
cases it slightly degrades performance.
Texture recognition in clutter. The advantage of FV-CNN
over FC-CNN is much larger when textures do not ﬁll the
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi