cases it slightly degrades performance.
Texture recognition in clutter. The advantage of FV-CNN
over FC-CNN is much larger when textures do not ﬁll the
image but are extracted from clutter. In OS+R (Sect. 2),
material recognition accuracy starts at about 46% for both
FC-CNN and D-SIFT; however, FV-CNN improves this by
more than 11% (46:5%!58:1%). The combination of FCand FV-CNN improves results further by 2%, but adding
SIFT deteriorates performance. With the very deep CNN
conclusions are similar; however, switching to VGG-VD
barely affects the FC-CNN performance ( 46:5!48:0%),
but strongly affects the one of FV-CNN ( 58:1%!65:1%).
This conﬁrms that FC-CNN, while excellent in object detection, is not a very good descriptor for classifying textured
regions. Results in OSA+R for texture attribute recognition
(Sect. 2) and in MSRC+R for semantic segmentation are
analogous; it is worth noting that, when ground-truth segments are used in this experiment, the best model achieves
a nearly perfect 99:7%classiﬁcation rate in MSRC.
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi