natural, signiﬁcantly more efﬁcient (as it does not require
recomputing the network for each extracted local descriptor) and, as shown in Sect. 4, more accurate.
3.2. Region segmentation
This section discusses our method to automatically partition an image into a number of recognisable regions. Inspired by Cimpoi et al. [7] that successfully ported object
description methods to texture descriptors, here we propose
a segmentation technique inspired by object detection. An
increasingly popular method for object detection, followed
for example by R-CNN [14], is to ﬁrst propose a number of
candidate object regions using low-level image cues, and
then verifying a shortlist of such regions using a powerful classiﬁer. Applied to textures, this requires a low-level
mechanism to generate textured region proposals, followed
by a region classiﬁer. A key advantage of this approach
is that it allows applying object- (FC-CNN) and texturelike (FV-CNN) descriptors alike. After proposal classiﬁcation, each pixel can be assigned more than one label; this is
solved with simple voting schemes, also inspired by object
detections methods.
The paper explores two such region generation methods:
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi