solved with simple voting schemes, also inspired by object
detections methods.
The paper explores two such region generation methods:
the crisp regions of [19] and the multi-scale combinatorial
grouping of [3]. In both cases, region proposals are generated using low-level image cues, such as colour or texture
consistency, as speciﬁed by the original methods. It would
of course be possible to incorporate FC-CNN and FV-CNN
among these energy terms to potentially strengthen the region generation mechanism itself. However, this contradicts partially the logic of the scheme, which breaks down
the problem into cheaply generating tentative segmentations and then verifying them using a more powerful (and
likely expensive) model. Furthermore, and more importantly, these cues focus on separating texture instances , as
presented in each particular image, whereas FC-CNN and
FV-CNN are meant to identify a texture class. It is reasonable to expect instance-speciﬁc cues (say the colour of a
painted wall) to be better for segmentation.
4. Results
This section evaluates the proposed region recognition
methods for classifying and segmenting materials, describable texture properties, and higher-level object categories.
Sect. 4.1 evaluates the classiﬁcation task by assessing how
well regions can be classiﬁed given that their true extent is
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi