contains images collected from the Internet, vividly dubbed
“images in the wild”, all these datasets make the simplifying
banded
 blotchy
 chequered
 grid
marbled
 paisley
 paisley
 wrinkled
brick
 ceramic
 carpet
 fabric
Figure 1. Texture recognition in clutter . Example of top retrieved texture segments by attributes (top two rows) and materials
(bottom) in the OpenSurfaces dataset.
assumption that textures ﬁll images. Thus, they are not necessarily representative of the signiﬁcantly harder problem
of recognising materials in natural images, where textures
appear in clutter. Building on a recent dataset collected by
the computer graphics community, the ﬁrst contribution of
this paper is a large-scale analysis of material and perceptual texture attribute recognition and segmentation in clutter(Fig. 1 and Sect. 2).
Motivated by the challenge posed by recognising texture
in clutter, we develop a new texture descriptor. In the simplest terms a texture is characterized by the arrangement of
local patterns, as captured in early works [26, 41] by the
distribution of local “ﬁlter bank” responses. These ﬁlter
banks were designed to capture edges, spots and bars at
different scales and orientations. Typical combinations of
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi