object bounding boxes are given.
FV-CNN can be used for describing regions by simply
pooling across pixels within the region. Combined with
a low-level segmentation algorithm this sufﬁces to localize textures within images. This approach is similar to a
recently proposed method called “R-CNN” for localizing
objects [14]. However, in contrast to it we do not need repeated evaluations of the CNN since the convolutional features can be computed just once for the entire image and
pooled differently. This makes FV-CNN not only faster,
but also as experiments suggest, much more accurate at
texture localization. We achieve state of the art results on
the MSRC segmentation dataset using a simple scheme of
classifying “superpixels” obtaining an accuracy of 87.0%
(previous best 86.5%). The corresponding R-CNN obtains
57.7% accuracy. Segmentation results are promising in the
OpenSurfaces dataset [4] as well.
Finally, we analyze the utility of different network layers
and architectures as ﬁlter banks, concluding that: SIFT is
competitive only with the ﬁrst few layers of a CNN (Fig. 4)
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi