a nearly perfect 99:7%classiﬁcation rate in MSRC.
4.2. Region recognition: objects and scenes
This section shows that the FV-CNN descriptor, despite
its orderless nature that make it an excellent texture descriptor, excels at object and scene recognition as well. In the remainder of the section, and unless otherwise noted, region
descriptors are applied to images as a whole by considering
these single regions.
FV-CNN vs FC-CNN. As seen in Table 1, in PASCAL
VOC and MIT Indoor the FC-CNN descriptor performs
very well but in line with previous results for this class of
methods [6]. FV-CNN performs similarly to FC-CNN in
PASCAL VOC, but substantially better ( +5% for VGG-M
and +13% for VGG-VD) in MIT Indoor. As further discussed below, this is an example of the ability of FV-CNN
to transfer between domains better than FC-CNN. The gap
between FC-CNN and FV-CNN is the highest for the very
deep VGG-VD models (68.1% !81.1%), a trend also exhibited by other datasets as seen in Tab. 1. In the CUB
dataset, FV-CNN signiﬁcantly outperforms FC-CNN both
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi