datasets. Here we investigate the effect of using domainspeciﬁc features. To do so, we consider the PLACES [47],
trained to recognize places on a dataset of about 2.5 million labeled images. [47] showed that, applied to the task of
scene recognition in MIT Indoor, these features outperform
similar ones trained on ILSVCR (denoted CAFFE [21] below) – a fact explained by the similarity of domains. Below,
we repeat this experiment using FC- and FV-CNN descriptors on top of VGG-M, VGG-VD, PLACES, and CAFFE.
Results are shown in Table 3. The FC-CNN results are
in line with those reported in [47] – in scene recognition
with FC-CNN the same CNN architecture performs better
if trained on the Places dataset instead of the ImageNet data
(58:6%!65:0%accuracy4). Nevertheless, stronger CNN
architectures such as VGG-M and VGG-VD can approach
and outperform PLACES even if trained on ImageNet data
(65:0%!63:0%=68:1%).
However, when it comes to using the ﬁlter banks with
FV-CNN, conclusions are very different. First, FV-CNN
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi