and in OS and MSRC in particular, not all pixels are labelled. In this case, accuracy is measured per-pixel rather
than per-segment, ignoring all pixels that are unlabelled in
the ground truth. For MSRC, furthermore, accuracy is normalised across all pixels regardless of their category. For
OSA, since some segments may have more than one label,
we are reporting mAP, following the standard procedure for
multi-label datasets. Finally, PASCAL VOC 2007 classiﬁcation uses mean average precision (mAP), computed using
the TRECVID 11-point interpolation [10].3
Descriptor details. FC-CNN and FV-CNN build on the
pre-trained VGG-M [6] model as this performs better than
other popular models such as [21] while having a similar computational cost. This network results in 4096dimensional FC-CNN features and 512-dimensional local
features for FV-CNN computation. The latter are pooled
into a FV representation with 64 Gaussian components,
resulting in 65K-dimensional descriptors. While the FVCNN dimensionality is much higher than the 4K dimensions of FC-CNN, the FV is known to be highly redundant and can be typically compressed by one order of magnitude without appreciable reduction in the classiﬁcation
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi