The ﬁrst experiment (Tab. 2) investigates the simplest possible scheme: combining the region descriptors
of Sect. 4.1 with a general-purpose image segmentation
method, namely the crisp regions of [19]. Two datasets
are evaluated: OS for material recognition and MSRC for
things & stuff. Compared to OS+R, classifying crisp regions results in a drop of about 5%points for all descriptors. As this dataset is fairly challenging with best achievable performance is 55:4%, this is a satisfactory result. But
it also illustrates that there is ample space for future improvements. In MSRC, the best accuracy is 87:0%, just a
hair above the best published result 86:5%[25]. Remarkably, these algorithms not use any dataset-speciﬁc training, nor CRF-regularised semantic inference: they simply
greedily classify regions as obtained from a general-purpose
segmentation algorithms. Qualitative segmentation results
(sampled at random) are given in Fig. 2 and 3.
Unlike crisp regions, the proposals of [3] are overlapping and a typical image contains thousands of them. We
propose a simple scheme to combine prediction from multiple proposals. For each proposal we set its label to the
highest scoring class, and score to the highest score. We
then sort the proposals in the increasing order of their score
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi