However, when it comes to using the ﬁlter banks with
FV-CNN, conclusions are very different. First, FV-CNN
outperforms FC-CNN in all cases, with substantial gains
up to 20% in correspondence of a domain transfer from
ImageNet to MIT Indoor. Second, the advantage of using domain-speciﬁc CNNs disappears . In fact, the same
CAFFE model that is 6.4% worse than PLACES with FCCNN, is actually 1.5% better when used in FV-CNN. The
conclusion is that FV-CNN appears to be immune, or at
least substantially less sensitive, to domain shifts.
Our tentative explanation of this surprising phenomenon
is that the convolutional layers are less committed to a speciﬁc dataset than the fully ones. Hence, by using those,
FV-CNN tends to be a more general than FC-CNN.
4.3. Texture segmentation
The previous section considered the problem of region
recognition when the region support is known at test time.
This section studies the problem of recognising regions
when their extent Risnotknown and also be estimated.
The ﬁrst experiment (Tab. 2) investigates the simplest possible scheme: combining the region descriptors
of Sect. 4.1 with a general-purpose image segmentation
Research in texture recognition often concentrates on the problem of material
recognition in uncluttered conditions, an assumption rarely met by
applications. In this work we conduct a first study of material and describable
texture at- tributes recognition in clutter, using a new dataset derived from
the OpenSurface texture repository. Motivated by the challenge posed by this
problem, we propose a new texture descriptor, D-CNN, obtained by Fisher Vector
pooling of a Convolutional Neural Network (CNN) filter bank. D-CNN
substantially improves the state-of-the-art in texture, mate- rial and scene
recognition. Our approach achieves 82.3% accuracy on Flickr material dataset
and 81.1% accuracy on MIT indoor scenes, providing absolute gains of more than
10% over existing approaches. D-CNN easily trans- fers across domains without
requiring feature adaptation as for methods that build on the fully-connected
layers of CNNs. Furthermore, D-CNN can seamlessly incorporate multi-scale
information and describe regions of arbitrary shapes and sizes. Our approach is
particularly suited at lo- calizing stuff categories and obtains
state-of-the-art re- sults on MSRC segmentation dataset, as well as promising
results on recognizing materials and surface attributes in clutter on the
OpenSurfaces dataset.
Mircea Cimpoi Subhransu Maji Andrea Vedaldi