High-Performance Neural Networks
for Visual Object Classication
Dan C. Cire san, Ueli Meier, Jonathan Masci,
Luca M. Gambardella and J urgen Schmidhuber
Technical Report No. IDSIA-01-11
January 2011
IDSIA / USI-SUPSI
Dalle Molle Institute for Articial Intelligence
Galleria 2, 6928 Manno, Switzerland
IDSIA is a joint institute of both University of Lugano (USI) and University of Applied Sciences of Southern Switzerland (SUPSI),
and was founded in 1988 by the Dalle Molle Foundation which promoted quality of life.
This work was partially supported by the Swiss Commission for Technology and Innovation (CTI), Project n. 9688.1 IFF:
Intelligent Fill in Form.arXiv:1102.0183v1  [cs.AI]  1 Feb 2011
Technical Report No. IDSIA-01-11 1
High-Performance Neural Networks
for Visual Object Classication
Dan C. Cire san, Ueli Meier, Jonathan Masci,
Luca M. Gambardella and J urgen Schmidhuber
January 2011
Abstract
We present a fast, fully parameterizable GPU implementation of Convolutional Neural
Network variants. Our feature extractors are neither carefully designed nor pre-wired, but
We present a fast, fully parameterizable GPU implementation of Convolutional
Neural Network variants. Our feature extractors are neither carefully designed
nor pre-wired, but rather learned in a supervised way. Our deep hierarchical
architectures achieve the best published results on benchmarks for object
classification (NORB, CIFAR10) and handwritten digit recognition (MNIST), with
error rates of 2.53%, 19.51%, 0.35%, respectively. Deep nets trained by simple
back-propagation perform better than more shallow ones. Learning is
surprisingly rapid. NORB is completely trained within five epochs. Test error
rates on MNIST drop to 2.42%, 0.97% and 0.48% after 1, 3 and 17 epochs,
respectively.
Dan C. Cireşan Ueli Meier Jonathan Masci Luca M. Gambardella Jürgen Schmidhuber