title: Compact Neural Networks based on the Multiscale Entanglement Renormalization Ansatz
abstract: The goal of this paper is to demonstrate a method for tensorizing neural networks based upon an efficient way of approximating scale invariant quantum states, the Multi-scale Entanglement Renormalization Ansatz (MERA). We employ MERA as a replacement for linear layers in a neural network and test this implementation on the CIFAR-10 dataset. The proposed method outperforms factorization using tensor trains, providing greater compression for the same level of accuracy and greater accuracy for the same level of compression. We demonstrate MERA-layers with 3900 times fewer parameters and a reduction in accuracy of less than 1% compared to the equivalent fully connected layers.
  
authors: Andrew Hallam Edward Grant Vid Stojevic Simone Severini Andrew G. Green
hIndex: Simone Severini 41