Neural Network Algorithm, Neural Networks, Julialang, Editors Pick, Thoughts And Theory.
it than to train a smaller network from scratch [7]. (Image by author) The problem with this method is that by removing too many edges one can lose what was learned. The main difficulty is in finding the best model size. Hence, we can see pruning as a neural network architecture search [8] problem,