Neural Network Algorithm, Neural Networks, Julialang, Editors Pick, Thoughts And Theory.
are either to eliminate a constant fraction of the network at each step or to adopt a more complex function of scheduling. Fine-tuning: after the pruning phase, commonly there is a drop in the accuracy, so it might be useful to retrain the network in order to stabilize it. There are different