Neural Network Algorithm, Neural Networks, Julialang, Editors Pick, Thoughts And Theory.
the network starting from the last obtained weights without reinitializing the parameters from scratch. The higher the percentage of pruned parameters the higher the drop in accuracy, this is the reason pruning is usually done iteratively eliminating a small percentage of the network at a time.