Machine Learning, Artificial Intelligence, Neural Networks, Data Science, Towards Data Science.
the weight matrix to zero, in effect deleting the corresponding output neuron. Here to achieve sparsity of k% we rank the columns of a weight matrix according to their L2-norm and delete the smallest k%. A third and more advanced method is to use Fischer pruning, which relies on the Fischer