Understanding Deep Learning Through Neuron Deletion
there is a rather oldish paper called 'optimal brain damage' which also explores something _similar_. iirc, it tries to get an optimal <i>size</i> of the network by removing unimportant weights from it.