Hello,
I have been working with nn.utils.prune and it seems to me that you cannot currently train those networks after pruning right? We set forward_pre_hooks which means that the forward pass is properly pruned but I do not see anywhere how it is made sure that backprop works. Is it true that this is not implemented? Would it not just work to set the backward_hooks as well? I read the tutorial and looked for other forum posts but I did not find any mention of retraining pruned networks anywhere.
Kind regards,
Richard