Hey, yes actually the prune module behaves just as I wanted it to behave. If you prune a module, than the weights will be zero in the forward pass and the gradients will be zero as well.
Does that answer your question?
Best,
Max