Solved by Michela in post #5 
              
              
                Glad we figured out how to make it work! 
Yes, the parameters will always be the unpruned versions of the tensors, until you .remove() the reparametrization. 
One option: grab both the unpruned parameters from self.parameters() and the masks from self.buffers() and do the multiplication manually (co…