You should not do that as it will break the computational graph and you will get wrong gradients !!
@Suyoung_Park check the second part of my message. That explains how to avoid the issue with trying to change the nn.Parameter. In particular, you need to delete the unused weights in the init.