Now I understand it, If I wrap parameters with nn.Parameter() or use .data, I will get wrong weird gradients. but what do you mean I have to delete the unused weights( only conv5.weight?) in the init?