I guess both approaches should work (you should get an error message if they are causing other issues), but they won’t be the same. In the second approach you are manipulating the weight of self.classifier[0] inplace, which would also change its execution in case you are calling self.classifier[0](input) at one point and would also be visible in the state_dict if you store the model.