My bad! typo in the post but not in the original code! Reinitialization of conv2d will randomly initialize the weights. Besides, the self.features = nn.Sequential( ... container doesn’t allow to change only the first conv2d layer (please correct me if I’m wrong) while keeping all the weights as they are that it received after the first statement above. Still looking for a clue on how to modify the first layer