nn.Conv2d(2048, 2048, kernel_size=[1, 1], stride=(1, 1), bias=False)
I added this to the model with
with torch.no_grad():
  self.layer.weight.fill_(1.0)

in the init function after defining it
but the thing is that when I got output till the previous layer in both the original and the new network they were same
but when I passed them through this layer it changed