Solved by ptrblck in post #2 
              
              
                Could you try to assign your new layer to the one you would like to replace? 
net = models.SqueezeNet()
net.features[3] = nn.Conv2d(96, 128, 1, 1) # Replace this with your custom layer