Hi,
I have a trained model weights, and I want to replace those weights with weights + some_random vector, and update only the random vector not weights of a model (freeze those weights).
pseudo code;
# some_random_tensor with requires_grad==True
for layer in model_layers:
    layer.weight = nn.Parameter(layer.weight.data + some_random_tensor)

So now during training, I only want to update some_random_tensor not model weights. How I can approach this problem?
Thanks!