Hey! have you found an efficient solution?
I’m also facing a similar problem, where I need to freeze my weights to a fixed value. I want to save training time by neglecting the backprop on the weights that I freeze.
For now, I’m overwriting the weights again and again to the fixed value in every forward pass. But that’s not an efficient way.