Is there an easy way to do this in a general way?  I’m doing seq2seq where the inputs are a set of variables rather than a single value.  I’ve got a special start of sequence set value that I’d like to use to trigger operations within the forward, but I’m hoping that I can somehow prevent the weights from being updated.
The approach I’m planning for now is to make the sequence all 0, with the target also 0, and hope that the net chooses the easy path of just connecting input to output, but ideally i’d like to just not update the weights at all.
I’m also curious about the implementation here within the embedding layer.  Is there corresponding code preventing the rest of the net from updating?  Or does padding index just prevent the embedding from updating?
Thanks in advance!