Does it make sense to have a frozen model right before the output and update earlier parameters?
I am training a model like:
input -> FC layers -> frozen RNN model -> binary output -> loss
I just want to update the FC layer weights. If there’s any related research or topic you can refer me to, that would be appreciated.