Hi,
I don’t think you can freeze the encoder layers without effectively freezing the embedding layer too.  (The changes won’t be able to propagate back through the frozen layers to reach the earlier layers.)