My expression may not be very clear. I want to say,  in EncoderDeocderModel, I load  the model like this
model = EncoderDecoderModel.from_encoder_decoder_pretrained('bert-base-uncased', 'bert-base-uncased')

I want to modify the structure of LMHead or manipulate the single step of the  output hidden state of the  decoder to make the use-specific generation . Is it possible ?