BERT as encoder and a transformer as a decoder.
Hi, there
Is there probability to build a model of the BERT as the encoder and the transformer as the decoder?

Thanks.
The encoder-decoder or bart may be what you want.<|||||>I think you should take a look into the ``encoder-decoder`` framework: https://huggingface.co/transformers/model_doc/encoderdecoder.html<|||||>Note that currently only Bert2Bert is possible.