extending of Transformer-XL for new tasks 
Hello community,

I am looking for an example which could help me to extend the Transformer XL to a model similar to bert-as-service model [1]. I would like to know how to set up new layers on the pretrained Tranformer XL and train the last new layers or the whole model. Could anyone give me an advice regarding this issue. Thank a lot

[1] - https://github.com/hanxiao/bert-as-service
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
