Hello ! Thank you two for the answers ! Nonetheless, I implemented TFBert and TFRoberta, instantiating them exactly the same way with their own tokenizer but with same input types, and It went really well. I already went through most of HuggingFace examples. Could you tell me more about the strategy I have to adopt ? Is it proper to longformer ?
By the way @jplu I see your profile picture, I am currently studying in Sophia Antipolis. It’s a small world !