[CamemBERT] Add CamembertForQuestionAnswering
Firstly, a huge thanks to Hugging Face team for their great work ! As we have now Camembert, it would be nice to use it for question answering using transformers ! You can find SQuAD in French on GitHub so it would be so easy to a lot of people to fine-tune Camembert for this task. 

Please consider it in future releases 😉

I wonder if loading as roberta really works for camembert<|||||>What do you mean with this statement?

> I wonder if loading as roberta really works for camembert<|||||>Happy to review a PR for this (should be pretty easy to add!)<|||||>> 
> 
> What do you mean with this statement?
> 
> > I wonder if loading as roberta really works for camembert

you can load camembert config and checkpoints as roberta models but I'm not perfectly sure it's identical. 
I did'nt checked if there was RobertaForQuestionAnswering so my comment is partly irrevelent. However both slould be added if possible. maybe some generic heads using PreTrainedModel could be possible even in not efficient<|||||>> > What do you mean with this statement?
> > > I wonder if loading as roberta really works for camembert
> 
> you can load camembert config and checkpoints as roberta models but I'm not perfectly sure it's identical.
> I did'nt checked if there was RobertaForQuestionAnswering so my comment is partly irrevelent. However both slould be added if possible. maybe some generic heads using PreTrainedModel could be possible even in not efficient

At the moment, you **can't** use RoBERTa model for QuestionAnswering. You can use `RoBERTa` model for **token classification**, **multiple choice**, **sequence classification** and **MaskedLM** (with the usual `RobertaFor*` naming convention).<|||||>Hi, thanks to the Hugging Face team for the amazing work ! I think there is a PR here to add camembert for question answering : https://github.com/huggingface/transformers/pull/2746<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
