bert uncased models needs lower casing option turned on in the example code.
The command to replicate bert-base-uncased model and bert-large-uncased-whole-word-masking model results on Squad requires --do_lower_case to be used. If not, the result is low.
Those models should contain config that initializes their tokenizer with the correct `do_lower_case=True` option. Is this not the case?

i.e. we are moving the tokenizer configuration out of those example scripts (see updated scripts for `Trainer` at https://github.com/huggingface/transformers/tree/master/examples).<|||||>I haven't gone through the recent update sorry. 
It looks like the [examples page](https://github.com/huggingface/transformers/tree/master/examples/) has completely changed now. 
But in the folder of [question-answering](https://github.com/huggingface/transformers/tree/master/examples/question-answering), the configuration to replicate results still remains the same. 

Shall I modify this there and create a request ? 
Because the  `do_lower_case` argument is a `store_true` argument and not a `boolean` with default as `true`. 

I spent 3 runs to realise the error because it worked correctly with cased models. 

Reference https://github.com/huggingface/transformers/blob/4658896ee105c504eba23db2efefc5fe14191b81/examples/question-answering/run_squad.py#L579


<|||||>Closing this b/c #4245 was merged

(we still need to investigate why the lowercasing is not properly populated by the model's config)

