Hi! So I added those lines in the run_qa.py file just before the trainer is called.
I trained (which took 1.5 hours) but then got terrible f1 results (5.9) 
I hypothesised that using 10 instead of 12 layers would end up with a worse output but not this much worse?
Is it possible that even the qa_head was frozen and nothing was training at all?
Was wondering if you have any ideas…