what is the batch size we can use for SQUAD task?
I am running the squad example. 

I have a Tesla M60 GPU which has about 8GB of memory. For bert-large-uncased model, I can only take batch size as 2, even after I used --fp16. Is it normal? 


solved