About QuestionAnswering on SQuAD2.0 Dataset
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
Do anyone understand the paper " QuestionAnswering on SQuAD2.0 Dataset" in section 5.1. It says
 "As we increase the number of epochs in training, the performance of the answerable questions is improved while the performance for the non-answerable questions drop hugely"
<img width="393" alt="擷取" src="https://user-images.githubusercontent.com/32416416/70907720-88033d00-2044-11ea-9ab9-1f2437aefd11.PNG">
I want to know why cause this situation?
And it also says  One possible solution is that, the no-answer indicator is only from the ﬁrst [CLS] token, the value of attentions to the [CLS] token may be much weaker than the word-word attention. Hence the Transformer may focus less on the attention associated with the [CLS] token.
what does this mean about " the Transformer may focus less on the attention associated with the [CLS] token."
Can anyone help? Thans a lot

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
