Adam Trischler|Tong Wang|Xingdi Yuan|Justin Harris|Alessandro Sordoni|Philip Bachman|Kaheer Suleman
NewsQA: A Machine Comprehension Dataset
Microsoft (Canada)|Microsoft (Canada)|Microsoft (Canada)|Microsoft (Canada)|Microsoft (Canada)|Microsoft (Canada)|Microsoft (Canada)
present newsqa challenging machine comprehension dataset 100000 humangenerated questionanswer pairscrowdworkers supply questions answers based set 10000 news articles cnn answers consisting spans text articleswe collect dataset fourstage process designed solicit exploratory questions require reasoninganalysis confirms newsqa demands abilities beyond simple word matching recognizing textual entailmentwe measure human performance dataset compare several strong neural modelsthe performance gap humans machines 133 f1 indicates significant progress made newsqa future researchthe dataset freely available online