We have noted that many of these desiderata make complex question answering quite similar to multi-document summarization ( Lin and Demner-Fushman 2005b ) , but these features are also beyond the capabilities of current summarization systems .
automatically evaluating answers to definition questions
Jimmy Lin Dina Demner-Fushman
The system should collate concurrences , that is , if multiple abstracts arrive at the same conclusion -- it need not be repeated unless the physician wishes to `` drill down '' ; the system should reconcile contradictions , for example , if two abstracts disagree on a particular treatment because they studied different patient populations . We have noted that many of these desiderata make complex question answering quite similar to multi-document summarization ( Lin and Demner-Fushman 2005b ) , but these features are also beyond the capabilities of current summarization systems . It is clear that the type of answers desired by physicians require a level of semantic analysis that is beyond the current state of the art , even with the aid of existing medical ontologies .
We have noted that many of these desiderata make complex question answering quite similar to multi-document summarization ( @@CITATIONb ) , but these features are also beyond the capabilities of current summarization systems .