José Antonio León Gascón|Ricardo Olmos|Isabel Escudero|José J. Cañas|Lalo Salmerón
Assessing short summaries with human judgments procedure and latent semantic analysis in narrative and expository texts
Autonomous University of Madrid|Autonomous University of Madrid|Autonomous University of Madrid|Universidad de Granada|Universidad de Granada
present study tested computerbased procedure assessing concise summaries 50 words long two types text narrative expository using latent semantic analysis lsa comparison judgments four human experts lsa used estimate semantic similarity using six different methods four holistic summarytext summarysummaries summaryexpert summaries pregradedungraded summary two componential summarysentence text summarymain sentence text total 390 spanish middle high school students 1416 years old six experts read narrative expository text later summarized results support viability developing computerized assessment tool using human judgments lsa although correlation human judgments lsa higher narrative text expository lsa correlated human content ratings human coherence ratings finally holistic methods found reliable componential methods analyzed study