Automated Comprehension Assessment in a Reading Tutor
Workshop Paper, ITS '02 Workshop on Creating Valid Diagnostic Assessments, June, 2002
Abstract
Can vocabulary and comprehension assessments be generated automatically for a given text? We describe the automated method used to generate, administer, and score multiple-choice vocabulary and comprehension questions in the 2001-2002 version of Project LISTEN's Reading Tutor. To validate the method against the Woodcock Reading Mastery Test, we analyzed 69,326 multiple-choice cloze items generated in the course of regular Reading Tutor use by 364 students in grades 1-9 at seven schools. Correlation between predicted and actual scores reached R=.85 for Word and Passage Comprehension.
BibTeX
@workshop{Mostow-2002-8476,author = {Jack Mostow and Brian Tobin and Andrew Cuneo},
title = {Automated Comprehension Assessment in a Reading Tutor},
booktitle = {Proceedings of ITS '02 Workshop on Creating Valid Diagnostic Assessments},
year = {2002},
month = {June},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.