Team of EduTec and TBA Members Wins Runners-Up Prize @ NAEP Reading Automated Scoring Challenge

Team of EduTec and TBA Members Wins Runners-Up Prize @ NAEP Reading Automated Scoring Challenge

Artificial Intelligence, Assessment, Award, Computational Psychometrics, School
The NAEP Reading Automated Scoring Challenge was a competition which was held in late 2021 by the National Center for Education (USA). The goal was to evaluate the applicability of natural language processing methodology to the task of scoring of large scale constructed response assessment data. In addition to this, participating models were also required to be interpretable and free of algorithmic bias against different student demographics. The data set which was used to evaluate the systems consisted of responses from 4th and 8th grade school student to 20 different reading comprehension tasks. More than a dozen different teams from universities and private assessment companies submitted contributions. Out of these, 12 contributions, including ours, were selected as eligible with respect to interpretability and algorithmic fairness. These contributions were then ranked…
Read More