Building a Validity Argument for an Automated Writing Evaluation System (eRevise) as a Formative Assessment

Richard Correnti, Lindsay Clare Matsumura, Elaine Lin Wang, Diane Litman, Haoran Zhang

ResearchPosted on rand.org May 4, 2022Published in: Computers and Education Open (2022). doi: 10.1016/j.caeo.2022.100084

  • To be useful for formative assessment purposes, the information derived from an automated writing evaluation (AWE) system must capture meaningful features of a writing construct.
  • We present a validity argument for an AWE system—termed eRevise—that targets elementary students' text-based argumentative writing skills, specifically their ability to use text evidence.
  • We provide evidence that the feedback is understood by students and that their revisions are aligned with the automated feedback they received.
  • Teachers overall responded very positively to eRevise, with nearly all reporting that they would use eRevise again.
  • Improvement scores were higher when teachers reported substantive interactions with students about the students' interpretation of the automated feedback.
Read More

Topics

Document Details

  • Copyright: Richard Correnti, Lindsay Clare Matsumura, Elaine Wang, Diane Litman, Haoran Zhang
  • Publisher: Elsevier Ltd
  • Availability: Non-RAND
  • Year: 2022
  • Pages: 52
  • Document Number: EP-68913

This publication is part of the RAND external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.