Use of Writing Samples on Standardized Tests
Susceptibility to Rule-Based Coaching and the Resulting Effects on Score Improvement
Published in: Applied Measurement In Education, v. 21 no. 3, Sep. 2008, p. 227-252
Posted on RAND.org on January 01, 2008
Despite the growing use of writing assessments in standardized tests, little is known about coaching effects on writing assessments. Therefore, this study tested the effects of short-term coaching on standardized writing tests, and the transfer of those effects to other writing genres. College freshmen were randomly assigned to either training (receiving nine hours of rule-based coaching) or a control group. Both groups completed pretest essays on the first day, and posttest and transfer essays (writing in a different genre) on the last day of the experiment. Group membership (training versus control) and an interaction between pretest scores and group membership were significant predictors of posttest scores after controlling for pretest performance. Training also produced higher transfer task scores after controlling for pretest and ACT scores. Implications are discussed.
This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.