The author estimated achievement effects as measured by the Stanford Achievement Test 9 for students in grades 1–11 who participated in America’s Choice, Co-nect, Different Ways of Knowing, Success for All (SFA), and Urban Learning Centers comprehensive school reform (CSR) designs implemented in the Los Angeles Unified School District between 1999 and 2002. This study yielded effects estimates that were generally less than prior research has suggested. The author found no consistent evidence across the five CSR designs that earlier intervention caused larger gains. However, students who began SFA in grades 1 or 2 benefited in reading, mathematics, and language arts. Results suggested that comparison group selection methods accounted for smaller effect sizes rather than being an artifact of where the reforms were implemented. Conditional on a statistically significant average achievement effect, there was strong evidence that longer participation caused larger effects. Policymakers thinking of implementing a CSR design must consider that prior-effects research might have overestimated achievement effects due to less internally valid research methods.
Mason, Bryce, Achievement Effects of Five Comprehensive School Reform Designs Implemented in Los Angeles Unified School District. Santa Monica, CA: RAND Corporation, 2005. https://www.rand.org/pubs/rgs_dissertations/RGSD192.html.
Mason, Bryce, Achievement Effects of Five Comprehensive School Reform Designs Implemented in Los Angeles Unified School District, Santa Monica, Calif.: RAND Corporation, RGSD-192, 2005. As of October 06, 2021: https://www.rand.org/pubs/rgs_dissertations/RGSD192.html