Improving Mathematics and Science Education
A Longitudinal Investigation of the Relationship Between Reform-Oriented Instruction and Student Achievement
The term reform-oriented teaching describes a collection of instructional practices that are designed to engage students as active participants in their own learning and to enhance the development of complex cognitive skills and processes. This monograph presents the findings of a multiyear National Science Foundation (NSF)-funded study of the effectiveness of reform-oriented science and mathematics instruction. It builds on an earlier RAND study, called the Mosaic project, which found “a weak but positive relationship” between reform-oriented practices and student achievement. The present study, called Mosaic II, extends this earlier research in two important ways. First, it incorporates more-diverse indicators of student exposure to reform-oriented practices, including innovative, vignette-based measures. Second, it follows students for three years in order to measure the relationship after longer exposure to reform practices.
Mosaic II was designed to answer two major research questions:
- Is the use of reform-oriented instructional practices in mathematics and science associated with higher student achievement?
- Is the relationship between reform-oriented practices and achievement sensitive to the aspects of achievement that are measured?
The research was conducted in three districts that participated in the NSF Local Systemic Change program, although the study is not an evaluation of the implementation or impact of that specific program.
We found nonsignificant or weak positive relationships between reform-oriented instruction in mathematics and science and student achievement measured using multiple-choice tests. The results also reinforce the message that measurement matters — i.e., the observed relationship between reform-oriented instruction and achievement may depend on how achievement is measured. It is common practice to use existing state or district tests as measures of program effectiveness, because it is often not feasible to administer additional tests. Our analysis indicates that this decision may influence findings.
Results should be of interest to educators and policymakers concerned with improving mathematics and science education.
Background details on and tabulated results of this study are included in supporting appendixes on a CD-ROM that is included with the printed version of this document.
Download eBook for Free
|PDF file||0.6 MB|
|PDF file||0.1 MB|
|PDF file||10.7 MB|
- Copyright: RAND Corporation
- Availability: Available
- Print Format: Paperback & CD-ROM
- Paperback & CD-ROM Pages: 116
- List Price: $30.00
- Paperback & CD-ROM Price: $24.00
- Paperback & CD-ROM ISBN/EAN: 978-0-8330-3964-4
- Document Number: MG-480-NSF
- Year: 2006
- Series: Monographs
Sample Selection and Data Collection
Measures of Teaching Practices
Relationships Between Reform-Oriented Instruction and Student Achievement in Mathematics and Science
The research described in this report was sponsored by the National Science Foundation and was conducted by RAND Education, a unit of the RAND Corporation.
This report is part of the RAND Corporation monograph series. RAND monographs present major research findings that address the challenges facing the public and private sectors. All RAND monographs undergo rigorous peer review to ensure high standards for research quality and objectivity.
Permission is given to duplicate this electronic document for personal use only, as long as it is unaltered and complete. Copies may not be duplicated for commercial purposes. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. For information on reprint and linking permissions, please visit the RAND Permissions page.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.