Improving Mathematics and Science Education

A Longitudinal Investigation of the Relationship Between Reform-Oriented Instruction and Student Achievement

by Vi-Nhuan Le, Brian M. Stecher, J. R. Lockwood, Laura S. Hamilton, Abby Robyn, Valerie L. Williams, Gery W. Ryan, Kerri A. Kerr, Jose Felipe Martinez, Stephen P. Klein

View related products

Download

Download eBook for Free

Full Document

FormatFile SizeNotes
PDF file 0.6 MB

Use Adobe Acrobat Reader version 7.0 or higher for the best experience.

Summary Only

FormatFile SizeNotes
PDF file 0.1 MB

Use Adobe Acrobat Reader version 7.0 or higher for the best experience.

Appendixes

FormatFile SizeNotes
PDF file 10.7 MB

Use Adobe Acrobat Reader version 7.0 or higher for the best experience.

Purchase

Purchase Print Copy

 FormatList Price Price
Add to Cart Paperback & CD-ROM116 pages $30.00 $24.00 20% Web Discount

Abstract

The term reform-oriented teaching describes a collection of instructional practices that are designed to engage students as active participants in their own learning and to enhance the development of complex cognitive skills and processes. This monograph presents the findings of a multiyear National Science Foundation (NSF)-funded study of the effectiveness of reform-oriented science and mathematics instruction. It builds on an earlier RAND study, called the Mosaic project, which found “a weak but positive relationship” between reform-oriented practices and student achievement. The present study, called Mosaic II, extends this earlier research in two important ways. First, it incorporates more-diverse indicators of student exposure to reform-oriented practices, including innovative, vignette-based measures. Second, it follows students for three years in order to measure the relationship after longer exposure to reform practices.

Mosaic II was designed to answer two major research questions:

  • Is the use of reform-oriented instructional practices in mathematics and science associated with higher student achievement?
  • Is the relationship between reform-oriented practices and achievement sensitive to the aspects of achievement that are measured?

The research was conducted in three districts that participated in the NSF Local Systemic Change program, although the study is not an evaluation of the implementation or impact of that specific program.

We found nonsignificant or weak positive relationships between reform-oriented instruction in mathematics and science and student achievement measured using multiple-choice tests. The results also reinforce the message that measurement matters — i.e., the observed relationship between reform-oriented instruction and achievement may depend on how achievement is measured. It is common practice to use existing state or district tests as measures of program effectiveness, because it is often not feasible to administer additional tests. Our analysis indicates that this decision may influence findings.

Results should be of interest to educators and policymakers concerned with improving mathematics and science education.

Background details on and tabulated results of this study are included in supporting appendixes on a CD-ROM that is included with the printed version of this document.

Table of Contents

  • Chapter One

    Introduction

  • Chapter Two

    Sample Selection and Data Collection

  • Chapter Three

    Measures of Teaching Practices

  • Chapter Four

    Relationships Between Reform-Oriented Instruction and Student Achievement in Mathematics and Science

  • Chapter Five

    Implications

Research conducted by

The research described in this report was sponsored by the National Science Foundation and was conducted by RAND Education, a unit of the RAND Corporation.

This report is part of the RAND Corporation monograph series. RAND monographs present major research findings that address the challenges facing the public and private sectors. All RAND monographs undergo rigorous peer review to ensure high standards for research quality and objectivity.

Permission is given to duplicate this electronic document for personal use only, as long as it is unaltered and complete. Copies may not be duplicated for commercial purposes. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. For information on reprint and linking permissions, please visit the RAND Permissions page.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.