Improving Teaching Effectiveness: Impact on Student Outcomes

The Intensive Partnerships for Effective Teaching Through 2013–2014

Italo A. Gutierrez, Gabriel Weinberger, John Engberg

ResearchPublished Sep 7, 2016

This interim report presents estimates of the overall effect that the Bill & Melinda Gates Foundation's Intensive Partnerships for Effective Teaching initiative has had on student outcomes through the 2013–2014 school year. The initiative's aim is to encourage and support strategic human-capital reforms that are intended to improve the ways in which "teachers are recruited, evaluated, supported, retained, and rewarded." The reform's cornerstone is the development and implementation of teacher-evaluation systems based on student achievement growth; structured classroom observations by principals or trained peers; and other inputs, such as student or parent surveys. These evaluations are used to guide personnel practices in staffing, professional development, and compensation and career-ladder decisions with the goal of giving every student access to highly effective teachers. The report covers Hillsborough County Public Schools (HCPS) in Florida, Memphis City Schools (MCS) in Tennessee, and Pittsburgh Public Schools (PPS) in Pennsylvania. The initiative has not had the dramatic positive effects on student outcomes for which the foundation had hoped. Through 2013–2014, most estimated effects on student outcomes were insignificant or negative, but there was a positive effect in grades 3–8 for math in PPS. However, impact estimates were increasing in 2013–2014 (the fifth year after the intervention began) in many sites, which suggests that the reforms might be on the way to having a positive effect.

Key Findings

Limited Impact is Seen in Sites, but Impact Estimates Were Trending Upward in the Most Recent Year Studied

  • Through 2013–2014, the initiative does not appear to have had much of an effect on student achievement or graduation rates. The authors' estimates of impact are small and not statistically significant in the first three or four years after the intervention (with the exception of Memphis City Schools (MCS), which fared significantly worse in the first years). However, impact estimates were increasing in 2013–2014 in many sites.
  • In school year 2013–2014, only student performance in lower grades (3 to 8) in math in Pittsburgh Public Schools (PPS) demonstrably improved as a result of the grant activities. This effect is equivalent to approximately two and a half months of learning for math in PPS.
  • The positive impact estimates for school year 2013–2014 in PPS and in Hillsborough County Public Schools (HCPS), the most promising effects to date, are smaller than the normal yearly gains in achievement and in comparison to many other school-level interventions.
  • The recent upward trajectory in five out of six of the achievement impact estimates suggests that the reforms might be on the way to having a positive effect after a few transition years with little or negative impact.

Order a Print Copy

Format
Paperback
Page count
124 pages
List Price
$24.50
Buy link
Add to Cart

Topics

Document Details

  • Availability: Available
  • Year: 2016
  • Print Format: Paperback
  • Paperback Pages: 124
  • Paperback Price: $24.50
  • Paperback ISBN/EAN: 978-0-8330-9552-7
  • DOI: https://doi.org/10.7249/RR1295.3-1
  • Document Number: RR-1295/3-1-BMGF

Citation

RAND Style Manual
Gutierrez, Italo A., Gabriel Weinberger, and John Engberg, Improving Teaching Effectiveness: Impact on Student Outcomes: The Intensive Partnerships for Effective Teaching Through 2013–2014, RAND Corporation, RR-1295/3-1-BMGF, 2016. As of September 8, 2024: https://www.rand.org/pubs/research_reports/RR1295z3-1.html
Chicago Manual of Style
Gutierrez, Italo A., Gabriel Weinberger, and John Engberg, Improving Teaching Effectiveness: Impact on Student Outcomes: The Intensive Partnerships for Effective Teaching Through 2013–2014. Santa Monica, CA: RAND Corporation, 2016. https://www.rand.org/pubs/research_reports/RR1295z3-1.html. Also available in print form.
BibTeX RIS

The research described in this report was conducted by RAND Education and supported by the Bill & Melinda Gates Foundation. For this document, different permissions for re-use apply. Please refer to the Bill & Melinda Gates Foundation section on our permissions page.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.