Improving Teaching Effectiveness: Implementation

The Intensive Partnerships for Effective Teaching Through 2013–2014

Brian M. Stecher, Michael S. Garet, Laura S. Hamilton, Elizabeth D. Steiner, Abby Robyn, Jeffrey Poirier, Deborah J. Holtzman, Eleanor S. Fulbeck, Jay Chambers, Iliana Brodziak de los Reyes

ResearchPublished Jun 6, 2016

Cover: Improving Teaching Effectiveness: Implementation
Download PDF

Does not include Appendixes D and E.

To improve the U.S. education system through more-effective classroom teaching, in school year 2009–2010, the Bill and Melinda Gates Foundation announced the Intensive Partnership for Effective Teaching sites. The Intensive Partnerships Initiative is based on the premise that efforts to improve instruction can benefit from high-quality measures of teaching effectiveness. The initiative seeks to determine whether a school can implement a high-quality measure of teaching effectiveness and use it to support and manage teachers in ways that improve student outcomes. This approach is consistent with broader national trends in which performance-based teacher evaluation is increasingly being mandated at state and local levels.

To test the theory in practice, the foundation sought partnership sites. It selected three school districts — Hillsborough County Public Schools in Florida, Shelby County Schools in Tennessee, and Pittsburgh Public Schools in Pennsylvania. The foundation also selected four charter management organizations — Alliance College-Ready Public Schools, Aspire Public Schools, Green Dot Public Schools, and the Partnerships to Uplift Communities, all in California.

To evaluate Intensive Partnership implementation, researchers from the RAND Corporation and the American Institutes for Research interviewed annually central-office staff at each site and teachers and other staff in a sample of schools for each site. They also used data from annual teacher and school-leader surveys and documents that the sites and the foundation provided. This report summarizes the implementation status of key reform elements at each site when the Intensive Partnerships initiative launched and five years later in the spring of 2014.

Key Takeaways

Sites Implemented Different Levers at Different Times and in Different Ways

  • Each site took about two years to design and implement its teaching-effectiveness (TE) measure. The surveys and interviews suggest that teachers and school leaders thought that the effectiveness measures had positive effects. Most teachers reported that the sites emphasized using measures for improvement far more than for dismissal or termination, though some teachers expressed concerns that the measures might eventually lead to job loss or other undesirable outcomes.
  • Sites made changes to their procedures for recruitment, hiring, placement, tenure, and dismissal of teachers to try to improve the overall effectiveness of their teacher workforce.
  • Sites did not make many changes to their professional-development (PD) practices for the first couple of years of the initiative. However, once the TE measures were operational, the sites began to explore strategies for supporting teachers based on their identified needs in an effort to improve instruction. Sites found it challenging to customize PD to the needs of individual teachers for a variety of reasons. Individualized PD also presented challenges in terms of recordkeeping.
  • Most sites implemented compensation reforms and differentiated career positions later than the other levers. Teachers reported that they preferred a salary schedule that has a base pay determined by background and experience with bonuses for effectiveness.

Recommendations

  • Continue evaluating the implementation and impact of the Intensive Partnerships initiative through the 2015–2016 school year. This will include updates on implementation and its cost and specific steps the sites are taking to sustain the reforms.
  • Investigate the quality of the teacher-effectiveness measures and assess the effects that the reform has on student outcomes.

Topics

Document Details

Citation

Chicago Manual of Style

Stecher, Brian M., Michael S. Garet, Laura S. Hamilton, Elizabeth D. Steiner, Abby Robyn, Jeffrey Poirier, Deborah J. Holtzman, Eleanor S. Fulbeck, Jay Chambers, and Iliana Brodziak de los Reyes, Improving Teaching Effectiveness: Implementation: The Intensive Partnerships for Effective Teaching Through 2013–2014. Santa Monica, CA: RAND Corporation, 2016. https://www.rand.org/pubs/research_reports/RR1295.html.
BibTeX RIS

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.