Methods for Evaluation

The evaluation of the Intensive Partnerships for Effective Teaching (IP) Initiative uses a variety of methods as part of the Implementation, Outcomes/Impact, and Replication and Scaling Studies.

Surveys

During annual surveys, school leaders and teachers are asked about a number of topics, including

  • Their roles and responsibilities
  • Their experience with the reforms
  • How they allocate their time as it relates to the reforms
  • Changes in their behaviors and practices
  • Their attitudes and reactions to the reforms.

Interviews

Researchers conduct interviews with key central office administrators in each IP site. The interviews focus on the development and implementation of the reforms, including new HR policies, the uses of teaching effectiveness ratings, challenges to implementation, administrative time commitments, and interactions with the Bill and Melinda Gates Foundation, as well as other districts and local education agencies.

School Case Studies

Seven schools from each site serve as case study schools. During these annual case studies, the researchers conduct either in-person or telephone interviews with principals, teachers, and coaches/mentors, as well as focus groups with teachers. Discussions focus on the reforms and how they are affecting the school, the staff, and instruction.

Administrative Data

The project team uses a wide array of existing administrative data from each of the IP sites:

  • Fiscal information, including site expenses by fund, function, and job
  • Personnel data, including staff background characteristics, employment status, compensation, ratings of effectiveness, etc.
  • Student information, such as background characteristics, grades, disciplinary actions, and standardized test scores.

Teaching Effectiveness Measures

RAND also collects each site’s teaching effectiveness data, including the results of classroom observations, student and parent satisfaction surveys, and value-added estimates of each teacher’s impact on student achievement.