Florida's Middle School Reading Coaches
What Do They Do? Are They Effective?
Research SummaryPublished Aug 15, 2008
What Do They Do? Are They Effective?
Research SummaryPublished Aug 15, 2008
Despite recent progress in reading achievement among elementary school children, literacy levels among U.S. adolescents remain low. Many middle school students struggle to develop advanced reading skills, such as the ability to analyze and synthesize complex ideas or to comprehend multiple points of view within a text. Middle schools have traditionally emphasized the disciplines, such as history or mathematics, rather than explicit reading instruction. Moreover, most middle school teachers have received only minimal preservice training in how to teach reading.
One popular approach for improving adolescents' literacy skills is the use of school-based literacy or reading coaches. Reading coaches are trained master teachers who provide leadership for the school's literacy program and offer onsite and ongoing support for teachers so that they can improve the literacy of their students. Coaches generally do not work directly with students but instead provide support to teachers.
While reading coaches have become increasingly prevalent, there is little empirical evidence regarding their effectiveness in changing teacher practice and improving student achievement. RAND sought to address this gap in knowledge by studying a statewide reading coach program in Florida middle schools. Researchers surveyed principals, coaches, and teachers in 113 middle schools; conducted interviews, focus groups, and observations in a sample of the surveyed schools; interviewed state officials and coach coordinators; and examined results from state middle school examinations in reading and mathematics.
Florida's coaching program, which is part of a broader statewide effort known as Just Read, Florida!, provides funding to school districts to hire full-time, site-based reading coaches for schools. The state defines basic goals for the program but leaves details up to districts. The state provides districts with a job description suggesting basic coach qualifications, recommends that coaches work with all teachers across all content areas, and suggests that they spend at least half their time in the classroom working one-on-one with teachers. The study found that districts tended to establish similar policies and supports for coaches regarding hiring, compensation, evaluation, and training.
Reading coaches typically divided their time among many activities, including formal work with teachers, informal coaching, administrative duties, data analysis, and noncoaching duties. Although coaches spent the most time on one-on-one work with teachers, this activity typically accounted for less than half of coaches' time (the amount recommended by the state). Moreover, coaches tended to work mostly with reading teachers, and were much less likely to focus on teachers specializing in other disciplines, such as English, mathematics, or science.
The majority of reading and social studies teachers reported that the coach had influenced their instructional practice. More than 40 percent characterized this influence as "moderate to great" in magnitude; approximately two-thirds believed that these interactions helped them feel more confident in their ability to teach reading to students. The vast majority of principals also reported that their coaches had a positive effect on their own knowledge, the school climate, and students' motivation to read.
On average, those coaches who received higher teacher ratings for their knowledge and skills also tended to be perceived as having greater influence over teachers' practice. Coaches' ability to support adult learners (i.e., teachers) (as reported by principals) was also associated with positive perceptions of coach influence in the classroom. Principal and district support for coaching appears to be another enabler of coach effectiveness.
However, ensuring the quality of coaches was a concern for many administrators. Some administrators raised questions about schools' ability to recruit and retain high-quality coaches, and some questioned the particular skills and knowledge of their coaches. Moreover, many coaches expressed a desire for additional professional development to help them understand specific needs of adult learners and how to support them effectively.
Researchers found that having a state-funded coach was associated with small but significant improvements in average annual gains for middle school students (as measured by the Florida Comprehensive Assessment Test (FCAT) Sunshine State Standards reading test) for two of the four cohorts analyzed (those schools first receiving a coach in 2003 and 2005). However, significant effects were not seen for the 2004 and 2006 cohorts.
There was a significant, though small, relationship between the frequency with which coaches reviewed assessment data with reading teachers and better student scores in reading and mathematics. Moreover, social studies teachers' perceptions of coaches' effectiveness in influencing their instruction were strongly related to the frequency with which the coach reviewed assessment data with them.
The study identified several barriers constraining coaches' ability and opportunity to provide instructional support to teachers. Most notably, more than half of coaches cited the large amount of time needed to coordinate and administer assessments as a moderate or great hindrance to their work, and about a third felt that the school schedule did not provide teachers with adequate planning time to meet with coaches. About one-third of coaches reported that some teachers were reluctant to work with them. Nearly a third of coaches and principals indicated that the ratio of teachers to reading coaches negatively affected the ability to coach, and many district coordinators and coaches noted the challenges involved in supporting many teachers at once.
Based on the findings of the study, researchers offered several recommendations for policymakers, administrators, and other school officials.
This publication is part of the RAND research brief series. Research briefs present policy-oriented summaries of individual published, peer-reviewed documents or of a body of published work.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.