Achieving State and National Literacy Goals, a Long Uphill Road: A Report to Carnegie Corporation of New York
Sep 16, 2005
Carnegie Corporation of New York has launched an initiative focusing on improving the literacy skills of adolescents. In support of this initiative, Carnegie asked the RAND Corporation to examine adolescents' literacy achievement across the nation. The results of that examination provide a sobering portrait of where adolescents stand relative to state and national literacy goals.
Despite recent progress in reading achievement among children in primary grades, many children are not moving beyond basic decoding skills as they advance to the fourth grade and classes in history, mathematics, and science. This situation is especially troubling, because adolescents increasingly face a job market that demands high levels of literacy skills. Continuous instruction beyond the third grade is needed; however, teaching reading and writing to adolescents is an "orphaned responsibility" in secondary schools.
To focus national attention on the problem of adolescent literacy, Carnegie Corporation of New York launched a new initiative, Advancing Literacy. As a first step, Carnegie asked the RAND Corporation to undertake a study examining the state of achievement in adolescent literacy in the nation. The results are documented in a RAND report by McCombs, Kirby, and colleagues. The report provides a comprehensive portrait of where the nation's adolescents stand relative to state and national literacy goals and underscores how far we are from the goal of 100-percent proficiency set under No Child Left Behind (NCLB).
The researchers examined data on state assessments to understand how states define and measure adolescent literacy and set proficiency standards. They also used the National Assessment of Educational Progress (NAEP) to analyze how well adolescents were faring on a national assessment. Data from the NAEP and the state assessments provide multiple indicators of student performance in the states and show how students are shaping up with respect to national and state literacy goals.
The researchers caution that, because of the differences in the tests themselves and in the definitions of proficiency levels in the NAEP and state performance standards, these data are not directly comparable. They offer two reasons for examining both sets of results: (1) It is important for state policymakers, practitioners, and parents to examine both sources of data and to make their own judgments regarding the relative performance of students against both sets of standards; and (2) under NCLB, states are now required to participate in the NAEP in order to help verify state results using a common measure—a reason for states needing to become familiar with the NAEP, what it measures, and how what it measures differs from their own assessments.
NCLB requires states to adopt standards-based accountability systems that set challenging content and performance standards for all students. To ensure that students are meeting these standards, states must test all children annually in reading and math in grades 3, 4, 5, 6, 7, 8, and once in high school by 2005–06 and in science at least once in grades 3–5, 6–9, and in grades 10–12 by 2007–08. States must establish goals for performance on the assessment and track performance for all students and subgroups of students (for example, racial/ethnic groups, students with disabilities, students with limited English proficiency). By the end of 12 years, schools in the state should all have reached 100-percent proficiency—that is, all children in the school must pass the state test.
The research findings suggest some major concerns about the ability of states to meet NCLB's ambitious goal:
First, in several states, fewer than half the students meet the state proficiency standards, and in no state do even half the students meet the NAEP national literacy standard of proficiency. Moreover, the pass rates on state assessments vary significantly from state to state:
Second, the wide disparity in the achievement of subgroups of students makes reaching the 100-percent proficiency goal for all students a more challenging task for certain schools and districts. The NAEP and state assessments show large and surprisingly similar achievement gaps between subgroups of students disaggregated by race/ethnicity and poverty status. For example:
It is clear that while states are operating under a common mandate for proficiency, there are large differences in the rigor of the assessment and cut-scores for proficiency rates, leading to quite disparate outcomes. Compare, for instance, South Carolina, Wyoming, North Carolina, and Texas. At the 8th-grade level, 21 percent of students in South Carolina and 39 percent of students in Wyoming passed the state assessment, compared with 86 to 88 percent of 8th-graders in North Carolina and Texas. However, when one looks at the 8th-grade NAEP scores, 24 percent of students in South Carolina and 34 percent of students in Wyoming scored at the proficient level, compared with 26 percent of students in Texas and 29 percent of students in North Carolina. Clearly, even if each state were to meet its 100-percent proficiency goal for reading, students in those states would likely have quite disparate abilities, knowledge, and skills.
Further, simply looking at proficiency rates on state assessments may not provide the public and parents all the information that they might want about student achievement. For example, examining individual states, we see both similarities and marked differences in some states about what the state assessments show about the relative performance of subgroups and what the NAEP shows about that performance. If state assessments show small performance gaps between these groups of students while the NAEP, arguably using a more challenging standard of literacy, shows large performance gaps, it is important for state policymakers and parents to reflect on what this disparity might imply for the likely future employment and educational opportunities for these students.
If we fail to give due attention to multiple sources of information regarding literacy achievement, we may fail to miss important problem areas and may end up shortchanging those most in need of assistance.
Overall, the data paint a sobering portrait of the literacy levels of U.S. adolescents. It is clear that simply mandating standards and assessments is not going to guarantee success. Unless we, as a nation, are prepared to focus attention and resources on this issue, our schools are likely to continue producing students who lack skills and are ill-prepared to deal with the demands of post-secondary education and the workplace. Policymakers, schools, and teachers need to step up and accept the "orphaned responsibility" of teaching students to read to learn. The costs of inattention are very high, in both personal and economic terms.