Early Insights on Designing Innovative High Schools
Interim Findings from an Evaluation of the Opportunity by Design Initiative
Research SummaryPublished Oct 19, 2017
Interim Findings from an Evaluation of the Opportunity by Design Initiative
Research SummaryPublished Oct 19, 2017
Photo by asiseeit/Getty
How can high schools be designed to prepare students for success? Could these innovative high schools also build capacity for innovation within their districts and serve as examples for the field? The Carnegie Corporation of New York’s (CCNY’s) Opportunity by Design (ObD) initiative is intended to address the ambitious goal of preparing students for postsecondary success, based on the premise that promising high school reforms need to be integrated into a comprehensive school design and accompanied by appropriate, sustained levels of financial, policy, and implementation supports. This brief summarizes early lessons from RAND’s interim evaluation of the ObD initiative and provides a number of recommendations, based on these early findings, that may be of interest to schools and districts implementing or considering implementation of similar approaches.
The CCNY ObD initiative was founded in 2013 to support the design and launch of a network of small high schools of choice that focus on ten design principles. The initiative provided each school with funding and technical support for a design year prior to the school’s opening and two years of implementation. Implementation of the ObD schools was phased — five schools opened in fall 2014, five opened in fall 2015, two schools opened in fall 2016, and the last schools opened in fall 2017. Through the ObD initiative, CCNY, along with the capacity-building organization Springpoint: Partners in School Design, supports the participating districts in using innovative school design to improve student outcomes and ultimately enable broader district reforms.
RAND researchers, as part of their evaluation of the program, have published an interim report that describes implementation of the ObD initiative after two years, as well as the conditions that facilitate and hinder implementation and how school staffs have addressed those conditions so far. The report emphasizes three key design principles — prioritizing mastery, personalizing learning, and positive youth development (PYD) — which CCNY believes are foundational to the schools' models.
The interim report focuses on implementation in the ten ObD schools in operation during the 2015–2016 academic year. The findings in this report are based on teacher and student surveys; interviews with principals, teachers, and district staff; student focus groups; brief classroom observations; and artifacts. The schools in the study were in an early phase of implementation — five were in their first year of implementation, and five were in their second year — and these findings provide an early look at the ObD models. The discussion of implementation in this interim report is largely descriptive; the authors do not draw any causal conclusions. In addition, the survey and interview data rely on self-reports and, for the interviews, involve relatively small sample sizes. Despite these limitations, these formative data provide detailed examples of the design principles in the ObD schools and rich descriptions of implementation facilitators and challenges, as well as illuminating areas of similarities and differences across schools and districts with a view to providing early lessons for the field.
1
Students demonstrate deep understanding of clearly defined, rigorous competencies.
2
Students’ learning experiences are tailored to individual learning needs and interests.
3
Students have a voice in their learning and access to experiences and relationships that help them develop the skills and mindsets to succeed.
The data suggest that many aspects of implementation improved over time. Schools were implementing numerous practices consistent with the design principles, including a clearly defined mission, mastery-based and personalized learning approaches, and a positive school climate and culture. Teachers’ opinions about professional development and clarity of school mission improved from the first year of implementation to the second. The five schools that opened in fall 2016 seemed to face fewer challenges than those that opened in fall 2015 did in their first year. Teachers in the five schools that opened in fall 2016 felt more prepared to implement the ObD principles, held more-positive opinions of their schools’ data systems, and reported greater adoption of personalized and mastery-based learning practices than did teachers at schools that opened in fall 2015. It is possible these improvements were due to Springpoint supports, or because schools improved their ability to use data to identify problems and continuously improve the school model or otherwise benefited from lessons learned during the first year of implementation. In addition, school and district leaders found Springpoint’s support — such as connections to consultants, study tours, and resources designed to align with the district vision, systems, and policies to support innovation — helpful.
As noted above, the five schools that opened in fall 2016 seemed to experience fewer implementation challenges than the schools that opened in fall 2015 did in their first year. Nevertheless, staff members in all schools reported challenges related to developing high-quality curriculum, hiring qualified staff, ensuring high-quality instruction, and maintaining universally high expectations for students. In particular, the lack of curriculum materials, staffing challenges, a need to personalize across multiple student ability levels, and a lack of clarity on how mastery should be implemented made it difficult to ensure high-quality instruction. External pressure to advance students at a certain pace, wide variation in the complexity of tasks used to assess mastery, and inconsistent application of mastery-based grading systems were barriers to maintaining universally high expectations for students. Teachers also reported varying access to student data useful for informing mastery-based instruction. Although most teachers reported receiving various types of achievement data at least monthly, and using it to inform their instruction, many teachers expressed a need for more or better data.
This research was conducted by RAND Education.
This publication is part of the RAND research brief series. Research briefs present policy-oriented summaries of individual published, peer-reviewed documents or of a body of published work.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.