- What research and development is needed to create high-quality measures of students' interpersonal and intrapersonal competencies?
- Which competencies should be addressed first?
- Which research and development goals should receive priority for the identified competencies?
- How long will the research and development process take, and how much money needs to be committed to support the efforts?
- How should the measurement-development process be managed?
Efforts to prepare students for college, careers, and civic engagement have traditionally emphasized academic skills, but a growing body of research suggests that interpersonal and intrapersonal competencies, such as communication and resilience, are important predictors of postsecondary success and citizenship. One of the major challenges in designing educational interventions to support these outcomes is a lack of high-quality measures that could help educators, students, parents, and others understand how students perform and monitor their development over time. This report provides guidelines to promote thoughtful development of practical, high-quality measures of interpersonal and intrapersonal competencies that practitioners and policymakers can use to improve valued outcomes for students.
A Few Guidelines Can Keep Research and Development Directed Appropriately
- Five broad tasks must be accomplished to develop and implement appropriate measures of interpersonal and intrapersonal competencies: defining and selecting constructs, identifying the intended uses of the measure, developing measures, evaluating the technical quality of measures, and documenting consequences of assessment use.
- To determine which competencies to address first, start by examining research to understand what measures currently exist across the domains of interest; how good they are from a technical, as well as a practical, perspective; and how difficult it is likely to be to develop new ones.
- Four kinds of development activities are likely to be needed: (1) conduct basic research to understand the nature of the psychological processes or behavioral manifestations that underlie a construct, (2) develop new measures for a construct that is well understood, (3) assess or improve the quality of an existing measure of a construct, or (4) investigate the consequences of using a measure in the school context.
- Create a pair of independent research coordinating boards to guide the measurement development process — one for interpersonal competencies and the other for intrapersonal competencies.
- Each board would create a research and development agenda, receive funding from contributing foundations and agencies, disburse it to developers, monitor the process incrementally, and make midcourse adjustments based on successes. The boards would not be responsible for doing the assessment development or validation work; this would be contracted to others.
- The boards should have a multiple-year mandate to reflect that fact that the process of development and validation is likely to take multiple years.
- The boards should be composed of members from key stakeholder groups, including researchers, policymakers, practitioners and funder, and they should represent key academic disciplines, including education, psychology, and psychometrics.
Table of Contents
Rationale for Developing New Measures
Research and Development Guidelines
Promoting High-Quality Measures: Recommendations and Challenges
Summary of the White House Workshop on Hard-to-Measure 21st-Century Skills
Experts Who Participated in Meetings and Interviews