The National Guard Youth ChalleNGe program is a residential, quasi-military program for youth ages 16 to 18 who are experiencing difficulties in traditional high school. This capstone report describes some of RAND's research and analyses on the ChalleNGe program from late 2017 through mid-2020. The authors focus on identifying and recommending strategies for programs to measure participants' long-term outcomes.

Developing Outcome Measures for the National Guard Youth ChalleNGe Program

Jennie W. Wenger, Stephani L. Wrabel, Thomas E. Trail, Louay Constant, Wing Yi Chan, Kathryn A. Edwards, Joy S. Moini, Hanna Han

ResearchPublished Mar 2, 2022

The National Guard Youth ChalleNGe program is a residential, quasi-military program for youth ages 16 to 18 who are experiencing difficulties in traditional high school. The program provides classroom instruction and other structured activities to young people at 40 different sites. This capstone report describes some of RAND's research and analyses on the ChalleNGe program from late 2017 through mid-2020.

Using a mixed-methods approach, the RAND team developed a program logic model, carried out a series of site visits, and planned and executed numerous analytic efforts. Many of the results of specific analytic efforts are described in other reports; here, the authors focus on identifying and recommending strategies for programs to measure participants' long-term outcomes. Consistently measuring long-term outcomes will allow the program to determine overall progress toward meeting its mission of ensuring that program participants are prepared for success as productive citizens.

Key Findings

ChalleNGe sites collect considerable data, but postgraduation placement data are lacking

  • ChalleNGe sites have detailed information on the number of applicants, entrants, and graduates, as well as on other relevant outcomes, such as the amount of community service performed and standardized test scores.
  • Sites gather placement data through mentors, and such data generally include no more than 12 months of minimal information; sites frequently express concern that mentor reporting drops off sharply after graduation. Sites may not be able to document industry or occupation, existence of benefits, or even total earnings.
  • The data collected by ChalleNGe sites provide useful information and meet reporting requirements, but this information is not sufficient to determine how well the program is meeting its stated mission of creating long-term change and helping young people go on to become productive citizens.

ChalleNGe does not keep a single, authoritative administrative database

  • Many of the sites use a similar database, the Cadet Tracker.
  • RAND researchers have collected consistent data from individual sites for the past four years, and the National Guard Bureau also collects data periodically.
  • Some sites have tested other methods of data collection; these include developing a customized database, surveying graduates, and focusing additional resources on tracking graduate placement.

Recommendations

  • Each site should select the data collection strategy or strategies most appropriate to the site context.
  • All sites should discuss the importance of data collection with cadets and parents.
  • Site and program staff should budget for data collection.
  • All sites should collect, at a minimum, data on graduates' educational attainment, labor force experience, and progress on other core components.
  • Sites should collect data for three years postgraduation.
  • The ChalleNGe program should invest in a single, consistent administrative database.

Order a Print Copy

Format
Paperback
Page count
116 pages
List Price
$23.00
Buy link
Add to Cart

Topics

Document Details

  • Copyright: RAND Corporation
  • Availability: Available
  • Year: 2022
  • Print Format: Paperback
  • Paperback Pages: 116
  • Paperback Price: $23.00
  • Paperback ISBN/EAN: 978-1-9774-0783-2
  • DOI: https://doi.org/10.7249/RRA271-5
  • Document Number: RR-A271-5

Citation

RAND Style Manual
Wenger, Jennie W., Stephani L. Wrabel, Thomas E. Trail, Louay Constant, Wing Yi Chan, Kathryn A. Edwards, Joy S. Moini, and Hanna Han, Developing Outcome Measures for the National Guard Youth ChalleNGe Program, RAND Corporation, RR-A271-5, 2022. As of September 11, 2024: https://www.rand.org/pubs/research_reports/RRA271-5.html
Chicago Manual of Style
Wenger, Jennie W., Stephani L. Wrabel, Thomas E. Trail, Louay Constant, Wing Yi Chan, Kathryn A. Edwards, Joy S. Moini, and Hanna Han, Developing Outcome Measures for the National Guard Youth ChalleNGe Program. Santa Monica, CA: RAND Corporation, 2022. https://www.rand.org/pubs/research_reports/RRA271-5.html. Also available in print form.
BibTeX RIS

Research conducted by

This research was sponsored by the Office of the Assistant Secretary of Defense for Manpower and Reserve Affairs and conducted within the Forces and Resources Policy Center of the RAND National Security Research Division (NSRD).

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.