RAND researchers developed program logic models for three of the Department of the Air Force’s programs: the Relocation Assistance Program, Employment Assistance, and Air Force Families Forever. These programs are intended to address some of the challenges that airmen, guardians, and their families face as a part of military service: frequent relocations, spouse employment, and deaths of service members.

Evaluation Design for Department of Air Force Military and Family Readiness Programs

Considerations for Air Force Families Forever, Relocation Assistance Program, and Employment Assistance

Thomas E. Trail, Miriam Matthews, Samantha E. DiNicola, Jenna W. Kramer, Coreen Farris, Isabelle González

ResearchPublished Mar 5, 2024

Cover: Evaluation Design for Department of Air Force Military and Family Readiness Programs
Download PDF
Additional Downloads

Includes Research Summary

Military service can be rewarding but also challenging for airmen, guardians, and their families. Frequent relocations require navigating housing and movement of household goods and can lead to difficulties for spouses wanting employment. Another aspect of military service that presents difficulties for family and friends is coping with a service member's death. To help address these challenges, the Department of the Air Force (DAF) has several programs that are implemented via Military and Family Readiness Centers: the Relocation Assistance Program (RAP), Employment Assistance (EA), and Air Force Families Forever (AFFF). RAP provides education and referrals to assist airmen, guardians, and their families with issues surrounding permanent change of station (PCS) moves. EA supports service members, DoD civilian employees, and family members in achieving employment. AFFF provides long-term information and referrals to eligible next of kin of deceased airmen and guardians. DAF asked RAND Project AIR FORCE to assist with the design of evaluations for these programs.

Key Findings

  • The success of each of the programs is unclear because of limited feedback and evaluation.
  • A factor believed to reduce the effectiveness of each of the programs is limited personnel capacity, or limited staffing, for program administration.
  • A factor commonly believed to positively affect program effectiveness is active unit commander support and engagement.
  • The logic models provided in this report map the various assumptions regarding what resources the programs need to run, how they run, and what effects they have, and they provide a road map for the development of a program evaluation.
  • Potential sources of data to measure elements of the logic models include administrative data, surveys, and qualitative assessments.

Recommendations

  • Adopt and communicate the program logic models in ways that ensure that stakeholders know and understand them.
  • Continue to engage stakeholders in the evaluation design process.
  • Implement measures that align with the program logic model.
  • Present the results of evaluations in ways that are clear and useful for stakeholders.
  • Modify the program logic models, as needed, drawing from the results of evaluations.
  • If DAF considers creating or using additional databases to track measures, involve stakeholders in its development.

Topics

Document Details

Citation

RAND Style Manual
Trail, Thomas E., Miriam Matthews, Samantha E. DiNicola, Jenna W. Kramer, Coreen Farris, and Isabelle González, Evaluation Design for Department of Air Force Military and Family Readiness Programs: Considerations for Air Force Families Forever, Relocation Assistance Program, and Employment Assistance, RAND Corporation, RR-A1753-2, 2024. As of September 9, 2024: https://www.rand.org/pubs/research_reports/RRA1753-2.html
Chicago Manual of Style
Trail, Thomas E., Miriam Matthews, Samantha E. DiNicola, Jenna W. Kramer, Coreen Farris, and Isabelle González, Evaluation Design for Department of Air Force Military and Family Readiness Programs: Considerations for Air Force Families Forever, Relocation Assistance Program, and Employment Assistance. Santa Monica, CA: RAND Corporation, 2024. https://www.rand.org/pubs/research_reports/RRA1753-2.html.
BibTeX RIS

Research conducted by

This research was conducted within the Workforce, Development, and Health Program of RAND Project AIR FORCE.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.