Air Force Special Warfare operators conduct physically and mentally challenging missions. For this career field, specialized assessment and selection of future operators is required. The authors examine the programs for assessing and selecting personnel for AFSPECWAR, identify job-relevant attributes, consider how these attributes should be weighted for candidate selection, and improve the accuracy of raters' evaluations of candidates.
Assessment and Selection for U.S. Air Force Special Warfare
Vol. 1, Defining Attributes and Designing Rater Training
Download
Download eBook for Free
Full Document
| Format | File Size | Notes |
|---|---|---|
| PDF file | 2.9 MB | Use Adobe Acrobat Reader version 10 or higher for the best experience. |
Research Summary
| Format | File Size | Notes |
|---|---|---|
| PDF file | 0.1 MB | Use Adobe Acrobat Reader version 10 or higher for the best experience. |
Purchase
Purchase Print Copy
| Format | List Price | Price | |
|---|---|---|---|
| Add to Cart | Paperback94 pages | $34.00 | $27.20 20% Web Discount |
Research Questions
- What are the attributes that AFSPECWAR can use to assess and select future operators?
- Should AFSPECWAR differentially weight these attributes to reflect their relative importance to the job?
- How can raters improve the accuracy of their candidate assessments?
Air Force Special Warfare (AFSPECWAR) operators conduct some of the most physically and mentally challenging missions in the U.S. military. Operating in these career fields and job environments benefits from specialized assessment and selection.
Assessing and selecting personnel begins with identifying job-relevant attributes for AFSPECWAR. Based on several sources from civilian and military domains, the authors identify eight attributes: Communication, Drive, Integrity, Physical Fitness, Problem Solving, Stress Tolerance, Teamwork, and Trainability. They then explore the relative importance of these attributes and whether certain attributes should be weighted more heavily than others when making a final selection decision. Although this process for identifying, weighting, and evaluating the job-relevant attributes is resource-intensive and requires engagement from many subject-matter experts, the outputs are foundational for establishing effective talent management practices. Selecting candidates who are suitable for the job and the environment has the potential to improve performance, increase satisfaction and commitment, and reduce turnover.
The authors also highlight approaches for improving the accuracy of ratings and identify potential gaps in current AFSPECWAR assessment and selection practices, which can be addressed by adopting best practices for designing and implementing assessment centers. Closing these gaps will further strengthen AFSPECWAR's objective to effectively assess and select individual members of the U.S. Air Force who have the attributes needed for training and job success.
Key Findings
Eight attributes are important for assessing and selecting AFSPECWAR candidates
- The job-relevant attributes are Communication, Drive, Integrity, Physical Fitness, Problem Solving, Stress Tolerance, Teamwork, and Trainability.
- These attributes are rated as important, very important, or extremely important by officers and enlisted personnel from all AFSPECWAR specialties.
- Attributes are foundational to a talent management system.
- There are multiple approaches to measuring attributes. One approach is an assessment center, which allows multiple raters to observe candidates through simulations, structured interviews, and standardized tests.
Differentially weighting the attributes will unlikely change selection decisions
- Subject-matter experts were found to allocate different weights to the key job-relevant attributes.
- These differences were sometimes large enough to affect a change in candidates' rank order but not large enough to change the likelihood of a candidate being selected.
- Consequently, equal weight (unit weights) should be assigned to relevant attributes.
There are multiple approaches to promoting and improving rater accuracy
- A focus on the attributes and corresponding behaviors reinforces transparency, objectivity, and defensibility in the process of evaluating candidates.
- The attributes can be further differentiated by defining specific facets for each, which facilitates a shared understanding of the key distinctions between attributes.
- Raters must be trained on how to use rating scales to evaluate candidates accurately.
- Rater performance should be monitored to ensure that raters are consistently providing accurate ratings.
Table of Contents
Chapter One
Introduction
Chapter Two
A&S Framework of Guiding Principles
Chapter Three
Define AFSPECWAR Attributes
Chapter Four
Evaluate the Potential Weights for A&S Attributes
Chapter Five
Approaches to Promote Rater Accuracy
Chapter Six
Key Findings, Lessons Learned, and Next Steps
Appendix A
The Measurement Foundation of Personnel Assessment and Selection: Reliability and Validity
Appendix B
Relative Importance Attribute Survey
Appendix C
Technical Details and Statistical Analyses to Explore Differential Attribute Weights
Research conducted by
The research described in this report was sponsored by Air Force Special Operations Command (AFSOC) and conducted by the Workforce, Development, and Health Program within RAND Project AIR FORCE.
This report is part of the RAND Corporation Research report series. RAND reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.