Readiness is integral to national security, and key to its management is the ability to measure it. The U.S. military reports monthly on overall readiness, and the authors' goal is to use artificial intelligence (AI) to improve the detail and accuracy of the U.S. military's readiness reports. This report will be of interest to people who seek to use AI and its enabling technologies to support the mission of national defense.
- How accurate and effective are the U.S. military's monthly readiness assessments?
- Which aspects of AI are useful in assessing military readiness?
- How can AI be tailored to improve military readiness assessments, and how can it assist senior leaders in refining the information they provide so as to align their narratives with reported readiness levels?
Military readiness is a perennial priority for the United States and a cornerstone of national security. Key to managing and improving readiness is the ability to measure it. This gives leaders situational awareness and tools for exploring trade-offs with other priorities, such as modernization, force structure, and use of national resources. There are likely many ways in which artificial intelligence (AI) can improve measurement and management of military readiness. In this report, the authors discuss work that advances the capability of computers to "understand" human language describing factors that promote or impede readiness.
The U.S. military reports monthly on overall readiness. These quantified reports are accompanied by narratives explaining what is occurring in military units that is affecting current or future readiness. The authors' goal in this report is to use these assessments to calculate overall readiness and enable senior leaders to estimate how readiness could be affected by personnel, equipment, or training factors. An additional benefit would be to have automated, real-time interaction with unit commanders as they write their assessments to help them refine the information they provide and better align their narratives with reported readiness levels.
- The research team built models, based on a deep neural network architecture, that predict the readiness level of military units and organizations. The models did well at interpreting natural language descriptions of personnel, equipment, and training factors, as well as other extenuating information, in terms of readiness implications. The best model was able to correctly calculate which of four readiness levels a unit would report 75 percent of the time.
- Such a model could provide real-time feedback to unit commanders as they submit their monthly readiness reports to improve the accuracy and detail of those reports.
- General-purpose public domain word embeddings are good on many natural language processing (NLP) tasks, but such embeddings do not work as well in a domain, such as national defense, that has a specialized vocabulary and semantic context.
- On intermediate, task-specific word relatedness and analogy tests, defense-specific embeddings appear to significantly outperform public domain embeddings and would likely be useful in downstream NLP models dealing with defense-related matters.
- Multilayer neural networks as a whole performed much better than the single-layer logistic regression model used as a baseline; once a single recurrent layer was added, model performance further improved, but additional recurrent layers made little or no difference.
Table of Contents
Interpreting Military Unit Readiness Through Machine Learning
Defense-Specific Word Embeddings
A Deep Neural Network to Estimate Readiness
Next Steps and Applications
Word Embedding Primer