Artificial Intelligence and Machine Learning for Space Domain Awareness

The Development of Two Artificial Intelligence Case Studies

Jonathan Tran, Prateek Puri, Jordan Logue, Anthony Jacques, Li Ang Zhang, Krista Langeland, George Nacouzi, Gary J. Briggs

ResearchPublished Sep 30, 2024

To address the growing demands of operating in the space domain, the U.S. Space Force and space domain awareness (SDA) operators must determine how to prioritize sensor observations more effectively, scale up to meet the sheer volume of resident space objects, and develop analytic capabilities that reflect the complexity of orbital mechanics and space operations, all while maintaining the responsiveness necessitated by operations in a warfighting domain. Although artificial intelligence and machine learning (AI/ML) tools have the potential to help meet these SDA challenges, the impact of these tools on the overall success of the SDA mission is not well understood, and this lack of understanding is a barrier to plan for and optimize the integration of these tools.

This report documents technical approaches to demonstrating the feasibility of AI/ML when applied to the U.S. Space Force and the space domain awareness mission. The ability to estimate the current and future states and uncertainties of a resident space object using mathematical and numerical techniques is fundamental for current SDA processes. The authors tested AI/ML algorithms, particularly Bayesian neural networks, to determine their suitability for these tasks. The research presented in this report focuses on the highly resource-intensive conjunction assessment mission under the broader SDA mission set. The two case studies focus on prediction and classification capabilities of neural networks and the use of these capabilities to improve the conjunction assessment. The authors found that Bayesian neural networks offer suitable performance trade-offs on metrics most likely to be relevant to risk-based SDA decisionmaking when compared with traditional processes and greater performance on metrics when compared with standard neural networks.

Key Findings

  • Neural networks are capable approximators for complex nonlinear functions. Prediction and classification capabilities can be applied to SDA mission processes with standard and Bayesian neural networks.
  • AI/ML tool developers should focus on tools that are compatible with the operational SDA architecture, data infrastructure, and processes.
  • Quantification of risk and uncertainty tolerance provides an operator or analyst with the capability to provide feedback to an AI/ML model by setting thresholds based on acceptable risk.
  • Quantification of risk and uncertainty tolerance can support improved performance of AI/ML tools focused on prediction and classification when compared with standard neural network approaches.
  • Active learning may be an attractive AI/ML feature when paired with SDA mission processes.

Recommendations

  • The development of AI/ML tools requires significant investment in ensuring high-quality training data. The Office of the Chief Scientist of the U.S. Air Force, with input from SDA operators, should consider the availability of such data for AI/ML investment.
  • AI/ML tool developers should consider SDA processes and limitations that have implications for tool design, including the selection of algorithms, metrics of performance, and benchmark requirements.
  • The U.S. Department of Defense should continue to consider the value of uncertainty quantification methodologies when developing and deploying operational AI/ML tools. SDA operators should be trained to use the uncertainty quantification provided by these methodologies.

Order a Print Copy

Format
Paperback
Page count
72 pages
List Price
$36.00
Buy link
Add to Cart

Topics

Document Details

  • Availability: Available
  • Year: 2024
  • Print Format: Paperback
  • Paperback Pages: 72
  • Paperback Price: $36.00
  • Paperback ISBN/EAN: 1-9774-1414-1
  • DOI: https://doi.org/10.7249/RRA2318-2
  • Document Number: RR-A2318-2

Citation

RAND Style Manual
Tran, Jonathan, Prateek Puri, Jordan Logue, Anthony Jacques, Li Ang Zhang, Krista Langeland, George Nacouzi, and Gary J. Briggs, Artificial Intelligence and Machine Learning for Space Domain Awareness: The Development of Two Artificial Intelligence Case Studies, RAND Corporation, RR-A2318-2, 2024. As of October 10, 2024: https://www.rand.org/pubs/research_reports/RRA2318-2.html
Chicago Manual of Style
Tran, Jonathan, Prateek Puri, Jordan Logue, Anthony Jacques, Li Ang Zhang, Krista Langeland, George Nacouzi, and Gary J. Briggs, Artificial Intelligence and Machine Learning for Space Domain Awareness: The Development of Two Artificial Intelligence Case Studies. Santa Monica, CA: RAND Corporation, 2024. https://www.rand.org/pubs/research_reports/RRA2318-2.html. Also available in print form.
BibTeX RIS

Research conducted by

This research was prepared for the Department of the Air Force and conducted within the Force Modernization and Employment Program of RAND Project AIR FORCE.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.