Lessons from RAND's Work on Planning Under Uncertainty for National Security

Paul K. Davis

ResearchPublished Jul 31, 2012

A first step in dealing with uncertainty is confronting its existence, ubiquity, and magnitude. A second step is dealing with it when informing assessments and decisions. As the Cold War waned, RAND developed new methods that urged sketching the no-surprises future, listing known branch-style uncertainties, and stretching the imagination to envision potential shocks, good or bad (e.g., Soviet Union disintegration or Saddam Hussein's invasion of Kuwait). Major surprises will nonetheless occur, and some of RAND's most important work on uncertainty has to do with coping with surprise developments.

RAND's progress in national security uncertainty analysis benefited from a confluence of developments in computer and software technology, theory and practice in strategic planning and decisionmaking, analytic theory and methods, and theory of complex adaptive systems. Work has emphasized facing up to deep uncertainty in many dimensions, performing exploratory analysis of "the possibility space," identifying regions of that space that pose special risks or opportunities, finding options to improve capabilities, and using portfolio analysis to conceive and compare strategic options for economically dealing with the diversity of challenges. A cross-cutting RAND theme is finding flexible, adaptive, and robust (FAR) strategies. Ultimately, different problems call for different approaches to uncertainty.

If the theory of planning under uncertainty and preparing to cope with surprise effectively is difficult and complex, this report makes clear that implementing and maintaining corresponding changes is even more difficult and suggests that policymakers to be constantly vigilant in ensuring that related initiatives are not undercut or allowed to wither.

Key Findings

Approaches to Uncertainty: Common Themes

  • Uncertainty analysis requires creative, divergent work to understand the range of possibilities, and then more convergent work to assist decisionmakers in conceiving and choosing among strategies. In both phases, there is need for human-intensive work (e.g., brainstorming, gaming, and judgment) as well as more analytical methods, including computational discovery.
  • There is a need for both theory-driven and data-driven approaches. Competition between approaches can help stimulate progress.
  • Experimentation and iteration are often crucial for uncertainty reduction and discovery.
  • In practice, strategy will often be revisited and modified over time, despite the common assumption of once-and-for-all decisionmaking.

Implementation

  • A common concept of good analytic practice for dealing with uncertainty when in a report to a policymaker is to show key assumptions, watch for the policymaker to acknowledge the assumptions, and then present results. Even if policymakers know the assumptions and believe them to be reasonable, this approach is inadequate because it does nothing to encourage hedging.
  • Policymakers are open to uncertainty analysis — if it helps them reach decisions.
  • Any initiative for planning under uncertainty can be seen by some elements of an organization as a threat to more general norms and activities (i.e., what organization theory refers to as a "precarious value").
  • If the theory of planning under uncertainty and preparing to cope with surprise effectively is difficult and complex, implementing and maintaining corresponding changes are even more so.
  • Policymakers need to be constantly vigilant, or their initiatives may be undercut or allowed to wither.

Recommendations

  • Policymakers should demand analysis that aids in finding flexible, adaptive, and robust (FAR) strategies.
  • The appropriate standard for analysts should include being sure that omitting considerations because of uncertainty does not critically affect study conclusions; that conclusions identify reasonable ways to hedge against consequences of uncertainty, to include preparing for adaptation; and that policymakers are sensitized to the importance of such hedging.
  • Planning should anticipate the need for adaptations and identify signals that should trigger them.
  • Strategic adaptations should be built into all options.
  • When conducting portfolio analysis it is necessary to estimate how well alternative strategies attend to all of the various objectives. Scenario evaluation of strategies is traditional and useful, but the scenarios should be chosen systematically and analytically to provide a set of "stress tests" addressing the diverse objectives and risks.
  • Planning should hedge by providing general capabilities and organizational agility that allow adaptations to unanticipated developments.
  • Major surprises will nonetheless occur, so planning should also provide general capabilities and organizational agility for adapting to such unanticipated developments, both positive and negative.
  • Narrowing the analysis for the study at hand should not be based on conventional wisdom or the desire to avoid controversy.

Order a Print Copy

Format
Paperback
Page count
54 pages
List Price
$22.95
Buy link
Add to Cart

Topics

Document Details

  • Availability: Available
  • Year: 2012
  • Print Format: Paperback
  • Paperback Pages: 54
  • Paperback Price: $22.95
  • Paperback ISBN/EAN: 978-0-8330-7661-8
  • Document Number: TR-1249-OSD

Citation

RAND Style Manual
Davis, Paul K., Lessons from RAND's Work on Planning Under Uncertainty for National Security, RAND Corporation, TR-1249-OSD, 2012. As of September 23, 2024: https://www.rand.org/pubs/technical_reports/TR1249.html
Chicago Manual of Style
Davis, Paul K., Lessons from RAND's Work on Planning Under Uncertainty for National Security. Santa Monica, CA: RAND Corporation, 2012. https://www.rand.org/pubs/technical_reports/TR1249.html. Also available in print form.
BibTeX RIS

The research for this paper was conducted within the RAND National Defense Research Institute, a federally funded research and development center sponsored by the Office of the Secretary of Defense, the Joint Staff, the Unified Combatant Commands, the Navy, the Marine Corps, the defense agencies, and the defense Intelligence Community.

This publication is part of the RAND technical report series. RAND technical reports, products of RAND from 2003 to 2011, presented research findings on a topic limited in scope or intended for a narrow audience; discussions of the methodology employed in research; literature reviews, survey instruments, modeling exercises, guidelines for practitioners and research professionals, and supporting documentation; and preliminary findings. All RAND technical reports were subject to rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.