A Delicate Balance
Portfolio Analysis and Management for Intelligence Information Dissemination Programs
ResearchPublished Dec 15, 2009
Portfolio Analysis and Management for Intelligence Information Dissemination Programs
ResearchPublished Dec 15, 2009
This description of the application of the RAND Corporation's PortMan portfolio analysis and management method for the National Security Agency (NSA) Information Sharing Services (ISS) division demonstrates how PortMan (1) enables the data-driven analysis of project portfolios and (2) provides a means for monitoring the progress of potentially high-value projects and associated risk-mitigation strategies.
RAND developed two sets of metrics to help ISS estimate the expected value of the projects in its portfolio, one for research and development (R&D) projects and one for operations and maintenance (O&M) projects. Metrics were based on elicitations of the important components of value and risk from ISS staff and an analysis of documents provided by ISS management. RAND also conducted a Delphi consensus-building exercise with subject matter experts from ISS's Senior Leadership Group (SLG) to estimate both the value and the probability of successful implementation of each project. PortMan allows for the inclusion of value, risk, and cost in the portfolio analysis, and RAND used a linear programming model to select a portfolio of projects that delivers the maximum portfolio expected value for the available budget.
This analysis generated reproducible and auditable data to support programmatic decisionmaking within ISS; it also provided a venue in which ISS leadership could identify areas of consensus and non-consensus and debate the latter. Finally, it provided data and analysis of expected value versus program budget and expected value-to-cost ratios of individual projects that can be used by program managers and directors in discussions with supervisors and senior management.
The research described in this report was prepared for the National Security Agency. The research was conducted in the RAND National Defense Research Institute, a federally funded research and development center sponsored by the Office of the Secretary of Defense, the Joint Staff, the Unified Combatant Commands, the Department of the Navy, the Marine Corps, the defense agencies, and the defense Intelligence Community.
This publication is part of the RAND monograph series. RAND monographs were products of RAND from 2003 to 2011 that presented major research findings that addressed the challenges facing the public and private sectors. All RAND monographs were subjected to rigorous peer review to ensure high standards for research quality and objectivity.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.