Benchmarking Data Use and Analytics in Large, Complex Private-Sector Organizations

Implications for Department of Defense Acquisition

Jeffrey A. Drezner, Jon Schmid, Justin Grana, Megan McKernan, Mark Ashby

ResearchPublished Jun 4, 2020

Public and private organizations are increasingly aware of the potential value of data and analytics to improving organizational performance and outcomes. The U.S. Department of Defense (DoD) is one of those organizations. Its size, complexity, security needs, and culture have created a challenging environment for successful use of data in decisionmaking. DoD's acquisition data lay an important part of the foundation for decisions about weapon systems. Because the private sector faces similar data challenges, the authors examined commercial data practices that might translate to the DoD acquisition community in the areas of data governance and analytics. Benchmarking select private-sector data governance and analytics practices helps establish a baseline against which DoD practices can be compared. That comparison can be used to identify areas in which DoD could improve and suggests actions or approaches to make those improvements. The authors determined that functions associated with the office of a chief data officer and associated data governance and data management are foundational requirements to pursue an analytics strategy in any organization.

Key Findings

  • There is a broad consensus on data governance and analytics guiding principles (i.e., lessons in creating a data-focused organization).
  • Data governance and strategy are critical enablers of analytics capability. Emphasis should be on how analytics contributes to an organization's strategic goals.
  • Organizational design should be federated: a strong central chief data officer with core governance and analytics function and distributed analytics capabilities within business units.
  • Resource requirements for analytics vary widely and are driven by strategic objectives and tailored to where an organization starts (i.e., existing data analytics capabilities).
  • Approach implementation using change management strategies. Becoming a data-driven organization was viewed as a transformative change in business processes.
  • Data and analytics maturity models reflect commercial benchmarks and provide a road map for improving analytics capabilities.

Recommendations

  • Because data governance and strategy are critical enablers of analytics capability, the Principal Deputy Assistant Secretary of Defense, Acquisition Enablers (PDASD[AE]) should create and maintain a data governance and analytics strategy for acquisition.
  • PDASD(AE) should use its position to expand its role in data governance, management, and analytics specific to acquisition to further improve the federated organizational design. This could include expanding the existing Acquisition Visibility Steering Group and Working Group to include analytics.
  • DoD leadership needs to see that resources are being spent efficiently. Demonstrating value quickly through the use of analytics activities to help solve or bring clarity to a pressing issue for the organization is one way to justify use of resources for analytics.
  • Further maturing the data analytics capability within the DoD acquisition community would be transformative and may require changes or impacts in decisionmaking processes, business processes, organizational structure, and organizational culture.
  • The acquisition community within the Office of the Under Secretary of Defense for Acquisition and Sustainment should continue to build on and leverage existing infrastructure, the common data framework for program information, and existing analytics capability.

Topics

Document Details

Citation

RAND Style Manual
Drezner, Jeffrey A., Jon Schmid, Justin Grana, Megan McKernan, and Mark Ashby, Benchmarking Data Use and Analytics in Large, Complex Private-Sector Organizations: Implications for Department of Defense Acquisition, RAND Corporation, RR-A225-1, 2020. As of September 23, 2024: https://www.rand.org/pubs/research_reports/RRA225-1.html
Chicago Manual of Style
Drezner, Jeffrey A., Jon Schmid, Justin Grana, Megan McKernan, and Mark Ashby, Benchmarking Data Use and Analytics in Large, Complex Private-Sector Organizations: Implications for Department of Defense Acquisition. Santa Monica, CA: RAND Corporation, 2020. https://www.rand.org/pubs/research_reports/RRA225-1.html.
BibTeX RIS

This research was sponsored by the Office of the Under Secretary of Defense for Acquisition and Sustainment, Acquisition Enablers, and conducted by the Acquisition and Technology Policy Center within the RAND National Defense Research Institute.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.