Navy analysts are struggling to keep pace with the growing flood of data collected by intelligence, surveillance, and reconnaissance sensors. This challenge is sure to intensify as the Navy continues to field new and additional sensors. The authors explore options for solving the Navy's "big data" challenge, considering changes across four dimensions: people, tools and technology, data and data architectures, and demand and demand management.

Data Flood

Helping the Navy Address the Rising Tide of Sensor Information

Isaac R. Porche III, Bradley Wilson, Erin-Elizabeth Johnson, Shane Tierney, Evan Saltzman

ResearchPublished May 1, 2014

In the U.S. Navy, there is a growing demand for intelligence, surveillance, and reconnaissance (ISR) data, which help Navy commanders obtain situational awareness and help Navy vessels perform a host of mission-critical tasks. The amount of data generated by ISR sensors has, however, become overwhelming, and Navy analysts are struggling to keep pace with this data flood. Their challenges include extremely slow download times, workstations cluttered with applications, and stovepiped databases and networks — challenges that are only going to intensify as the Navy fields new and additional sensors in the coming years. Indeed, if the Navy does not change the way it collects, processes, exploits, and disseminates information, it will reach an ISR "tipping point" — the point at which its analysts are no longer able to complete a minimum number of exploitation tasks within given time constraints — as soon as 2016.

The authors explore options for solving the Navy's "big data" challenge, considering changes across four dimensions: people, tools and technology, data and data architectures, and demand and demand management. They recommend that the Navy pursue a cloud solution — a strategy similar to those adopted by Google, the Intelligence Community, and other large organizations grappling with big data's challenges and opportunities.

Key Findings

The Navy Faces Barriers to Making Sense of the Intelligence, Surveillance, and Reconnaissance Data Being Collected

  • Challenges to the timely consumption of data include slow download times, shared communications pipelines, and large chunks of untagged raw data.
  • Challenges to the accurate integration of data include stovepiped databases and networks, and cluttered analyst workstations.

Dynamically Managing Analyst Workloads May Improve Analyst Productivity, but Only to a Certain Extent

  • Today's tasking arrangements are, in the main, fixed and geographically based. Intelligence specialists in one location can become quickly overwhelmed with tasks.
  • Tasking models in which tasks are automatically shared based on who is available to accept new tasking outperform today's model in terms of analyst productivity, but only in the short term.

A Solution to the Navy's "Big Data" Challenge Must Involve Changes Across Four Dimensions: People, Tools and Technology, Data and Data Architectures, and Demand and Demand Management

  • One potential solution involves adding more applications to analyst workstations, with the goal of helping analysts take advantage of the increased variety of data afforded by the proliferation of data types and databases.
  • A second potential solution involves the physical consolidation of applications and their corresponding data and databases, with the goal of enabling a high level of interoperability.
  • A third potential solution involves the virtual consolidation of databases, applications, widgets, services, and other elements into a cloud architecture, with the goal of limiting the transmission of raw data and of implementing a data strategy that includes the use of metadata.

Recommendation

  • The Navy should pursue the third solution — a cloud strategy similar to those adopted by Google, the Intelligence Community, and other large organizations grappling with big data's challenges and opportunities. Specifically, the Navy should adopt the Intelligence Community's cloud approach, designing its next generation of intelligence, surveillance, and reconnaissance tools and systems to work with the National Security Agency's distributed cloud concept.

Order a Print Copy

Format
Paperback
Page count
84 pages
List Price
$29.95
Buy link
Add to Cart

Topics

Document Details

  • Copyright: RAND Corporation
  • Availability: Available
  • Year: 2014
  • Print Format: Paperback
  • Paperback Pages: 84
  • Paperback Price: $29.95
  • Paperback ISBN/EAN: 978-0-8330-8429-3
  • DOI: https://doi.org/10.7249/RR315
  • Document Number: RR-315-NAVY

Citation

RAND Style Manual
Porche, Isaac R. III, Bradley Wilson, Erin-Elizabeth Johnson, Shane Tierney, and Evan Saltzman, Data Flood: Helping the Navy Address the Rising Tide of Sensor Information, RAND Corporation, RR-315-NAVY, 2014. As of September 16, 2024: https://www.rand.org/pubs/research_reports/RR315.html
Chicago Manual of Style
Porche, Isaac R. III, Bradley Wilson, Erin-Elizabeth Johnson, Shane Tierney, and Evan Saltzman, Data Flood: Helping the Navy Address the Rising Tide of Sensor Information. Santa Monica, CA: RAND Corporation, 2014. https://www.rand.org/pubs/research_reports/RR315.html. Also available in print form.
BibTeX RIS

Research conducted by

This research was sponsored by the Department of the Navy and conducted within the Acquisition and Technology Policy Center of the RAND National Defense Research Institute, a federally funded research and development center sponsored by the Office of the Secretary of Defense, the Joint Staff, the Unified Combatant Commands, the Navy, the Marine Corps, the defense agencies, and the defense Intelligence Community.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.