RAND Corporation researchers developed an approach for analyzing social media data to derive insights about chemical incidents and conducted a proof of concept of that approach by applying it to the case of chemical weapons use in Syria (2017–2018). The procedure, a four-step process, showed promise. They recommend that the Defense Threat Reduction Agency initiate three activities to further the development of the procedure.
Using Social Media to Extract Information About Chemical Weapons Incidents
A Methodology and Demonstration of Concept from the Civil War in Syria
Download
Download eBook for Free
Format | File Size | Notes |
---|---|---|
PDF file | 1 MB | Use Adobe Acrobat Reader version 10 or higher for the best experience. |
Purchase
Purchase Print Copy
Format | List Price | Price | |
---|---|---|---|
Add to Cart | Paperback108 pages | $22.00 | $17.60 20% Web Discount |
Research Questions
- When a chemical event happens, what information about it tends to appear in social media, and what forms does that information typically take?
- How can a computational approach enable rapid detection of chemical weapons incidents buried among millions of social media posts?
- How can a blended computer-human approach improve on a fully automated approach?
- What do leaders need to know to implement a social media analysis capability?
Policymakers across the federal government have begun to recognize the potential of social media as a source of information and have commissioned studies to explore how social media can improve disaster situational awareness, influence public opinion, augment traditional data sources, and counter disinformation. In this project, RAND Corporation researchers developed an approach for analyzing social media data to derive insights about chemical incidents and conducted a proof of concept of that approach by applying it to the case of chemical weapons employment in Syria between 2017 and 2018.
They identified a four-step process: (1) Identify operationally relevant factors and examine known events to find incident indicators, (2) develop a feed of social media data, (3) conduct automated daily scans for elevated keyword use in Twitter data, and (4) analyze posts to verify detection and extract information.
The procedure showed promise. Based on the analysis, it is recommended that the Defense Threat Reduction Agency initiate three activities to further the development of this procedure.
Key Findings
Twitter, Facebook, and YouTube post text may include chemical attack descriptor keywords, place names, and broad characterizations of the agent used
- It may also include reactive language, such as expressions of anger, lamentation, or religious invocation.
- Images, videos, and links may provide more incident detail, as well as ways to verify authenticity.
Scanning a Twitter sample for chemical incident–descriptor keyword and reactive-language surges can provide analysts with a low-latency alert that an event may have happened
- This can direct them toward posts they can use to adjudicate whether it has happened.
- The researchers scanned Twitter during our research for this report, but choosing which platform to scan is a complex decision with many considerations.
Human intelligence may be better able to cope with the irregularity of social media data and better poised to use sophisticated inference and verification techniques to investigate incidents
- If computation can filter data volume down to something manageable, the human intelligence component can generate deeper insights from it.
The information value of social media methods varies from place to place, depending on characteristics of the population, relevant state actors, social media platforms, and analyst capabilities
- Implementing this method also requires supporting proportional staffing levels and taking steps to protect staff from posttraumatic stress.
Recommendations
- Develop resource pooling agreements with other federal agencies.
- Build an extensive chemical weapons keyword list and rigorously test the list's detection effectiveness against best available intelligence.
- Conduct an exercise with federal computers and staff, scanning for easily verified types of events.
Table of Contents
Chapter One
Introduction
Chapter Two
Social Media Analysis of Chemical Weapons Incidents in Syria
Chapter Three
Implementation Considerations
Chapter Four
Conclusions and Policy Implications
Appendix A
Additional Technical Tables
Appendix B
Quality of the Social Media Environment
Appendix C
Estimating Analyst Level of Effort Requirements
Appendix D
Protecting Analysts from Secondary Trauma
Appendix E
Social Media Event-Detection Literature Review
Research conducted by
This research was sponsored by the Defense Threat Reduction Agency (DTRA) and conducted within the International Security and Defense Policy Center of the RAND National Security Research Division (NSRD).
This report is part of the RAND Corporation Research report series. RAND reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.