Measuring Cooperative Biological Engagement Program (CBEP) Performance

Capacities, Capabilities, and Sustainability Enablers for Biorisk Management and Biosurveillance

by Stephanie Young, Henry H. Willis, Melinda Moore, Jeffrey Engstrom

Download

Download eBook for Free

FormatFile SizeNotes
PDF file 0.9 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

Purchase

Purchase Print Copy

 FormatList Price Price
Add to Cart Paperback166 pages $37.50 $30.00 20% Web Discount

Research Questions

  1. What should the Cooperative Biological Engagement Program (CBEP) measure to evaluate program performance?
  2. How should CBEP systematically identify metrics?
  3. What metrics do we recommend for CBEP?

The Cooperative Biological Engagement Program (CBEP) is the biological threat component of the Cooperative Threat Reduction program. It grew out of efforts to address risks associated with legacy biological agents, related materials, and technical expertise developed as part of the biological weapon program in the former Soviet Union. CBEP now partners with about 20 countries in different regions around the world and works with them to address diverse threats to international security, including terrorist organizations seeking to acquire pathogens of security concern; human, animal, and agricultural facilities operating with inadequate safety and security safeguards; and the spread of diseases with potential security or economic consequences. As the program has evolved since its inception two decades ago, so too have its content and approaches to performance measurement. The objective of the research reported here was to build on existing work to develop a comprehensive evaluation framework and recommend metrics for assessing and communicating progress toward CBEP's goals. The report ultimately recommends a number of qualitative and quantitative indicators of CBEP performance, some that can be implemented immediately, some to be implemented later.

Key Findings

To Inform Metric Selection, the Cooperative Biological Engagement Program (CBEP) Needs to

  • Strengthen enduring partner capabilities for biorisk management
  • Strengthen enduring partner capabilities for biosurveillance.

These Objectives Can Be Placed into a Conceptual Framework Built on Logical Models

  • Logic models establish the sequence from program inputs to activities, outputs, outcomes, and impacts.
  • Separate logic models were developed for biosafety, biosecurity, and biosurveillance, each addressing capacities, capabilities, and sustainability enablers.

This Framework Can Be Used to Identify a Candidate Measures

  • Using these models, an initial list of some 300 metrics was identified from the literature. This list was scored and winnowed down into those metrics that scored most strongly in multiple dimensions.
  • Two final lists of recommended metrics emerged, one for use now, one for later introduction.

Recommendations

  • CBEP should take steps to refine and implement the metrics framework to support internal evaluations and external reporting on program impacts. To refine the framework by identifying implementation challenges and mitigation strategies, conduct pilot tests of the recommended metrics in a small set of CBEP partner countries. This approach would allow CBEP to identify challenges and opportunities for refinement in advance of widespread implementation.
  • CBEP should also consider moving evaluation efforts forward by focusing on assessing program outcomes in areas key to ultimate program success. Evaluations of lessons learned and best practices would position CBEP to support effectiveness by improving alignment of program activities with program objectives.

Table of Contents

  • Chapter One

    Introduction and Background

  • Chapter Two

    Using a Conceptual Framework to Identify Metrics for CBEP

  • Chapter Three

    Conceptual Model and Recommended Metrics for Biorisk Management

  • Chapter Four

    Conceptual Model and Recommended Metrics for Biosurveillance

  • Chapter Five

    Implementing the Recommended Metrics Framework

  • Chapter Six

    Aggregating Proposed Metrics to Report on CBEP Performance to Support Decisionmaking at Several Levels

  • Chapter Seven

    Conclusions and Next Steps

  • Appendix A

    Implementation Information for Proposed Metrics — Aligned to Logic Model Framework

  • Appendix B

    Implementation Information for Proposed Metrics — Aligned to Functional Framework

This research was sponsored by the Cooperative Biological Engagement Program in the Defense Threat Reduction Agency's Cooperative Threat Reduction Program, and conducted within the Acquisition and Technology Policy Center of the RAND National Defense Research Institute, a federally funded research and development center sponsored by the Office of the Secretary of Defense, the Joint Staff, the Unified Combatant Commands, the Navy, the Marine Corps, the defense agencies, and the defense Intelligence Community.

This report is part of the RAND Corporation research report series. RAND reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

Permission is given to duplicate this electronic document for personal use only, as long as it is unaltered and complete. Copies may not be duplicated for commercial purposes. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. For information on reprint and linking permissions, please visit the RAND Permissions page.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.