Technology-enabled collaborative learning and capacity-building models connect generalist providers, often located in remote areas, with specialist teams that help train these providers so that they can deliver care for conditions that generalists might not otherwise feel adequately prepared to handle. This report focuses on the quality of evidence for the effectiveness of such models and describes ways to improve measurement of effectiveness.

Evaluation of Technology-Enabled Collaborative Learning and Capacity Building Models

Materials for a Report to Congress

Shira H. Fischer, Adam J. Rose, Ryan K. McBain, Laura J. Faherty, Jessica L. Sousa, Monique Martineau

ResearchPublished Mar 6, 2019

Cover: Evaluation of Technology-Enabled Collaborative Learning and Capacity Building Models
Download PDF

Does not include Appendix F.

Additional Downloads

Includes Appendix F

Across the United States and internationally, multiple health care sites have embraced technology-enabled collaborative learning and capacity-building models. Such models use technology to connect generalist providers, often located in remote areas, with specialist teams that help train these providers to deliver care for patients with conditions that they might not feel adequately prepared to handle but are nevertheless within their scope of practice. The first implementation of this model, Project ECHO (Extension for Community Healthcare Outcomes), launched in 2003 in New Mexico. Project ECHO began with a focus on supporting the management of patients with hepatitis C virus (HCV) in rural regions of the state. This model has since been adapted to many different sites within the United States and other countries, and these models now address a wide range of medical conditions and other issues that providers face. This report documents what is known about ECHO and ECHO-like models (EELM). Generally speaking, the quality of evidence for the effectiveness of EELM could use improvement, but EELM mostly show positive effects in the small but growing body of research of EELM, which thus far measures more provider outcomes than patient outcomes.

Key Findings

Empirical evidence for the effects of ECHO and ECHO-like models (EELM) on patient and provider outcomes remains modest

  • Based on a literature review and a technical expert panel, the quality of evidence for the effectiveness of EELM is rated as "low" or "very low" based on generally accepted systems of measurement. However, it is important to note that many models of care delivery are supported only by low-quality evidence.
  • In the areas that researchers have measured, EELM mostly show positive effects.
  • The intention of EELM is to increase access to specialty care by educating generalist health providers, particularly those in locales with limited access such as rural and remote areas. However, there is a need for targeted funding to evaluate EELM effectively.

Recommendations

  • Implementers and evaluators can engage with policymakers, funders, and others to explore mechanisms for supporting rigorous evaluation. Such mechanisms would ideally address care delivery imperatives in the near term and enable rigorous evaluations that would expand the evidence base to support longer-term investments in EELM.
  • An expanded focus on rigorous reporting of program characteristics of EELM would help evaluators assess how the model is put into practice and what "ingredients" might lead to better outcomes and are worth replicating.
  • Building capacity to evaluate EELM is a third critical opportunity and is two-pronged. Building such capacity could help implementers design EELM to facilitate improved evaluations, and it could help researchers more effectively choose populations for study, outcomes, comparators, and study designs.
  • Implementers and evaluators can engage with policymakers, funders, and others to explore mutually beneficial mechanisms for supporting rigorous evaluation. Such mechanisms would ideally address care delivery imperatives in the near term and enable rigorous evaluations that would expand the evidence base to support longer-term investments in EELM.

Topics

Document Details

Citation

RAND Style Manual
Fischer, Shira H., Adam J. Rose, Ryan K. McBain, Laura J. Faherty, Jessica L. Sousa, and Monique Martineau, Evaluation of Technology-Enabled Collaborative Learning and Capacity Building Models: Materials for a Report to Congress, RAND Corporation, RR-2934-ASPEC, 2019. As of September 17, 2024: https://www.rand.org/pubs/research_reports/RR2934.html
Chicago Manual of Style
Fischer, Shira H., Adam J. Rose, Ryan K. McBain, Laura J. Faherty, Jessica L. Sousa, and Monique Martineau, Evaluation of Technology-Enabled Collaborative Learning and Capacity Building Models: Materials for a Report to Congress. Santa Monica, CA: RAND Corporation, 2019. https://www.rand.org/pubs/research_reports/RR2934.html.
BibTeX RIS

Research conducted by

This research was funded by the Office of the Assistant Secretary for Planning and Evaluation (ASPE) and conducted by Payment, Cost, and Coverage program within RAND Health Care.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.