Virtual Behavioral Health for Army Soldiers: Soldier Perspectives and Patterns of Treatment

Kimberly A. Hepner, Joshua Breslau, Jessica L. Sousa, Carol P. Roth, Teague Ruder, Isabelle González, Cheryl K. Montemayor, Beth Ann Griffin

RAND Health Quarterly, 2023; 11(1):5

RAND Health Quarterly is an online-only journal dedicated to showcasing the breadth of health research and policy analysis conducted RAND-wide.

More in this issue

Abstract

Delivery of high-quality behavioral health (BH) care is essential to supporting the readiness of the U.S. armed forces and their families. The coronavirus disease 2019 (COVID-19) pandemic led to a dramatic expansion of virtual behavioral health (VBH) care: remote patient access to BH care using technology such as a computer or cellular phone. The U.S. Army asked RAND Arroyo Center to examine the use of VBH to inform recommendations on the role of VBH care in the future of BH care in the Military Health System. The authors analyzed administrative data on VBH and in-person BH care from prior to the pandemic through March 2022 and surveyed soldiers who received BH care to assess their perceptions of VBH care. Administrative data analyses showed that direct care providers were less likely to deliver VBH care than private-sector providers and relied heavily on audio rather than video VBH. In addition, soldiers who received VBH care typically received a mix of VBH and in-person visits. Survey respondents who used VBH care had similar perceptions of the quality of their care and more-positive views of VBH than respondents who did not use VBH care. Few respondents had declined VBH care in favor of in-person care. Using these findings, the authors make recommendations on the role of VBH care in overall BH delivered by the military.

For more information

Full Text

Access to high-quality behavioral health (BH) care is essential to the readiness of the U.S. armed forces and the health of their families. The U.S. Army has made significant improvements to its BH care delivery system over the past ten years, but it now faces the challenge of integrating lessons learned from the dramatic and unanticipated shift to virtual behavioral health (VBH) that occurred in the context of the coronavirus disease 2019 (COVID-19) pandemic. Three years since the onset of the pandemic, the optimal role of VBH as part of overall BH care delivery for soldiers and their dependents remains unclear. To inform policy and planning related to VBH, the Office of the Surgeon General, U.S. Army, asked RAND Arroyo Center to assess the expansion of VBH services and its relationship with overall BH service utilization and soldier perceptions of VBH, to inform recommendations on the role of VBH in military BH care in the future.

Background and Methods

BH conditions include a range of mental health and substance use disorders. VBH, also referred to as telehealth or telebehavioral health, is remote patient access to visits with a BH provider using technology such as a computer or cellular phone. VBH can be conducted as video visits using audio and visual communication technology, or as audio visits (also called audio-only or telephone) using audio technology with no video. Literature suggests that VBH can improve access to care, especially for patients who face barriers that involve work commitments, transportation, or child care (Donelan et al., 2019; Kruse et al., 2017). Systematic reviews suggest that VBH is similarly effective to in-person care for assessment and diagnosis of BH conditions (Greenwood et al., 2022; Hilty et al., 2013; Krzyzaniak et al., 2021; Scott, Bakhit, et al., 2022; Scott, Clark, et al., 2022). Research is favorable yet inconclusive on the comparative effectiveness of treatment through VBH and in-person care, as many studies were limited in their size, duration of follow-up, and the number of populations or BH conditions studied (Barnett et al., 2021; Ekeland, Bowes, and Flottorp, 2010). Therefore, it has been difficult to generalize the findings about effectiveness of VBH across populations, treated conditions, modalities (e.g., video, audio), and models (e.g., hybrid use of VBH and in-person BH care). For instance, some studies have concluded that video visits are superior to audio visits for the treatment of depression and trauma (McClellan et al., 2022). Patient satisfaction with VBH tends to be high, especially when patients can see their usual provider, and tends to increase with more use of VBH (Fischer et al., 2022; Kruse et al., 2017). Yet greater understanding is needed of patient experiences with and preferences regarding VBH and how those might change under a variety of conditions, treatments, and circumstances.

In this study, we examined patterns of VBH care delivery to active-component soldiers and their spouses and their receipt of VBH by different sources of care (i.e., direct care versus private-sector care). We also analyzed soldiers’ perceptions of and experiences with VBH.

  • Administrative data analyses included visit-level analyses of trends in the proportion of BH visits that were by VBH from October 2019 through March 2022 and VBH visits by soldiers (N = 78,797) and their spouses (N = 49,705) who had at least one BH visit through primary or specialty care between October 2021 and March 2022. Administrative data analyses also included person-level analyses of VBH visits among a subset of soldiers (n = 22,614) and their spouses (n = 7,836) who received at least three specialty BH treatment visits at a military treatment facility (MTF) (or, for spouses, at an MTF or in private-sector care) between October 2021 and March 2022 (the BH treatment cohorts).
  • A survey of soldiers assessed perceptions of VBH among those who received at least three BH specialty care outpatient treatment visits at an MTF between January and March 2022. The survey contained 70 items; was fielded between August 4 and September 23, 2022; and was completed by 419 soldiers.

Key Findings

We distilled the main findings from our administrative data analyses and the soldier survey into five themes.

Direct Care Providers Were Less Likely to Deliver Virtual Behavioral Health Than Private-Sector Providers and Relied Heavily on Audio Virtual Behavioral Health

For soldiers, the proportion of direct care VBH visits hit a peak of 74 percent in April 2020 and declined to 16 percent by March 2022. In contrast, private-sector care VBH visits among soldiers ranged from 61 percent to 46 percent during the same period. In direct care, between October 2021 and March 2022, primary care providers and psychiatrists were most likely to provide care by VBH, and evaluation and management/medication management visits were more likely to be by VBH than other types of visits. During the same period, in private-sector care, clinical psychologists and social workers were most likely to provide care by VBH, and individual psychotherapy was more likely to be by VBH than other types of visits. About 80 percent of direct care VBH visits were coded as audio visits, and nearly all private-sector VBH visits were coded as video-based, but guidelines on coding practices may partially account for these differences. Specifically, provider guidance varied regarding the definition of synchronous VBH (e.g., whether a video component was required), and codes used by direct care providers to designate audio visits were not used by private-sector providers. Survey findings indicated that, among those with any VBH, more soldiers reported receiving audio visits (79 percent) than video visits (58 percent). The majority of soldiers accessed VBH using their cell phone, though some used a computer or tablet or completed a visit from their vehicle; the home was the most common location for receiving VBH visits.

Soldiers Who Received Virtual Behavioral Health Typically Received a Mix of Virtual Behavioral Health and In-Person Visits

About half of soldiers in the BH treatment cohort received their treatment through a mix of VBH and in-person visits. Some small differences (just over 5 percentage points) were found in receipt of VBH across demographic groups within the BH treatment cohort. The largest difference in use of VBH was across age groups: VBH was used by 60 percent of those age 45–64 and 51 percent of those age 18–24. Almost all soldiers in the BH treatment cohort (98 percent) received at least some in-person care. Only 2 percent received all their visits through VBH.

Receipt of Virtual Behavioral Health Was Associated with More Positive Perceptions of Virtual Behavioral Health

Soldiers generally had positive perceptions of VBH convenience, regardless of whether they had received VBH as part of their BH care. About two-thirds of soldiers indicated that VBH visits saved time and were more convenient than in-person BH visits, and slightly less than half viewed VBH as requiring less time away from their military duties. About two-thirds of soldiers also saw VBH as an important option for care continuity during deployment or after moving to a new location. However, soldiers who had received VBH were more likely to endorse the advantages of VBH than those with no VBH experience (72 percent versus 48 percent, respectively, on the convenience of VBH, for example). Likewise, those with VBH experience were less likely to agree with statements about privacy concerns related to VBH (19 percent versus 34 percent, respectively, on concern about security of the connection). In addition, the “dose” of VBH experience also seemed to make a difference in perceptions of VBH: Soldiers with two or more VBH visits indicated significantly more positive perceptions of their providers, of visits, and of VBH technology (e.g., ease of use, protection of privacy) than those with only one visit.

Soldiers Who Received Virtual Behavioral Health Rated Their Military Behavioral Health Care Similarly to Those Who Received Only In-Person Behavioral Health Care

Comparing soldiers who received VBH and those who did not, we found no significant differences in perceptions of BH care quality, access, privacy, convenience, working alliance with providers, helpfulness of BH care, or global ratings of care. Some concerns arose regarding the scheduling of appointments in a timely manner, and a minority reported feeling concerned about their privacy during appointments, but those concerns did not differ by receipt of VBH. Because perceptions of BH care did not differ, these findings suggest that VBH integration did not negatively affect soldiers’ experience receiving BH care.

Few Soldiers Declined Virtual Behavioral Health in Favor of In-Person Care, but Nearly One-Third Were Not Offered Virtual Behavioral Health

While about half of surveyed soldiers received VBH in the prior six months, nearly one-third were not offered VBH, one-sixth were offered it but did not receive it, and the remainder did not receive VBH but could not be sure whether it was offered. This suggests that some soldiers may have been interested in VBH and may have chosen to use it had it been offered to them. The soldiers who were offered VBH but did not receive it were a small part of the sample (17 percent), but the majority (91 percent) of this small subgroup expressed a preference for in-person BH care.

Recommendations

We integrated our analyses of VBH use and the survey of soldiers to develop three recommendations on the role of VBH in overall BH delivered by the military.

Recommendation 1. Support the Expanded Delivery of Virtual Behavioral Health Among Military Treatment Facility Providers by Developing a Virtual Behavioral Health Care Strategic Plan

Our findings suggest that there is ample room to increase the use of VBH in direct care. The proportion of VBH visits in direct care was substantially lower than in private-sector care, and direct care providers relied heavily on audio visits. A subset of soldiers in our survey who did not receive VBH also indicated that they had not been offered VBH care, which suggests that they might have used it had it been offered to them. To expand the delivery of VBH, we recommend that the Military Health System (MHS) capitalize on its existing virtual health care strategic plan by developing goals and an implementation plan specific to VBH. These could include defining a target volume of VBH to be delivered through direct care and private-sector care, releasing guidance on appropriate situations for VBH delivery, and clarifying coding guidelines for video and audio visits in direct and private-sector care. A VBH implementation plan should establish minimum requirements for training and outfitting military BH providers with necessary technical equipment. Direct and private-sector providers should receive guidance on standardized coding for the VBH modality used (i.e., video versus audio) to ensure accurate data capture of the use of these modalities. These standards for VBH could be communicated to providers across service branches through an updated Defense Health Agency Procedural Instruction or similar document and through clinical, administrative, and technical trainings.

Recommendation 2. Assess Barriers to Virtual Behavioral Health and Ensure That Military Treatment Facility Providers Are Equipped and Trained to Deliver Virtual Behavioral Health

The high proportion of audio visits in direct care suggest that direct care providers may need additional support to carry out video visits. While the MHS currently has plans to fully equip all direct care providers with VBH equipment, conducting a baseline survey to assess perceived barriers related to technology and clinical training for VBH among MTF BH providers would provide a comprehensive needs assessment to guide these efforts. Survey findings could help identify content to incorporate into standardized trainings, current technology resources, and areas for which additional clinical guidelines or training protocols may be needed.

Recommendation 3. Evaluate the Utility of Virtual Behavioral Health in Supporting Continuity of Behavioral Health Care Across Military Treatment Facilities

Most soldiers indicated that they saw substantial value in being able to continue seeing their provider through VBH while deployed or after moving to a new location. Though the MHS has been developing a Virtual Medical Center to address access shortages in direct care settings in the United States and around the world, there are several barriers to keeping soldiers connected to providers regardless of location. These include administrative processes regarding MTF privileging and credentialing, existing systems for measuring provider productivity according to visits completed with service members at the provider's MTF, and a lack of guidance on how and when to implement VBH with service members after a move or deployment. If the MHS were to address these barriers through changes to administrative processes and the dissemination of updated guidance, it could be useful to then pilot and evaluate the utility of VBH in supporting continuity of care across MTFs. For example, the MHS could explore the feasibility of allowing time-limited use of VBH to support care continuity, such as for a period of six months or until BH care is established with a new provider. A rigorous evaluation could assess for differences in quality and cost of BH care and provide an assessment of the potential value of broader implementation of VBH to support care continuity in the future.

Summary

The rapid expansion of VBH during the pandemic provided an opportunity to learn about the potential for VBH to enhance access to BH care for soldiers and their spouses. The key findings and recommendations from this report may be used to inform policymaking and planning regarding the role that VBH will play as a permanent part of BH care delivery.

This research was sponsored by the Office of the Surgeon General, U.S. Army and conducted within the Personnel, Training, and Health Program within the RAND Arroyo Center.

More in this issue

References

Barnett, Phoebe, Lucy Goulding, Cecilia Casetta, Harriet Jordan, Luke Sheridan-Rains, Thomas Steare, Julie Williams, Lisa Wood, Fiona Gaughran, and Sonia Johnson, "Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews," Journal of Medical Internet Research, Vol. 23, No. 7, 2021.

Donelan, Karen, Esteban A. Barreto, Sarah Sossong, Carie Michael, Juan J. Estrada, Adam B. Cohen, Janet Wozniak, and Lee H. Schwamm, "Patient and Clinician Experiences with Telehealth for Patient Follow-Up Care," American Journal of Managed Care, Vol. 25, No. 1, January 2019.

Ekeland, Anne G., Alison Bowes, and Signe Flottorp, "Effectiveness of Telemedicine: A Systematic Review of Reviews," International Journal of Medical Informatics, Vol. 79, No. 11, 2010.

Fischer, Shira H., Zachary Predmore, Elizabeth Roth, Lori Uscher-Pines, Matthew Baird, and Joshua Breslau, "Use of and Willingness to Use Video Telehealth Through the COVID-19 Pandemic," Health Affairs, Vol. 41, No. 11, 2022.

Greenwood, Hannah, Natalia Krzyzaniak, Ruwani Peiris, Justin Clark, Anna Mae Scott, Magnolia Cardona, Rebecca Griffith, and Paul Glasziou, "Telehealth Versus Face-to-Face Psychotherapy for Less Common Mental Health Conditions: Systematic Review and Meta-Analysis of Randomized Controlled Trials," JMIR Mental Health, Vol. 9, No. 3, 2022.

Hilty, Donald M., Daphne C. Ferrer, Michelle Burke Parish, Barb Johnston, Edward J. Callahan, and Peter M. Yellowlees, "The Effectiveness of Telemental Health: A 2013 Review," Telemedicine and e-Health, Vol. 19, No. 6, 2013.

Kruse, Clemens Scott, Nicole Krowski, Blanca Rodriguez, Lan Tran, Jackeline Vela, and Matthew Brooks, "Telehealth and Patient Satisfaction: A Systematic Review and Narrative Analysis," BMJ Open, Vol. 7, No. 8, 2017.

Krzyzaniak, Natalia, Hannah Greenwood, Anna M. Scott, Ruwani Peiris, Magnolia Cardona, Justin Clark, and Paul Glasziou, "The Effectiveness of Telehealth Versus Face-to-Face Interventions for Anxiety Disorders: A Systematic Review and Meta-Analysis," Journal of Telemedicine and Telecare, 2021.

McClellan, Michael J., Richard Osbaldiston, Rongxiu Wu, Rachael Yeager, Addison D. Monroe, Tyler McQueen, and Mattie Helen Dunlap, "The Effectiveness of Telepsychology with Veterans: A Meta-Analysis of Services Delivered by Videoconference and Phone," Psychological Services, Vol. 19, No. 2, 2022.

Scott, Anna Mae, Mina Bakhit, Hannah Greenwood, Magnolia Cardona, Justin Clark, Natalia Krzyzaniak, Ruwani Peiris, and Paul Glasziou, "Real-Time Telehealth Versus Face-to-Face Management for Patients with PTSD in Primary Care: A Systematic Review and Meta-Analysis," Journal of Clinical Psychiatry, Vol. 83, No. 4, 2022.

Scott, Anna Mae, Justin Clark, Hannah Greenwood, Natalia Krzyzaniak, Magnolia Cardona, Ruwani Peiris, Rebecca Sims, and Paul Glasziou, "Telehealth v. Face-to-Face Provision of Care to Patients with Depression: A Systematic Review and Meta-Analysis," Psychological Medicine, Vol. 52, No. 14, 2022.

Topics

RAND Health Quarterly is produced by the RAND Corporation. ISSN 2162-8254.

PubMed logo

Explore RAND Health Quarterly articles on PubMed