Jan 29, 2020
Photo by Mass Communication Specialist 1st Class Demetrius Kennon/Flickr
The materials designed to raise awareness of the Department of Defense's Real Warriors Campaign (RWC) constitute one of four federally funded mental health public awareness campaigns that RAND is evaluating as part of a cross-agency evaluation (funded by the Department of Defense Psychological Health Center of Excellence) aimed at improving the mental health of service members and veterans. A cross-agency evaluation report describes the campaigns' overlapping and unique scope and content, as well as cross-campaign dissemination efforts. Based on the cross-agency evaluation report, this brief about RWC awareness materials is one in a series examining the individual campaigns' messages, the consistency of messaging in their materials, and the tools they use to deliver content to their audiences. Because the results presented here are from an evaluation of the four campaigns' collective reach and impact, they are not intended to serve as a full and comprehensive evaluation of RWC. It should also be noted that this evaluation focuses on the materials designed to raise awareness of RWC and not on the functioning or operations of the campaign itself.
The following are some key findings about RWC from the RAND research team's content analysis of campaign materials, an analysis of campaign-collected communication metrics, and a discussion with a panel of experts that assessed the extent to which the RWC's content and design align with best practices for mental health public awareness campaigns.
The majority (62 percent) of the 265 pieces of RWC content reviewed were tailored to active-duty service members or those in the Guard or Reserve. Women, officers, and post-2001 service members were well represented in the materials.
More than 70 percent of RWC content supported its messaging. Campaign content also supported messages that corresponded with shared goals across the campaigns being evaluated (for example, offering resources for those in crisis).
Experts found that RWC materials generally adhered to best practices and used credible messengers.
of campaign materials were tailored to service members (active duty, National Guard, or Reserve)
More than 80 percent of the RWC webpages contained a clearly marked source for the information. Of these, about half cited scientific articles.
RWC provided a small amount of content for its secondary audiences, particularly health professionals.
The panel of experts found some RWC materials to be complicated, the website somewhat disorganized, and some web content out of date (for example, the website hosts a weekly podcast series that was last updated in 2013).
The analysis found numerous missed opportunities for the four campaigns' websites to link to each other's campaigns and resources. For example, RWC creates video testimonials about recovery, but the Make the Connection campaign has 600 such videos on its site.
Between 2012 and 2015, the number of website sessions increased by 22 percent, with a peak of 331,639 sessions in 2013.
public service announcements were aired on radio and television
RWC was responsible for 93 percent of radio and television public service announcement (PSA) viewer impressions (the number of viewers who might have been exposed to the PSA) generated by the four campaigns. It aired almost 37,000 radio public service announcements that racked up 37 billion impressions and almost 15,500 television public service announcements that generated more than 3 billion impressions.
RWC is the most active user of Twitter among the campaigns. It averaged five tweets per day in 2015, for a total of 1,865, and had 40,000 followers. Approximately 25 percent of its posts generated some engagement from nonofficial channels, and this volume increased over time, even as the number of official tweets declined.
Photo by Mass Communication Specialist Senior Chief Kevin Elliott/U.S. Navy
The experts recommended several approaches to improve RWC. See the full report for a complete list of recommendations based on the cross-campaign analysis.