Developing Citizen Report Cards for Primary Health Care in Low and Middle-income Countries

Results from Cognitive Interviews in Rural Tajikistan

Published in: PloS One, Volume 12, Number 10 (October 2017), e0186745. doi: 10.1371/journal.pone.0186745

Posted on on November 22, 2017

by Sebastian Bauhoff, Lila Rabinovich, Lauren A. Mayer

Read More

Access further information on this document at PloS One

This article was published outside of RAND. The full text of the article can be found at the link above.

Citizen report cards on health care providers have been identified as a potential means to increase citizen engagement, provider accountability and health systems performance. Research in high-income settings indicates that the wording, presentation and display of performance information are critical to achieve these goals. However, there are limited insights on developing effective report card designs for middle- and low-income settings. We conducted cognitive interviews to assess consumers' understanding, interpretation of and preferences for displaying information for a health care report card in rural Tajikistan. We recruited a convenience sample of 40 citizens (20 women and 20 men aged 18–45) from rural areas of two provinces of Tajikistan (Soghd and Khatlon oblasts). The interview protocol was adapted from the model of cognitive interviews used in social science research to improve survey questionnaires. We used multivariate regression to assess understanding and interpretation of the report card; chi2 tests to assess differences in preferences for displaying information; and tests of proportions to assess the preferred comparison group. Respondents understood the main idea of the report card and are not confused by the indicators or display. However, many respondents had difficulties making comparisons, and when asked to identify worst-performing services. Respondents preferred detailed rankings using school grades, comparisons of their local clinic with the regional or national average performance, and the use of color in the report card. We found some heterogeneity across the two provinces. Overall, our findings are promising regarding the citizens' comprehension of health care report cards in rural Tajikistan, while underscoring the challenges of effectively providing health care performance information to communities. Cognitive interviews and iterative testing can support an effective implementation of reporting initiatives.

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.