Assessing Quality in Cross-Country Comparisons of Health Systems and Policies

Towards a Set of Generic Quality Criteria

Published in: Health Policy, 2013

Posted on on January 01, 2013

by Mirella Cacace, Stefanie Ettelt, Nicholas Mays, Ellen Nolte

There is a growing body of cross-country comparisons in health systems and policy research. However, there is little consensus as to how to assess its quality. This is partly due to the fact that cross-country comparison constitutes a diverse inter-disciplinary field of study, with much variation in the motives for research, foci and levels of analyses, and methodological approaches. Inspired by the views of subject area experts and using the distinction between variable-based and case-based research, we briefly review the main different types of cross-country comparisons in health systems and policy research to identify pertinent quality issues. From this, we identify the following generic quality criteria for cross-country comparisons: (1) appropriate use of theory, (2) explicit selection of comparator countries, (3) rigour of the comparative design, (4) attention to the complexity of cross-national comparison, (5) rigour of the research methods, and (6) contribution to knowledge. This list may not be exclusive though publication and discussion of the list of criteria should help raise awareness in this field of what constitutes high quality research. In turn, this should be helpful for those planning, undertaking, or commissioning cross-country comparative research.

Research conducted by

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.