An Evaluation of the Use of Performance Measures in Health Care
- How are performance measures being used in practice?
- What factors are influencing measure use?
- What types of system changes have occurred as a result of measure use?
- What improvements could make it easier to use performance measures?
The National Quality Forum (NQF), a private, nonprofit membership organization committed to improving health care quality performance measurement and reporting, was awarded a contract with the U.S. Department of Health and Human Services (HHS) to establish a portfolio of quality and efficiency measures. The portfolio of measures would allow the federal government to examine how and whether health care spending is achieving the best results for patients and taxpayers. As part of the scope of work under the HHS contract, NQF was required to conduct an independent evaluation of the uses of NQF-endorsed measures for the purposes of accountability (e.g., public reporting, payment, accreditation, certification) and quality improvement. In September 2010, NQF entered into a contract with the RAND Corporation for RAND to serve as the independent evaluator. This report presents the results of the evaluation study. It describes how performance measures are being used by a wide array of organizations and the types of measures being used for different purposes, summarizes key barriers and facilitators to the use of measures, and identifies opportunities for easing the use of performance measures moving forward.
Measures Serve Internal, Public Needs
- Public reporting (releasing information about quality of care) and quality improvement were the most commonly reported uses of performance measures.
- Users reported using measures drawn from seven performance domains: structure of care, process of care, outcome, access, safety, costs, and patient experience, with process measures being the most widely used.
- A combination of factors is driving use of performance measures, including requirements related to payments based on meeting quality standards and public reporting in the Patient Protection and Affordable Care Act, and the need to respond to local health issues.
After Release, Minimal Interest in Measures
- Few organizations had studied the results from measuring performance, particularly regarding the return on investment.
New Measures Could Improve Measurement of Care
- Access measures, among others, are lacking - leading to incomplete information about the care provided
- Several areas for developing new measures were identified, including coordination of care, outcomes, patient safety, cost and resource use, access and affordability, and measures that address specific conditions, settings, and populations.
- Establish priorities for where end users should focus their attention and resources.
- Align measures among the various parties that impose reporting requirements.
- Develop new measures for emerging applications, such as those in the context of episode-based payments, accountable care organizations, and value-based purchasing.
- Engage in front-end planning to influence the data architecture of EHRs and other health IT to support the construction of measures
- Conduct a systematic review of the literature to fully catalog measure use and formally assess the system-change results from the use of measures.
Table of Contents
Members of the Evaluation of Measure Use Expert Advisory Panel
List of Organizations Included in the Document and Website Review
Breakdown of Measure Uses in Sample of Organizations Undergoing Document and Website Review
Additional Data Summary Tables from Document and Website Review and Key-Informant Interviews