Improving Disparity Estimates for Rare Racial/Ethnic Groups with Trend Estimation and Kalman Filtering

An Application to the National Health Interview Survey

Published In: HSR, Health Services Research, v. 44, no. 5, pt. 1, Oct. 2009, p. 1622-1639

Posted on on January 01, 2009

by Marc N. Elliott, Daniel F. McCaffrey, Brian Karl Finch, David J. Klein, Nathan Orr, Megan K. Beckett, Nicole Lurie

Read More

Access further information on this document at Blackwell Publishing

This article was published outside of RAND. The full text of the article can be found at the link above.

OBJECTIVE: Single-year estimates of health disparities in small racial/ethnic groups are often insufficiently precise to guide policy, whereas estimates that are pooled over multiple years may not accurately describe current conditions. While collecting additional data is costly, innovative analytic approaches may improve the accuracy and utility of existing data. They developed an application of the Kalman filter in order to make more efficient use of extant data. DATA SOURCE: The authors used 1997-2004 National Health Interview Survey data on the prevalence of health outcomes for two racial/ethnic subgroups: American Indians/Alaska Natives and Chinese Americans. STUDY DESIGN: The authors modified the Kalman filter to generate more accurate current-year prevalence estimates for small racial/ethnic groups by efficiently aggregating past years of cross-sectional survey data within racial/ethnic groups. The authors compared these new estimates and their accuracy to simple current-year prevalence estimates. PRINCIPAL FINDINGS: For 18 of 19 outcomes, the modified Kalman filter approach reduced the error of current-year estimates for each of the two groups by 20-35 percent-equivalent to increasing current-year sample sizes for these groups by 56-135 percent. CONCLUSIONS: This approach could increase the accuracy of health measures for small groups using extant data, with virtually no additional cost other than those related to analytical processes.

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.