Next Steps for Use of Item Response Theory in the Assessment of Health Outcomes
Published In: Quality of Life Research, v. 16, Suppl. 1, Aug. 2007, p. 195-199
Posted on RAND.org on January 01, 2007
OBJECTIVES: The authors review the NCI/DIA conference, Improving health outcomes assessment based on modern measurement theory and computerized adaptive testing, and suggest next steps in use of item response theory (IRT) to assess health outcomes. BACKGROUND: In recent years the level of interest and use of IRT methods has increased dramatically among health outcomes researchers. The NCI/DIA conference on June 24-25, 2004, was one of the first systematic opportunities to examine many challenging issues in applying IRT to the health outcomes field. METHOD: Based on the conference presentations, the authors identified five issues important to future applications of IRT to health outcomes. RESULTS: The five key issues are as follows: (1) collaboration between academia, government and industry; (2) common versus unique item banks; (3) educating and establishing standards for use and reporting of IRT; (4) demonstrating the value of IRT; and (5) continuing efforts to improve the user friendliness of IRT software. CONCLUSIONS: Moving forward will require a collaborative effort between academia, government agencies, and industry to design and conduct IRT research. A common item bank developed with collaboration from investigators from multiple institutions could be very valuable to the field. The establishment of consensus standards for use and reporting of IRT results would help users and consumers of the methodology. Clear documentation of how IRT can lead to better patient-reported outcome measures and more accurate understanding of substantive issues is essential. Academia, government and industry should continue current work to enhance the user-friendliness of the IRT software.