Cover: The Psychometric Performance of the PROMIS Smoking Assessment Toolkit

The Psychometric Performance of the PROMIS Smoking Assessment Toolkit

Comparisons of Real-Data CATs, Short Forms, and Mode of Administration

Published in: Nicotine & Tobacco Research, 2015

Posted on Apr 22, 2015

by Brian D. Stucky, Wenjing Huang, Maria Orlando Edelen

INTRODUCTION: The PROMIS® Smoking Initiative has developed six items banks for assessment related to cigarette smoking among adult smokers (Nicotine Dependence, Coping Expectancies, Emotional and Sensory Expectancies, Health Expectancies, Psychosocial Expectancies, and Social Motivations). This paper evaluates the psychometric performance of the banks when administered via short form (SF), computer adaptive test (CAT), and by mode of administration (computer vs. paper-and-pencil). METHODS: Data are from two sources: an internet sample (N=491) of daily and nondaily smokers who completed both SFs and CATs via the web and a community sample (N=369) that completed either paper-and-pencil or computer administration of the SFs at two time points. First a CAT version of the PROMIS Smoking Assessment Toolkit was evaluated by comparing item administration rates and scores to the SF administration. Next, we considered the effect of computer vs. paper-and-pencil administration on scoring and test re-test reliability. RESULTS: Across the domains approximately 5.4 to 10.3 items were administered on average for the CAT. SF and CAT IRT-scores were correlated from 0.82 to 0.92 across the domains. Cronbach's alpha for the 4 to 8-item SFs among daily smokers ranged from .80 to .91 and .82 to .91 for paper-and-pencil and computer administrations, respectively. Test-retest reliability of the SFs ranged from 0.79 to 0.89 across mode of administration. CONCLUSIONS: Results indicate that the SF and CAT and computer and paper-and-pencil administrations provide highly comparable scores for daily and nondaily smokers, but preference for SF or CAT administration may vary by smoking domain.

This report is part of the RAND external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.