Using a Criterion Standard to Validate the Alcohol-Related Problems Survey (ARPS)

A Screening Measure to Identify Harmful and Hazardous Drinking in Older Persons

Published in: Aging : Clinical and Experimental Research, v. 12, no. 3, 2000, p. 221-227

by Alison A. Moore, Ron D. Hays, David Reuben, John Beck

Read More

Access further information on this document at

This article was published outside of RAND. The full text of the article can be found at the link above.

The authors compared the Alcohol-Related Problems Survey (ARPS), a new screening measure targeted at harmful and hazardous drinking among older individuals, to a criterion standard (CS) among 22 persons aged 65 and older who reported consuming at least one drink of alcohol in the previous 12 months. The CS was conducted by a study physician and research assistant. It assessed risks from alcohol use, and consisted of a structured review of each subject's medical record, clinical interview, physical examination, and an interview with a collateral informant. Analyses included descriptive statistics for demographic and health characteristics, inter-rater reliability, agreement between the ARPS and the CS, reasons for disagreement, and sensitivity and specificity of the ARPS as compared to the CS. Using Landis and Koch criteria, inter-rater reliability between two physicians for 11 subjects was substantial (weighted kappa 0. 79), but agreement between the ARPS and the CS was only fair (weighted kappa 0.28). Reasons for disagreement included problems with ARPS' questions and classification rules, and problems with study physicians' assessments of drinking risk. Based on these reasons for disagreement, the authors made revisions in the ARPS and its classification rules. Agreement between the revised ARPS and the CS improved substantially (weighted kappa 0.62). Sensitivity and specificity of the original ARPS were 80% and 50%, respectively, and both improved to 82% after revisions. The revised ARPS is sensitive and specific for identifying harmful and hazardous drinking in older persons as determined by clinicians.

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.