Project
Toolkit for Weighting and Analysis of Nonequivalent Groups (TWANG)
Mar 12, 2014
Using Propensity Score Based Methods to Understand Dosage Effects Within a Randomized Controlled Trial
Published in: Journal of Substance Abuse Treatment, Volume 132 (January 2022). doi: 10.1016/j.jsat.2021.108637
Posted on RAND.org on June 24, 2022
This article was published outside of RAND. The full text of the article can be found at the link above.
In a recently published randomized controlled trial (RCT) of Volunteer Recovery Support for Adolescents (VRSA), a secondary finding indicated that better adherence to planned VRSA telephone session frequency resulted in significantly higher remission rates relative to lower session adherence. However, interpretation of this dose-response relationship may have been confounded by participant characteristics such as baseline levels of substance use and mental health problems.
The present study used statistical methods designed to approximate RCTs when comparing more than two nonequivalent groups that include an assessment of the potential impact of omitted variables. Classification and Regression Tree (CRT) analysis was used to establish the cut-point between high (H) and low (L) VRSA dosage groups. Because we were interested in generalizing to youth with poor attendance, the L-VRSA group served as the reference group. Balancing weights for H-VRSA and a services as usual (SAU) control group were calculated to ensure similarity of baseline pretreatment characteristics to the reference group, and sensitivity of findings to unobserved confounding variables was assessed.
Findings suggested that superior remission rates at the end of the intervention phase were the result of high adherence to planned VRSA session frequency. Recommendations to achieve high VRSA participation among a larger segment of youth and to test whether longer VRSA duration improves the stability of recovery outcomes are provided.
Few published dose-response studies have adequately controlled for selection confounds from both observed and unobserved confounding. As such, the present study aims to both assess the impact of different dosage levels of VRSA and provide a template for how to apply state-of-the-art statistical methods designed to approximate randomized controlled trials to such studies.
This article was published outside of RAND. The full text of the article can be found at the link above.
This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.
Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit www.rand.org/about/research-integrity.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.