January 2021 Newsletter
|
|
Unbelievably, so much has happened in the world since our last newsletter. We realize that this is an incredibly difficult time for everyone, and we hope you are all finding ways to cope. Our team has been coping with long walks, bicycle rides, kayaking, puzzles, board games, cooking and baking, and yoga. We have all found that unplugging from work has also been vitally important. In sum, we have been trying to support each other in new ways as we dealt with a year that has shifted our personal and work lives in unprecedented ways. Our latest newsletter will catch you up on our recent work-related activities on our Causal Tools Project.
|
|
|
|
Latest Tools
|
This is a user-friendly, menu-driven Shiny application (app) that can be used to estimate propensity score weights for studies with three or more treatment groups. It also estimates the needed treatment effect estimates using those propensity score weights. The app includes a tutorial, which demonstrates use of the TWANG Shiny app through an illustrative example and toy dataset. It provides a nice complement to our binary SHINY App for Two Treatments.
|
|
The SBdecomp package for R can be used to quantify the proportion of the estimated selection bias explained by each observed confounder when estimating causal effects using propensity score weights. It includes two approaches to quantify the proportion of the selection bias explained by each observed confounder—a single confounder removal approach and a single confounder inclusion approach. This tool can help analyze data where there is a substantive interest in identifying the variable or variables that explains the largest proportion of the estimated selection bias.
|
|
This series of eight training videos provides researchers and analysts with an overview of causal inference and the role of propensity scores in analysis. It introduces causal modeling using the potential outcomes framework and propensity score weights to estimate causal effects from observational data. Presenters demonstrate how propensity score weights can be used to estimate intervention effects, how to evaluate balance before and after propensity score weighting, and how to fit models with available software in Stata and R. Tools are also available in SAS and Shiny. Those who take the course learn how to implement propensity score weighting using state-of-the-art methods and gain insights into some of the practical issues around evaluating the quality of propensity score weights for two or more treatment groups and time-varying treatments.
|
|
|
Forthcoming Tools
We have four tools that will be released on CRAN and our website shortly. These include:
R Tools
- Continuous exposures/treatment tool (twangContinuous) – This tool estimates generalized propensity score weights for continuous exposures/treatments using generalized boosted models (GBM).
- Omitted variable sensitivity analysis tool (OVtool) – This tool assesses the sensitivity of treatment effects and statistical significance to an unobserved confounder.
- Twang 2.0 – Our updated TWANG package expands the original package to include xgboost for estimation of propensity score weights with the goal of improving the performance of the TWANG package for big data.
- Entropy balancing for binary and continuous trts (entbal) – This tool estimates causal treatment effects for binary and continuous treatments using entropy balancing (EB).
|
Additionally, we have four tools that are currently actively being beta-tested. We need additional beta-testers. Would you be willing to help us? If you are interested in beta testing any of our forthcoming tools, please email us at twang-project@rand.org. Beta testers who can return feedback within two weeks will receive a $50 gift card.
R Tools
- Causal mediation tool (wgtmed) — This tool will conduct causal mediation to estimate natural direct and indirect effects for one or more mediators using a weighting approach with weight estimated by GBM or logistic regression.
|
Shiny Tools
- TWANG IPTW Shiny app — This user-friendly, menu-driven app estimates inverse probability of treatment weights for time-varying treatments groups using GBM.
- Covariate Balance Web App (CoBApp) — This user-friendly, menu-driven app estimates balancing weights for 9 different propensity score and entropy balancing methods, selects the optimal set of weights, performs treatment effect estimation, and helps users carefully assess the validity of both the overlap and unobserved confounding assumptions required for valid inference.
|
Stata Tools
- IPTW Macro — This macro will estimate inverse probability of treatment weights for time-varying treatments using GBM
|
|
|
Currently Available Tools
All software tools are available to download here: https://www.rand.org/statistics/twang/downloads.html
Shiny Tools
- Shiny App for Two Treatments
- Shiny App for Three or More Treatments
|
SAS Tools
- TWANG Macro Package — This package contains commands for estimating propensity score weights for two groups (using the %ps command) and for more than two groups (using the %mnps command). It also contains a command (using the %dxwts command) for assessing the covariate balance achieved by any set of weights.
|
Stata Tools
- Support Files for PS and MNPS — This set of files supports estimating propensity score weights for two groups (using the ps command) and more than two groups (using the ps and mnps command) and for checking the balance of groups after weighting.
|
R Tools
- The twang R library on CRAN contains:
- ps command — to estimate propensity score weights for two groups
- mnps command — to estimate propensity score weights for more than two groups
- iptw command — to estimate inverse probability of treatment weights for time-varying treatments.
- Selection Bias Decomposition (SBdecomp) Tool
|
|
|
|
|
Upcoming Workshops
|
A list of workshops can be found here: https://www.rand.org/statistics/twang/workshops.html
Members of the TWANG project team will again be conducting a series of workshops in 2021 to help those without any experience in propensity scores, as well as more advanced users gain hands-on experience to estimate propensity score weights using boosted models in R, SAS, Stata, and Shiny.
American Statistical Association (ASA) Traveling Short Course Series
Guidelines for Using State-of-the-Art Methods to Estimate Propensity Score and Inverse Probability of Treatment Weights When Drawing Causal Inferences
Presenters: Beth Ann Griffin, Daniel McCaffrey, Lane Burgette, Matt Cefalu, Donna Coffman
Locations: TBA
Dates: 2021
College on Problems of Drug Dependence (CPDD) Invited Workshop
Causal Mediation Analysis: A Conceptual Overview & Methodological Considerations
Presenter: Megan Schuler
Virtual conference: June 20-23, 2021
|
|
|
|
|
Related Publications
|
A full list of related publications can be found here: https://www.rand.org/statistics/twang/publications.html
- Griffin BA, Ayer L, Pane J, et al. Expanding outcomes when considering the relative effectiveness of two evidence-based outpatient treatment programs for adolescents. J Subst Abuse Treat. 2020;118:108075.
- Vegetabile BG, Griffin BA, Coffman DL, Godley M, McCaffrey DF. Nonparametric Estimation of Population Average Dose-Response Curves using Entropy Balancing Weights for Continuous Exposures. Health Services and Outcomes Research Methodology. In Press.
- Parast L, Griffin BA. Quantifying the bias due to observed individual confounders in causal treatment effect estimates. Stat Med. 2020;39(18):2447-2476.
- Vegetabile BG, Gillen DL, Stern HS. Optimally balanced Gaussian process propensity scores for estimating treatment effects. J Roy Stat Soc Ser A (Stat Soc). 2020;183(1):355-377.
- Coffman DL, Zhou J, Cai X. Comparison of methods for handling covariate missingness in propensity score estimation with a binary exposure. BMC Med Res Methodol. 2020;20(1):168.
- Robbins MW, Griffin BA, Shih RA, Slaughter ME. Robust estimation of the causal effect of time-varying neighborhood factors on health outcomes. Stat Med. 2020;39(5):544-561.
- Ayer, Lynsay and Dana Schultz, eds., Mental Health Task-Shifting in Community-Based Organizations: Implementation, Impact, and Cost — Evaluation of the Connections to Care Program, Santa Monica, Calif.: RAND, RR-3083-MFANYC, 2020. As of January 12, 2021: https://www.rand.org/pubs/research_reports/RR3083.html
- Antonelli, Joseph, and Matthew Cefalu. "Averaging causal estimators in high dimensions." Journal of Causal Inference 8.1 (2020): 92-107.
- Agniel Denis, Han Bing, and Cefalu Matthew. "Synthetic estimation for the complier average causal effect." Canadian Journal of Statistics. In press.
|
|
|
|
|
Funding
|
Funding for these efforts have been supported by two grants from the National Institute of Drug Abuse (NIDA): R01DA034065 and R01DA045049 (PIs: Griffin & McCaffrey).
|
|
|
|
|
Feedback
|
|
RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis.
|
|
|
Privacy statement
|
 |
RAND. RAND® is a registered trademark.
|
|
|
|
|
|
|