Evaluability Assessment and Evaluation Options for an Elder Abuse Shelter Model
Mar 23, 2023
Ready for Impact Evaluation
|PDF file||0.2 MB||
Use Adobe Acrobat Reader version 10 or higher for the best experience.
The Harry and Jeanette Weinberg Center for Elder Justice in New York City offers emergency housing and multidisciplinary support services through an Elder Abuse Shelter (EAS) to older adults experiencing abuse or mistreatment. Building on an initial RAND assessment of this shelter model, RAND researchers created three options for rigorously evaluating its impact and value. These approaches offer a flexible framework for identifying features of the EAS model that are most important to its success, which the Center and similar organizations can use as a blueprint for replicating and expanding the program into other locales if the evaluation demonstrates positive impacts.
Elder abuse and mistreatment affects one in ten adults older than 60 who live in the community (i.e., not in facilities such as assisted living). However, emergency housing remains elusive for this group. A 2019 study found that nearly 25 percent of elder abuse victims needed access to temporary emergency housing to interrupt the abuse. Yet a review of 115 programs that address elder mistreatment found that only seven helped provide emergency housing.
With the number of Americans aged 65 and over expected to almost double to 95 million by 2060, the problem of elder abuse stands to become ever-more prevalent. Programs have sprouted in various locations across the United States to help intervene and provide services to victims, yet there is scant evidence available on which intervention features work best.
An initial 2021 RAND assessment of the Center's EAS model used hypothetical vignettes to explore the model's potential to reduce overall costs of care for members of this population while maintaining or improving their quality of life. For the current study, the National Institute of Justice asked RAND researchers to document the EAS model and devise practical but rigorous options for evaluating its impact. The RAND team conducted a systematic literature review of EAS model evaluations and assessed the Center's ability to participate in a full-scale impact evaluation. The team also conducted interviews with staff, partners, and other organizations with EAS models.
The Weinberg Center for Elder Justice is colocated with a nonprofit, faith-based, long-term care community in the Hebrew Home at Riverdale, in the Bronx borough of New York. It provides emergency shelter to older individuals who are referred by community-based providers such as Adult Protective Services (APS) and who would not be able to receive services at domestic violence shelters due to special needs such as cognitive impairment, chronic medical conditions, and mobility issues.
Once admitted, clients gain access to a full range of supportive trauma-informed care from a well-trained multidisciplinary team that works collaboratively to address the complexities of their needs (Figure 1). Staff include attorneys, Elder Justice Specialists (Licensed Master Social Worker [LMSW]), Transitional Care Social Workers (Licensed Clinical Social Worker [LCSW]), and a Public Health Specialist who tailor services to clients' needs, such as obtaining an order of protection, providing guidance on relationship restoration, or connecting with community-based services upon discharge. Weinberg Center also work with medical staff at the Hebrew Home to ensure that clients' health needs are addressed. The Weinberg Center pays for housing and medical care for clients through insurance (e.g., Medicaid or Medicare). The program also draws on grants and donations to cover services outside those provided by the Hebrew Home.
In 2020 and 2021, 51 racially and ethnically diverse clients were admitted to the program; more than 80 percent were female, their average age was 76, most had low incomes, and more than half were cognitively impaired. However, not all victims of abuse referred to the program become clients. Three factors contribute to this. First, the coronavirus disease 2019 pandemic outbreak in many nursing facilities might have dissuaded some clients from becoming residents. Second, the EAS model requires new residents to have a no-contact period — meaning no visitors — to insulate victims from their abusers, giving the care team time to get clients started on their treatment. Finally, the Center's admissions and exclusion criteria limit the number of victims they can serve. The Center, for example, does not typically accept individuals with untreated substance abuse and mental health conditions or without a clear discharge plan (i.e., a potential place to return to after completing the program or someone to help the transition) upon admission.
Ultimately the research team concluded that the Weinberg Center model is organizationally and programmatically ready to undergo a full evaluation, though it would need to strengthen its data-collection capabilities to undergo some types of evaluation designs.
The research team homed in on three quasi-experimental evaluation designs for the Weinberg Center EAS and other EASs to consider:
All three options would take three to six years to complete, following generally the same steps from recruitment, to data collection and analysis, to publication and dissemination. Option 1 would include one additional step, estimated to take two to four months, involving formation of partnerships and agreements for data collection with referral agencies. The population and timeline requirements for each option are outlined in Table 1.
|1||100+ clients||100+ non-client victims||450–530 labor days|
|2||100+ clients||100+ non-client victims||360–435 labor days|
|3||200+ clients||None||320–350 labor days|
A full impact evaluation of the Weinberg Center's EAS model would be a substantial contribution to the literature on interventions to shelter elderly people experiencing abuse. As the Weinberg Center assesses its options for such an evaluation, it will need to consider hiring evaluators who have expertise working with this vulnerable population and understand how to securely handle their personal data. Evaluators must also have cultural competency to assess whether services are being delivered equitably across populations and must be able to incorporate family input if warranted by the study design. Organizations that run programs similar to the EAS model might also consider learning from the Weinberg Center's evaluation or even applying one of these evaluation designs to their own operations.
This report is part of the RAND Corporation Research brief series. RAND research briefs present policy-oriented summaries of individual published, peer-reviewed documents or of a body of published work.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.