In an evaluation of a pension program in Yucatan, researchers found that low literacy, language barriers, and cultural biases hindered older adult respondents' ability to answer mortality-expectation questions and experimented with new ways of asking the questions. They tried variations of the questions with and without visual aids. They report here what they learned for constructing subsequent survey items.

Mortality Expectations of Older Mexicans

Development and Testing of Survey Measures

Emma Aguila, Abril Borges, Cielo Margot Castillejos, Ashley Pierson, Beverly A. Weidmer

ResearchPublished May 6, 2014

Individual subjective forecasts of one's own mortality or survival, referred to as mortality expectations, can affect economic decisions, such as consumption and saving. Such measures may be particularly useful when evaluating social programs serving older populations or otherwise analyzing populations with potentially high mortality rates. In an evaluation of a pension program in Yucatan, researchers found that low literacy, language barriers, and cultural biases hindered older adult respondents' ability to answer mortality-expectation questions and experimented with new ways of asking the questions. The initial version of the questions used a ruler with a numeric scale representing a percentage chance of living five more years. Researchers tried direct and indirect versions of the questions, versions with possible answers being contingent on answers to previous questions, and versions incorporating use of visual aids, and combinations of these variations. Through cognitive interviewing, they studied how respondents understood, processed, and responded to the survey items. They then used what they learned to revise the survey measures. The visual aids tested were the original numeric-scale ruler, a sliding ruler, stones, and stick figures. With their survey population, they had the most success using the stick figures for conditional questions and the stones for direct questions.

Key Findings

Respondents Experienced Several Difficulties in Reporting Their Mortality Expectations

  • Interviewers reported the most difficulties with respondents who had low levels of education or literacy, language barriers, bias against the nature of the question, or trouble seeing or understanding visual aids.
  • Interviewer error or method could also be a factor.

The Original Mortality-Expectation Question Did Not Work Well

  • Given interviewer debriefings, analysis of nonresponse, and interviewer comments, the question originally asked on the baseline and follow-up surveys (the chances of living to be a certain age) did not work well.

Other Ways of Asking the Question Can Yield Better Results

  • In U.S. interviews, the stick figures and the corresponding question series appeared to work well.
  • In Mexico interviews, the stones with the direct, unconditional series and the stick figures with the indirect, conditional series worked best.
  • Cognitive interviewing in this population can provide valuable information on how respondents understand survey items.
  • Some visual aids might hinder rather than help in eliciting a response.
  • In a population with low levels of literacy, eliciting numerical answers poses a particular challenge.
  • In an older Mexican population with low levels of education and a high percentage of Mayan speakers, asking respondents to think of others like themselves (using the visual aid of the stick figures) was helpful, as was the visual aid of stones paired with direct mortality-expectation questions.

Recommendation

  • Test survey items using cognitive interviews with small groups of respondents prior to including those items on a larger survey.

Topics

Document Details

  • Copyright: RAND Corporation
  • Availability: Web-Only
  • Year: 2014
  • Pages: 52
  • Document Number: TR-1288/6-SOY-NIA

Citation

RAND Style Manual
Aguila, Emma, Abril Borges, Cielo Margot Castillejos, Ashley Pierson, and Beverly A. Weidmer, Mortality Expectations of Older Mexicans: Development and Testing of Survey Measures, RAND Corporation, TR-1288/6-SOY-NIA, 2014. As of September 18, 2024: https://www.rand.org/pubs/technical_reports/TR1288z6.html
Chicago Manual of Style
Aguila, Emma, Abril Borges, Cielo Margot Castillejos, Ashley Pierson, and Beverly A. Weidmer, Mortality Expectations of Older Mexicans: Development and Testing of Survey Measures. Santa Monica, CA: RAND Corporation, 2014. https://www.rand.org/pubs/technical_reports/TR1288z6.html.
BibTeX RIS

The research described in this report was made possible with funding from the government of the state of Yucatan, the U.S. National Institute on Aging (NIA), the RAND Center for the Study of Aging, RAND Labor and Population, and the Center for Latin American Social Policy (CLASP).

This publication is part of the RAND technical report series. RAND technical reports, products of RAND from 2003 to 2011, presented research findings on a topic limited in scope or intended for a narrow audience; discussions of the methodology employed in research; literature reviews, survey instruments, modeling exercises, guidelines for practitioners and research professionals, and supporting documentation; and preliminary findings. All RAND technical reports were subject to rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.