Cover: Measuring Probability Numeracy

Measuring Probability Numeracy

Published Sep 25, 2018

by Peter Hudomiet, Michael D. Hurd, Susann Rohwedder

Download eBook for Free

FormatFile SizeNotes
PDF file 0.8 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

Download Support Files

Mergeable probability numeracy scores

FormatFile SizeNotes
zip file 3 MB

The file(s) provided above are ZIP-formatted archives, which most modern systems can natively unpack. If your computer does not unpack the archive when you double-click it, you may need to use a separate decompression program such as UnZip.

Probability numeracy is the ability of individuals to think in probabilistic terms and use probabilities effectively in everyday life. Measuring probability numeracy helps to understand how well individuals can plan for uncertainty, such as the likelihood of losing a job over the next year, and to identify groups who make suboptimal life decisions because of their limited understanding of probabilities. In this paper, we explore different batteries of questions to measure levels of numeracy. We do so by examining questions asked in the American Life Panel Financial Crisis Survey. We describe methods to create various versions of the numeracy score based on Item Response Theory. We evaluate the performance of alternative scores in predicting the quality of answers to subjective probability questions in the survey. We identify a four-item battery that captures relevant variation in probability numeracy; it takes about 90 seconds of survey time. We show that adding demographic covariates (e.g. gender, age, education, race) significantly improves properties of the score, but some additions such as education pose challenges for comparisons across cohorts or countries because of the differences in the meaning of these measures.

This research was conducted by RAND Labor and Population.

This report is part of the RAND working paper series. RAND working papers are intended to share researchers' latest findings and to solicit informal peer review. They have been approved for circulation by RAND but may not have been formally edited or peer reviewed.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.