Identifying the Effects of Unjustified Confidence versus Overconfidence

Lessons Learned from Two Analytic Methods

by Andrew M. Parker, Eric R. Stone

Download eBook for Free

FormatFile SizeNotes
PDF file 0.3 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

One of the most common findings in behavioral decision research is that people often have unrealistic beliefs about how much they know, but only recently have researchers begun to examine the consequences of these unrealistic beliefs. Unfortunately, examination of this issue is complicated by the use of different ways of characterizing unrealistic beliefs about one’s knowledge. This paper examines the implications of two common measures – labeled overconfidence and unjustified confidence – showing how and where they can lead to different conclusions when used for prediction. The authors first consider conceptual, measurement, and analytic issues distinguishing these measures. Next, they provide a set of simulations designed to elucidate when these two different methods of characterizing unrealistic beliefs about one’s knowledge will lead to different conclusions. Finally, they illustrate the main findings from the simulations with three empirical examples drawn from our own data. The results highlight the need for clarity in the match between research question and measurement strategy.

This paper series was made possible by the NIA funded RAND Center for the Study of Aging and the NICHD funded RAND Population Research Center.

This report is part of the RAND Corporation Working paper series. RAND working papers are intended to share researchers' latest findings and to solicit informal peer review. They have been approved for circulation by RAND but may not have been formally edited or peer reviewed.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.