An analysis of the validity of using self-rating as a technique for selecting more accurate subgroups in applications of the Delphi method for eliciting group judgments. A series of experiments was conducted using 16 groups of upper-class and graduate college students answering almanac-type questions (20 subjects per group and 20 questions per subject). The findings indicate that if the difference in average self-rating between the subgroups is substantial, and if the subgroups are held to reasonable size, both the degree of improvement and the total number of improvements are greater than when feedback alone is used. This study augments the results reported in RM-5888 and RM-5957.
This report is part of the RAND Corporation Research memorandum series. The Research Memorandum was a product of the RAND Corporation from 1948 to 1973 that represented working papers meant to report current results of RAND research to appropriate audiences.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.