Extracting the wisdom of crowds when information is shared

Journal Article (Journal Article)

Using the wisdom of crowds-combining many individual judgments to obtain an aggregate estimate-can be an effective technique for improving judgment accuracy. In practice, however, accuracy is limited by the presence of correlated judgment errors, which often emerge because information is shared. To address this problem, we propose an elicitation procedure in which respondents are asked to provide both their own best judgment and an estimate of the average judgment that will be given by all other respondents. We develop an aggregation method, called pivoting, which separates individual judgments into shared and private information and then recombines these results in the optimal manner. In several studies, we investigate the method and examine the accuracy of the aggregate estimates. Overall, the empirical data suggest that the pivoting method provides an effective judgment aggregation procedure that can significantly outperform the simple crowd average.

Full Text

Duke Authors

Cited Authors

  • Palley, AB; Soll, JB

Published Date

  • May 1, 2019

Published In

Volume / Issue

  • 65 / 5

Start / End Page

  • 2291 - 2309

Electronic International Standard Serial Number (EISSN)

  • 1526-5501

International Standard Serial Number (ISSN)

  • 0025-1909

Digital Object Identifier (DOI)

  • 10.1287/mnsc.2018.3047

Citation Source

  • Scopus