Reliability and consensus of experienced wine judges: Expertise within and between


Book Section

© The American Association of Wine Economists, 2012. This chapter considers the levels of reliability and consensus of wine quality judgments found in studies of experienced wine judges. Both reliability, which concerns the similarity of repeat judgments of a particular wine by the same judge, and consensus, which concerns the similarity of judgments of a particular wine across judges, are necessary requirements for expertise in wine judging. Reliability and consensus levels found in wine judging are compared to those documented by a large body of research in six other fields: medicine, clinical psychology, business, auditing, personnel management, and meteorology. In all fields, including wine judging, reliability is greater than consensus. Both reliability and consensus are, on average, substantially lower in wine judging than in other fields, although tremendous variability exists across judges in every field. Overall, little support is found for the idea that experienced wine judges should be regarded as experts.

Full Text

Duke Authors

Cited Authors

  • Ashton, RH

Published Date

  • January 1, 2018

Volume / Issue

  • 6 /

Book Title

  • World Scientific Handbook in Financial Economics Series

Start / End Page

  • 413 - 433

Digital Object Identifier (DOI)

  • 10.1142/9789813232747_0019

Citation Source

  • Scopus