Skip to main content
Journal cover image

Log-Optimal Economic Evaluation of Probability Forecasts

Publication ,  Journal Article
Johnstone, DJ
Published in: Journal of the Royal Statistical Society Series A: Statistics in Society
July 1, 2012

The commercial test of an expert’s probability assessments is not that they are accurate in an abstract sense, but that they yield financial returns to decision makers. From this utilitarian standpoint, a model or forecaster is merely a font of cash pay-offs, like any other form of asset or security. The modern perspective in finance theory is that individual ‘securities’ (sources of cash pay-offs) must be valued in portfolio rather than of themselves. Applying portfolio methods to forecast evaluation, the theoretical worth of a forecast depends on its marginal contribution to the best available portfolio of securities. When considered within a log-optimal (maximum E[ log (wealth)]) portfolio, the value of an individual forecast (or forecaster) depends on both its expected cash pay-off and the covariance of its pay-off with those from all other available securities. In effect, portfolio theory rewards forecasters more for making accurate forecasts when other forecasters (or, more broadly, other sources of pay-offs) perform badly than when all or most forecasters do well. Conversely, the penalty for being wrong is reduced when other forecasters are right. This has the effect of promoting original thinking and unique (idiosyncratic) forecasting expertise. Herding by resort to industry standard models or routines is discouraged.

Duke Scholars

Published In

Journal of the Royal Statistical Society Series A: Statistics in Society

DOI

EISSN

1467-985X

ISSN

0964-1998

Publication Date

July 1, 2012

Volume

175

Issue

3

Start / End Page

661 / 689

Publisher

Oxford University Press (OUP)

Related Subject Headings

  • Statistics & Probability
  • 1603 Demography
  • 1403 Econometrics
  • 0104 Statistics
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Johnstone, D. J. (2012). Log-Optimal Economic Evaluation of Probability Forecasts. Journal of the Royal Statistical Society Series A: Statistics in Society, 175(3), 661–689. https://doi.org/10.1111/j.1467-985x.2011.01011.x
Johnstone, D. J. “Log-Optimal Economic Evaluation of Probability Forecasts.” Journal of the Royal Statistical Society Series A: Statistics in Society 175, no. 3 (July 1, 2012): 661–89. https://doi.org/10.1111/j.1467-985x.2011.01011.x.
Johnstone DJ. Log-Optimal Economic Evaluation of Probability Forecasts. Journal of the Royal Statistical Society Series A: Statistics in Society. 2012 Jul 1;175(3):661–89.
Johnstone, D. J. “Log-Optimal Economic Evaluation of Probability Forecasts.” Journal of the Royal Statistical Society Series A: Statistics in Society, vol. 175, no. 3, Oxford University Press (OUP), July 2012, pp. 661–89. Crossref, doi:10.1111/j.1467-985x.2011.01011.x.
Johnstone DJ. Log-Optimal Economic Evaluation of Probability Forecasts. Journal of the Royal Statistical Society Series A: Statistics in Society. Oxford University Press (OUP); 2012 Jul 1;175(3):661–689.
Journal cover image

Published In

Journal of the Royal Statistical Society Series A: Statistics in Society

DOI

EISSN

1467-985X

ISSN

0964-1998

Publication Date

July 1, 2012

Volume

175

Issue

3

Start / End Page

661 / 689

Publisher

Oxford University Press (OUP)

Related Subject Headings

  • Statistics & Probability
  • 1603 Demography
  • 1403 Econometrics
  • 0104 Statistics