Forecast comparisons in unstable environments

Published

Journal Article

We propose new methods for comparing the out-of-sample forecasting performance of two competing models in the presence of possible instabilities. The main idea is to develop a measure of the relative local forecasting performance for the two models, and to investigate its stability over time by means of statistical tests. We propose two tests (the Fluctuation test and the One-Time Reversal test) that analyze the evolution of the models' relative performance over historical samples. In contrast to previous approaches to forecast comparison, which are based on measures of global performance, we focus on the entire time path of the models' relative performance, which may contain useful information that is lost when looking for the model that forecasts best on average. We apply our tests to the analysis of the time variation in the out-of-sample forecasting performance of monetary models of exchange rate determination relative to the random walk. © 2010 John Wiley & Sons, Ltd.

Full Text

Cited Authors

  • Giacomini, R; Rossi, B

Published Date

  • June 1, 2010

Published In

Volume / Issue

  • 25 / 4

Start / End Page

  • 595 - 620

Electronic International Standard Serial Number (EISSN)

  • 1099-1255

International Standard Serial Number (ISSN)

  • 0883-7252

Digital Object Identifier (DOI)

  • 10.1002/jae.1177

Citation Source

  • Scopus