On economic evaluation of directional forecasts
AbstractIt is commonly accepted that information is helpful if it can be exploited to improve a decision making process. In economics, decisions are often based on forecasts of the upward or downward movements of the variable of interest. We point out that directional forecasts can provide a useful framework for assessing the economic forecast value when loss functions (or success measures) are properly formulated to account for the realized signs and realized magnitudes of directional movements. We discuss a general approach to (directional) forecast evaluation which is based on the loss function proposed by Granger, Pesaran and Skouras. It is simple to implement and provides an economically interpretable loss/success functional framework. We show that, in addition, this loss function is more robust to outlying forecasts than traditional loss functions. As such, the measure of the directional forecast value is a readily available complement to the commonly used squared error loss criterion.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal International Journal of Forecasting.
Volume (Year): 27 (2011)
Issue (Month): 4 (October)
Contact details of provider:
Web page: http://www.elsevier.com/locate/ijforecast
Directional forecasts Directional forecast value Forecast evaluation Economic forecast value Mean squared forecast error Mean absolute forecast error;
Other versions of this item:
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
- E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
- E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications
- F17 - International Economics - - Trade - - - Trade Forecasting and Simulation
- F - International Economics
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Rob J. Hyndman & Anne B. Koehler, 2005.
"Another Look at Measures of Forecast Accuracy,"
Monash Econometrics and Business Statistics Working Papers
13/05, Monash University, Department of Econometrics and Business Statistics.
- Elliott, Graham & Timmermann, Allan G, 2007.
CEPR Discussion Papers
6158, C.E.P.R. Discussion Papers.
- Makridakis, Spyros, 1993. "Accuracy measures: theoretical and practical concerns," International Journal of Forecasting, Elsevier, vol. 9(4), pages 527-529, December.
- Spyros Skouras, 1998.
"Financial Returns and Efficiency as seen by an Artificial Technical Analyst,"
9808001, EconWPA, revised 24 Aug 1998.
- Skouras, Spyros, 2001. "Financial returns and efficiency as seen by an artificial technical analyst," Journal of Economic Dynamics and Control, Elsevier, vol. 25(1-2), pages 213-244, January.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Peter F. Christoffersen & Francis X. Diebold, .
"Optimal Prediction Under Asymmetric Loss,"
CARESS Working Papres
97-20, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Peter F. Christoffersen & Francis X. Diebold, 1997. "Optimal prediction under asymmetric loss," Working Papers 97-11, Federal Reserve Bank of Philadelphia.
- Christoffersen & Diebold, . "Optimal Prediction Under Asymmetric Loss," Home Pages 167, 1996., University of Pennsylvania.
- Peter F. Christoffersen & Francis X. Diebold, 1994. "Optimal Prediction Under Asymmetric Loss," NBER Technical Working Papers 0167, National Bureau of Economic Research, Inc.
- Pesaran, M.H. & Timmermann, A., 1990.
"A Simple Non-Parametric Test Of Predictive Performance,"
29, California Los Angeles - Applied Econometrics.
- Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-65, October.
- Pesaran, M.H. & Timmermann, A., 1990. "A Simple, Non-Parametric Test Of Predictive Performance," Cambridge Working Papers in Economics 9021, Faculty of Economics, University of Cambridge.
- Oliver Blaskowitz & Helmut Herwatz, 2008.
"Adaptive Forecasting of the EURIBOR Swap Term Structure,"
SFB 649 Discussion Papers
SFB649DP2008-017, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
- Oliver Blaskowitz & Helmut Herwartz, 2009. "Adaptive forecasting of the EURIBOR swap term structure," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(7), pages 575-594.
- Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," The Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July.
- Anatolyev, Stanislav & Gerko, Alexander, 2005. "A Trading Approach to Testing for Predictability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 455-461, October.
- Öller, Lars-Erik & Barot, Bharat, 2000.
"The Accuracy of European Growth and Inflation Forecasts,"
72, National Institute of Economic Research.
- Oller, Lars-Erik & Barot, Bharat, 2000. "The accuracy of European growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 16(3), pages 293-315.
- West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993.
"A utility-based comparison of some models of exchange rate volatility,"
Journal of International Economics,
Elsevier, vol. 35(1-2), pages 23-45, August.
- Kenneth D. West & Hali J. Edison & Dongchul Cho, 1992. "A Utility Based Comparison of Some Models of Exchange Rate Volatility," NBER Technical Working Papers 0128, National Bureau of Economic Research, Inc.
- Kenneth D. West & Hali J. Edison & Dongchul Cho, 1993. "A utility based comparison of some models of exchange rate volatility," International Finance Discussion Papers 441, Board of Governors of the Federal Reserve System (U.S.).
- Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
- Oliver Blaskowitz & Helmut Herwartz, 2009. "Pca-Based Ex-Ante Forecasting Of Swap Term Structures," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 12(04), pages 465-489.
- Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-33, October.
- Helmut Herwartz & Konstantin A. Kholodilin, 2011. "In-Sample and Out-of-Sample Prediction of Stock Market Bubbles: Cross-Sectional Evidence," Discussion Papers of DIW Berlin 1173, DIW Berlin, German Institute for Economic Research.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.