Properties of Optimal Forecasts
Abstract
Evaluation of forecast optimality in economics and finance has almost exclusively been conducted under the assumption of mean squared error loss. Under this loss function optimal forecasts should be unbiased and forecast errors serially uncorrelated at the single-period horizon with increasing variance as the forecast horizon grows. Using analytical results we show in this Paper that all the standard properties of optimal forecasts can be invalid under asymmetric loss and non-linear data-generating processes and thus may be very misleading as a benchmark for an optimal forecast. Our theoretical results suggest that many of the conclusions in the empirical literature concerning sub-optimality of forecasts could be premature. We extend the properties that an optimal forecast should have to a more general setting than previously considered in the literature. We also present new results on forecast error properties that may be tested when the forecaster's loss function is unknown but restrictions can be imposed on the data-generating process, and introduce a change of measure, following which the optimum forecast errors for general loss functions have the same properties as optimum errors under MSE loss.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic Info
Paper provided by C.E.P.R. Discussion Papers in its series CEPR Discussion Papers with number 4037.Length:
Date of creation: Aug 2003
Date of revision:
Handle: RePEc:cpr:ceprdp:4037
Contact details of provider:
Postal: Centre for Economic Policy Research, 77 Bastwick Street, London EC1V 3PZ
Phone: 44 - 20 - 7183 8801
Fax: 44 - 20 - 7183 8820
Order Information:
Email:
Related research
Keywords: efficient markets; forecast evaluation; loss function; rationality;Other versions of this item:
- Allan Timmermann & Andrew J. Patton, 2004. "Properties of Optimal Forecasts," Econometric Society 2004 North American Winter Meetings 234, Econometric Society.
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
This paper has been announced in the following NEP Reports:
- NEP-ALL-2004-06-13 (All new papers)
- NEP-ECM-2003-10-05 (Econometrics)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Corradi, Valentina & Swanson, Norman R., 2002.
"A consistent test for nonlinear out of sample predictive accuracy,"
Journal of Econometrics,
Elsevier, vol. 110(2), pages 353-381, October.
- Corradi, V. & Swanson, N.R., 2000. "A Consistent Test for Nonlinear Out of Sample Predictive Accuracy," Discussion Papers 0012, Exeter University, Department of Economics.
- Dokko, Yoon & Edelstein, Robert H, 1989. "How Well Do Economists Forecast Stock Market Prices? A Study of the Livingston Surveys," American Economic Review, American Economic Association, vol. 79(4), pages 865-71, September.
- Spyros Skouras, 2001.
"Decisionmetrics: A Decision-Based Approach to Econometric Modeling,"
Working Papers
01-11-064, Santa Fe Institute.
- Skouras, Spyros, 2007. "Decisionmetrics: A decision-based approach to econometric modelling," Journal of Econometrics, Elsevier, vol. 137(2), pages 414-440, April.
- Francis X. Diebold & Jose A. Lopez, 1995.
"Forecast evaluation and combination,"
Research Paper
9525, Federal Reserve Bank of New York.
- Francis X. Diebold & Jose A. Lopez, 1996. "Forecast Evaluation and Combination," NBER Technical Working Papers 0192, National Bureau of Economic Research, Inc.
- Drost, Feike C & Nijman, Theo E, 1993.
"Temporal Aggregation of GARCH Processes,"
Econometrica,
Econometric Society, vol. 61(4), pages 909-27, July.
- Drost, F.C. & Nijman, T.E., 1990. "Temporal aggregation of GARCH processes," Discussion Paper 1990-66, Tilburg University, Center for Economic Research.
- Drost, F.C. & Nijman, T.E., 1992. "Temporal aggregation of GARCH processes," Discussion Paper 1992-40, Tilburg University, Center for Economic Research.
- Drost, F.C. & Nijman, T.E., 1993. "Temporal aggregation of GARCH processes," Open Access publications from Tilburg University urn:nbn:nl:ui:12-153273, Tilburg University.
- Drost, F.C. & Nijman, T.E., 1990. "Temporal Aggregation Of Garch Processes," Papers 9066, Tilburg - Center for Economic Research.
- Drost, F.C. & Nijman, T.E., 1992. "Temporal Aggregation of Garch Processes," Papers 9240, Tilburg - Center for Economic Research.
- Elliott, Graham & Komunjer, Ivana & Timmermann, Allan G, 2003. "Estimating Loss Function Parameters," CEPR Discussion Papers 3821, C.E.P.R. Discussion Papers.
- Pesando, James E, 1975. "A Note on the Rationality of the Livingston Price Expectations," Journal of Political Economy, University of Chicago Press, vol. 83(4), pages 849-58, August.
- Kenneth D. West & Hali J. Edison & Dongchul Cho, 1993.
"A utility based comparison of some models of exchange rate volatility,"
International Finance Discussion Papers
441, Board of Governors of the Federal Reserve System (U.S.).
- West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
- Kenneth D. West & Hali J. Edison & Dongchul Cho, 1992. "A Utility Based Comparison of Some Models of Exchange Rate Volatility," NBER Technical Working Papers 0128, National Bureau of Economic Research, Inc.
- Frederic S. Mishkin, 1983.
"Are Market Forecasts Rational?,"
NBER Chapters,
in: A Rational Expectations Approach to Macroeconomics: Testing Policy Ineffectiveness and Efficient-Markets Models, pages 59-75
National Bureau of Economic Research, Inc.
- Mishkin, Frederic S, 1981. "Are Market Forecasts Rational?," American Economic Review, American Economic Association, vol. 71(3), pages 295-306, June.
- Frederic S. Mishkin, 1981. "Are Market Forecasts Rational?," NBER Working Papers 0507, National Bureau of Economic Research, Inc.
- Sentana, E., 1997.
"Least Squares Predictions and Mean-Variance Analysis,"
Papers
9711, Centro de Estudios Monetarios Y Financieros-.
- Enrique Sentana, 2005. "Least Squares Predictions and Mean-Variance Analysis," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 3(1), pages 56-78.
- Sentana, Enrique, 1999. "Least Squares Predictions and Mean-Variance Analysis," CEPR Discussion Papers 2088, C.E.P.R. Discussion Papers.
- Enrique Sentana & Enrique Sentana, 1999. "Least Squares Predictions and Mean-Variance Analysis," FMG Discussion Papers dp312, Financial Markets Group.
- Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
- repec:cup:etheor:v:7:y:1991:i:2:p:222-35 is not listed on IDEAS
- Peter Christoffersen & Kris Jacobs, 2003.
"The Importance of the Loss Function in Option Valuation,"
CIRANO Working Papers
2003s-52, CIRANO.
- Christoffersen, Peter & Jacobs, Kris, 2004. "The importance of the loss function in option valuation," Journal of Financial Economics, Elsevier, vol. 72(2), pages 291-318, May.
- Michael P. Keane & David E. Runkle, 1998. "Are Financial Analysts' Forecasts of Corporate Profits Rational?," Journal of Political Economy, University of Chicago Press, vol. 106(4), pages 768-805, August.
- Zarnowitz, Victor, 1985. "Rational Expectations and Macroeconomic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(4), pages 293-311, October.
- Cargill, Thomas F & Meyer, Robert A, 1980. " The Term Structure of Inflationary Expectations and Market Efficiency," Journal of Finance, American Finance Association, vol. 35(1), pages 57-70, March.
- Hoque, Asraul & Magnus, Jan R. & Pesaran, Bahram, 1988. "The exact multi-period mean-square forecast error for the first-order autoregressive model," Journal of Econometrics, Elsevier, vol. 39(3), pages 327-346, November.
- Christoffersen, Peter F. & Diebold, Francis X., 1997.
"Optimal Prediction Under Asymmetric Loss,"
Econometric Theory,
Cambridge University Press, vol. 13(06), pages 808-817, December.
- Peter F. Christoffersen & Francis X. Diebold, 1997. "Optimal prediction under asymmetric loss," Working Papers 97-11, Federal Reserve Bank of Philadelphia.
- Peter F. Christoffersen & Francis X. Diebold, 1994. "Optimal Prediction Under Asymmetric Loss," NBER Technical Working Papers 0167, National Bureau of Economic Research, Inc.
- Christoffersen & Diebold, . "Optimal Prediction Under Asymmetric Loss," Home Pages 167, 1996., University of Pennsylvania.
- Peter F. Christoffersen & Francis X. Diebold, . "Optimal Prediction Under Asymmetric Loss," CARESS Working Papres 97-20, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-84, March.
- Magnus, Jan R. & Pesaran, Bahram, 1989. "The exact multi-period mean-square forecast error for the first-order autoregressive model with an intercept," Journal of Econometrics, Elsevier, vol. 42(2), pages 157-179, October.
- Lakonishok, Josef, 1980. " Stock Market Return Expectations: Some General Properties," Journal of Finance, American Finance Association, vol. 35(4), pages 921-31, September.
- repec:cup:etheor:v:13:y:1997:i:6:p:808-17 is not listed on IDEAS
- Clive W.J. Granger, 1999. "Outline of forecast theory using generalized cost functions," Spanish Economic Review, Springer, vol. 1(2), pages 161-173.
- Granger, C.W.J. & Pesaran, M. H., 1999. "Economic and Statistical Measures of Forecast Accuracy," Cambridge Working Papers in Economics 9910, Faculty of Economics, University of Cambridge.
- Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
- De Bondt, Werner F M & Thaler, Richard H, 1990. "Do Security Analysts Overreact?," American Economic Review, American Economic Association, vol. 80(2), pages 52-57, May.
- Clements, Michael P. & Hendry, David F., 1998. "Forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 14(1), pages 111-131, March.
- Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Pablo Pincheira, 2006. "Shrinkage Based Tests of the Martingale Difference Hypothesis," Working Papers Central Bank of Chile 376, Central Bank of Chile.
- Anatolyev, Stanislav, 2009.
"Dynamic modeling under linear-exponential loss,"
Economic Modelling,
Elsevier, vol. 26(1), pages 82-89, January.
- Stanislav Anatolyev, 2006. "Dynamic modeling under linear-exponential loss," Working Papers w0092, Center for Economic and Financial Research (CEFIR).
- Capistrán, Carlos, 2008.
"Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?,"
Journal of Monetary Economics,
Elsevier, vol. 55(8), pages 1415-1427, November.
- Carlos Capistrán, 2006. "Bias in Federal Reserve Inflation Forecasts: Is the Federal Reserve Irrational or Just Cautious?," Working Papers 2006-14, Banco de México.
- Carlos Capistrán-Carmona, 2005. "Bias in Federal Reserve Inflation Forecasts: Is the Federal Reserve Irrational or Just Cautious?," Computing in Economics and Finance 2005 127, Society for Computational Economics.
- Carmona, Carlos Capistran, 2005. "Bias in Federal Reserve Inflation Forecasts: Is the Federal Reserve Irrational or Just Cautious?," University of California at San Diego, Economics Working Paper Series qt6v28v0b6, Department of Economics, UC San Diego.
- Patton, Andrew J., 2011.
"Volatility forecast comparison using imperfect volatility proxies,"
Journal of Econometrics,
Elsevier, vol. 160(1), pages 246-256, January.
- Andrew Patton, 2006. "Volatility Forecast Comparison using Imperfect Volatility Proxies," Research Paper Series 175, Quantitative Finance Research Centre, University of Technology, Sydney.
- Romulo A. Chumacero, 2004.
"Forecasting Chilean Industrial Production and Sales with Automated Procedures,"
Computing in Economics and Finance 2004
112, Society for Computational Economics.
- Rómulo Chumacero E., 2004. "Forecasting Chilean Industrial Production and Sales With Automated Procedures," Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 7(3), pages 47-56, December.
- Rómulo Chumacero, 2004. "Forecasting Chilean Industrial Production and Sales with Automated Procedures," Working Papers Central Bank of Chile 260, Central Bank of Chile.
- McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
- Elliott, Graham & Komunjer, Ivana & Timmermann, Allan G, 2003. "Estimating Loss Function Parameters," CEPR Discussion Papers 3821, C.E.P.R. Discussion Papers.
- Timmermann, Allan G, 2005.
"Forecast Combinations,"
CEPR Discussion Papers
5361, C.E.P.R. Discussion Papers.
- Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, Elsevier.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, School of Economics and Management, University of Aarhus.
- Romulo A. Chumacero, 2004. "Forecasting Chilean Industrial Production with Automated Procedures," Econometric Society 2004 Latin American Meetings 177, Econometric Society.
- Carlos Capistrán & Gabriel López-Moctezuma, 2008. "Experts´ Macroeconomics Expectations: An Evaluation of Mexican Short-Run Forecasts," Working Papers 2008-11, Banco de México.
- Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
- Andrew J. Patton & Allan Timmermann, 2005. "Testable Implications of Forecast Optimality," STICERD - Econometrics Paper Series /2005/485, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:4037For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

