IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v29y2013i4p622-627.html
   My bibliography  Save this article

Analyzing fixed-event forecast revisions

Author

Listed:
  • Chang, Chia-Lin
  • de Bruijn, Bert
  • Franses, Philip Hans
  • McAleer, Michael

Abstract

It is common practice to evaluate fixed-event forecast revisions in macroeconomics by regressing current forecast revisions on one-period lagged forecast revisions. Under weak-form (forecast) efficiency, the correlation between the current and one-period lagged revisions should be zero. The empirical findings in the literature suggest that this null hypothesis of zero correlation is rejected frequently, and the correlation can be either positive (which is widely interpreted in the literature as “smoothing”) or negative (which is widely interpreted as “over-reacting”). We propose a methodology for interpreting such non-zero correlations in a straightforward and clear manner. Our approach is based on the assumption that numerical forecasts can be decomposed into both an econometric model and random expert intuition. We show that the interpretation of the sign of the correlation between the current and one-period lagged revisions depends on the process governing intuition, and the current and lagged correlations between intuition and news (or shocks to the numerical forecasts). It follows that the estimated non-zero correlation cannot be given a direct interpretation in terms of either smoothing or over-reaction.

Suggested Citation

  • Chang, Chia-Lin & de Bruijn, Bert & Franses, Philip Hans & McAleer, Michael, 2013. "Analyzing fixed-event forecast revisions," International Journal of Forecasting, Elsevier, vol. 29(4), pages 622-627.
  • Handle: RePEc:eee:intfor:v:29:y:2013:i:4:p:622-627
    DOI: 10.1016/j.ijforecast.2013.04.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207013000496
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2013.04.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Giampiero M. Gallo & Clive W.J. Granger & Yongil Jeon, 2002. "Copycats and Common Swings: The Impact of the Use of Forecasts in Information Sets," IMF Staff Papers, Palgrave Macmillan, vol. 49(1), pages 1-2.
    2. Dovern, Jonas & Weisser, Johannes, 2011. "Accuracy, unbiasedness and efficiency of professional macroeconomic forecasts: An empirical comparison for the G7," International Journal of Forecasting, Elsevier, vol. 27(2), pages 452-465.
    3. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    4. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2009. "Expert opinion versus expertise in forecasting," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 63(3), pages 334-346, August.
    5. Clements, Michael P., 1996. "Evaluating the rationality of fixed-event forecasts," Economic Research Papers 268705, University of Warwick - Department of Economics.
    6. Gultekin Isiklar & Kajal Lahiri & Prakash Loungani, 2006. "How quickly do forecasters incorporate news? Evidence from cross‐country surveys," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 703-725, September.
    7. Olga Isengildina & Scott H. Irwin & Darrel L. Good, 2006. "Are Revisions to USDA Crop Production Forecasts Smoothed?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(4), pages 1091-1104.
    8. Philip Hans Franses & Rianne Legerstee, 2010. "Do experts' adjustments on model-based SKU-level forecasts improve forecast quality?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 331-340.
    9. Loungani, Prakash, 2001. "How accurate are private sector forecasts? Cross-country evidence from consensus forecasts of output growth," International Journal of Forecasting, Elsevier, vol. 17(3), pages 419-432.
    10. Ager, P. & Kappler, M. & Osterloh, S., 2009. "The accuracy and efficiency of the Consensus Forecasts: A further application and extension of the pooled approach," International Journal of Forecasting, Elsevier, vol. 25(1), pages 167-181.
    11. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    12. Cho, Dong W., 2002. "Do revisions improve forecasts?," International Journal of Forecasting, Elsevier, vol. 18(1), pages 107-115.
    13. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    14. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    15. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    16. Amir, Eli & Ganzach, Yoav, 1998. "Overreaction and underreaction in analysts' forecasts," Journal of Economic Behavior & Organization, Elsevier, vol. 37(3), pages 333-347, November.
    17. Berger, Allen N & Krane, Spencer D, 1985. "The Information Efficiency of Econometric Model Forecasts," The Review of Economics and Statistics, MIT Press, vol. 67(1), pages 128-134, February.
    18. Carlos Capistrán & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2‐3), pages 365-396, March.
    19. Ashiya, Masahiro, 2003. "Testing the rationality of Japanese GDP forecasts: the sign of forecast revision matters," Journal of Economic Behavior & Organization, Elsevier, vol. 50(2), pages 263-269, February.
    20. Lawrence, Michael & O'Connor, Marcus, 2000. "Sales forecasting updates: how good are they in practice?," International Journal of Forecasting, Elsevier, vol. 16(3), pages 369-382.
    21. Franses, Philip Hans & Kranendonk, Henk C. & Lanser, Debby, 2011. "One model and various experts: Evaluating Dutch macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 482-495.
    22. Masahiro Ashiya, 2006. "Testing the rationality of forecast revisions made by the IMF and the OECD," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 25-36.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Iregui, Ana María & Núñez, Héctor M. & Otero, Jesús, 2021. "Testing the efficiency of inflation and exchange rate forecast revisions in a changing economic environment," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 290-314.
    2. Sun, Yuying & Wang, Shouyang & Zhang, Xun, 2018. "How efficient are China's macroeconomic forecasts? Evidences from a new forecasting evaluation approach," Economic Modelling, Elsevier, vol. 68(C), pages 506-513.
    3. Chia-Lin Chang & Yu-Pei Ke, 2014. "Testing Price Pressure, Information, Feedback Trading, And Smoothing Effects For Energy Exchange Traded Funds," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 9(02), pages 1-26.
    4. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    5. Tian, Jing & Goodwin, Thomas, 2018. "An unobserved component modeling approach to evaluate multi-horizon forecasts," Working Papers 2018-04, University of Tasmania, Tasmanian School of Business and Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dovern, Jonas & Weisser, Johannes, 2011. "Accuracy, unbiasedness and efficiency of professional macroeconomic forecasts: An empirical comparison for the G7," International Journal of Forecasting, Elsevier, vol. 27(2), pages 452-465, April.
    2. Franses, Ph.H.B.F., 2019. "Professional Forecasters and January," Econometric Institute Research Papers EI2019-25, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    3. Philip Hans Franses, 2020. "Correcting the January optimism effect," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(6), pages 927-933, September.
    4. Iregui, Ana María & Núñez, Héctor M. & Otero, Jesús, 2021. "Testing the efficiency of inflation and exchange rate forecast revisions in a changing economic environment," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 290-314.
    5. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    6. Stekler, H.O., 2007. "The future of macroeconomic forecasting: Understanding the forecasting process," International Journal of Forecasting, Elsevier, vol. 23(2), pages 237-248.
    7. Bruno Deschamps & Christos Ioannidis, 2014. "The Efficiency of Multivariate Macroeconomic Forecasts," Manchester School, University of Manchester, vol. 82(5), pages 509-523, September.
    8. Philip Hans Franses & Max Welz, 2020. "Does More Expert Adjustment Associate with Less Accurate Professional Forecasts?," JRFM, MDPI, vol. 13(3), pages 1-8, March.
    9. Sun, Yuying & Wang, Shouyang & Zhang, Xun, 2018. "How efficient are China's macroeconomic forecasts? Evidences from a new forecasting evaluation approach," Economic Modelling, Elsevier, vol. 68(C), pages 506-513.
    10. Frenkel, Michael & Rülke, Jan-Christoph & Zimmermann, Lilli, 2013. "Do private sector forecasters chase after IMF or OECD forecasts?," Journal of Macroeconomics, Elsevier, vol. 37(C), pages 217-229.
    11. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    12. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2013. "Information Rigidities in Economic Growth Forecasts: Evidence from a Large International Panel," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79936, Verein für Socialpolitik / German Economic Association.
    13. Xie, Zixiong & Hsu, Shih-Hsun, 2016. "Time varying biases and the state of the economy," International Journal of Forecasting, Elsevier, vol. 32(3), pages 716-725.
    14. Deschamps, Bruno & Ioannidis, Christos & Ka, Kook, 2020. "High-frequency credit spread information and macroeconomic forecast revision," International Journal of Forecasting, Elsevier, vol. 36(2), pages 358-372.
    15. Masahiro Ashiya, 2006. "Testing the rationality of forecast revisions made by the IMF and the OECD," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 25-36.
    16. Philip Hans Franses, 2021. "Modeling Judgment in Macroeconomic Forecasts," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 401-417, December.
    17. Rybacki, Jakub, 2020. "Polish GDP Forecast Errors: A Tale of Ineffectiveness," MPRA Paper 98952, University Library of Munich, Germany.
    18. Jakub Rybacki, 2021. "Polish GDP forecast errors: a tale of inefficiency," Bank i Kredyt, Narodowy Bank Polski, vol. 52(2), pages 123-142.
    19. Deschamps, Bruno & Ioannidis, Christos, 2013. "Can rational stubbornness explain forecast biases?," Journal of Economic Behavior & Organization, Elsevier, vol. 92(C), pages 141-151.
    20. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.

    More about this item

    Keywords

    Evaluating forecasts; Macroeconomic forecasting; Rationality; Intuition; Weak-form efficiency; Fixed-event forecasts;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:29:y:2013:i:4:p:622-627. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.