IDEAS home Printed from https://ideas.repec.org/p/chb/bcchwp/556.html
   My bibliography  Save this paper

A Real Time Evaluation of the Central Bank of Chile GDP Growth Forecasts

Author

Listed:
  • Pablo Pincheira

Abstract

In this paper we evaluate the Central Bank of Chile annual GDP growth forecasts over the period 1991-2009 using a real-time database. We compare the Central Bank of Chile forecasts with those of the Survey of Professional Forecasters (SPF), Consensus Forecasts, and simple time-series models. We compare all forecasts to first and quasi-final GDP growth vintages. We evaluate a number of different forecast properties, including forecast accuracy and efficiency. We report mixed results in terms of root mean squared prediction errors. Depending on the sample period, the forecast horizon and the vintage used in the analysis, forecasts from the Central Bank of Chile may outperform or be outperformed by the benchmarks. Despite these mixed results, differences in root mean squared prediction errors are generally moderate and have no statistical significance. Nevertheless, our efficiency analysis, in addition to the fact that in some periods the forecasts produced by the Central Bank of Chile have been outperformed by alternative forecasts, opens the question about the room for improvement in the accuracy of the Central Bank of Chile forecasts. While the room for improvement may actually exist, our results suggest that this room seems to be small for point forecasts and larger for interval forecasts.

Suggested Citation

  • Pablo Pincheira, 2010. "A Real Time Evaluation of the Central Bank of Chile GDP Growth Forecasts," Working Papers Central Bank of Chile 556, Central Bank of Chile.
  • Handle: RePEc:chb:bcchwp:556
    as

    Download full text from publisher

    File URL: https://www.bcentral.cl/documents/33528/133326/DTBC_556.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Paul Cashin & C. John McCDermott, 2002. "The Long-Run Behavior of Commodity Prices: Small Trends and Big Variability," IMF Staff Papers, Palgrave Macmillan, vol. 49(2), pages 1-2.
    2. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    3. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    4. Michael Pedersen, 2013. "Extracting GDP signals from the monthly indicator of economic activity: Evidence from Chilean real-time data," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(1), pages 1-16.
    5. Martin Ellison & Thomas J. Sargent, 2012. "A Defense Of The Fomc," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(4), pages 1047-1065, November.
    6. Eduardo Borensztein & Carmen M. Reinhart, 1994. "The Macroeconomic Determinants of Commodity Prices," IMF Staff Papers, Palgrave Macmillan, vol. 41(2), pages 236-261, June.
    7. Dale F. Gray & Carlos J. García & Leonardo Luna & Jorge E. Restrepo, 2011. "Incorporating Financial Sector Risk Into Monetary Policy Models: Application to Chile," Central Banking, Analysis, and Economic Policies Book Series, in: Rodrigo Alfaro (ed.),Financial Stability, Monetary Policy, and Central Banking, edition 1, volume 15, chapter 6, pages 159-197, Central Bank of Chile.
    8. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    9. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    10. Carmen M. Reinhart & Peter Wickham, 1994. "Commodity Prices: Cyclical Weakness or Secular Decline?," IMF Staff Papers, Palgrave Macmillan, vol. 41(2), pages 175-213, June.
    11. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    12. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    13. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    14. McCulloch, Robert & Rossi, Peter E., 1990. "Posterior, predictive, and utility-based approaches to testing the arbitrage pricing theory," Journal of Financial Economics, Elsevier, vol. 28(1-2), pages 7-38.
    15. Calista Cheung & Sylvie Morin, 2007. "The Impact of Emerging Asia on Commodity Prices," Money Affairs, CEMLA, vol. 0(2), pages 181-224, July-Dece.
    16. Selim Elekdag & René Lalonde & Douglas Laxton & Dirk Muir & Paolo Pesenti, 2008. "Oil Price Movements and the Global Economy: A Model-Based Assessment," IMF Staff Papers, Palgrave Macmillan, vol. 55(2), pages 297-311, June.
    17. Dalibor S. Eterovic, 2011. "Institutional Bias towards the Status Quo," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 167(3), pages 489-514, September.
    18. K. Newey, Whitney, 1985. "Generalized method of moments specification testing," Journal of Econometrics, Elsevier, vol. 29(3), pages 229-256, September.
    19. Groen, Jan J.J. & Kapetanios, George & Price, Simon, 2009. "A real time evaluation of Bank of England forecasts of inflation and growth," International Journal of Forecasting, Elsevier, vol. 25(1), pages 74-80.
    20. Bentancor, Andrea & Pincheira, Pablo, 2010. "Predicción de errores de proyección de inflación en Chile," El Trimestre Económico, Fondo de Cultura Económica, vol. 0(305), pages 129-154, enero-mar.
    21. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    22. Marcus Cobb, 2009. "Forecasting Chilean Inflation From Disaggregate Components," Working Papers Central Bank of Chile 545, Central Bank of Chile.
    23. Carlos Bowles & Roberta Friz & Veronique Genre & Geoff Kenny & Aidan Meyler & Tuomas Rautanen, 2007. "The ECB survey of professional forecasters (SPF) – A review after eight years’ experience," Occasional Paper Series 59, European Central Bank.
    24. René Lalonde & Zhenhua Zhu & Frédérick Demers, 2003. "Forecasting and Analyzing World Commodity Prices," Money Affairs, CEMLA, vol. 0(1), pages 1-30, January-J.
    25. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    26. Pincheira Brown, Pablo & Rubio Hurtado, Hernán, 2015. "El escaso poder predictivo de simples curvas de Phillips en Chile," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), August.
    27. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    28. Chumacero, Romulo A, 2001. "Empirical Analysis of Systematic Errors in Chilean GDP Forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(1), pages 37-45, January.
    29. Dalibor Eterovic, 2009. "Policy Reform Under Electoral Uncertainty," Working Papers Central Bank of Chile 546, Central Bank of Chile.
    30. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    31. Andersson, Michael K. & Karlsson, Gustav & Svensson, Josef, 2007. "The Riksbank’s Forecasting Performance," Working Paper Series 218, Sveriges Riksbank (Central Bank of Sweden).
    32. Eduardo Borensztein & Carmen M. Reinhart, 1994. "The Macroeconomic Determinants of Commodity Prices," IMF Staff Papers, Palgrave Macmillan, vol. 41(2), pages 236-261, June.
    33. Jeannine Bailliu & Patrick Blagrave & James Rossiter, 2010. "Introducing the Bank of Canada's Projection Model for the Global Economy," Technical Reports 99, Bank of Canada.
    34. Rómulo A.Chumacero & Francisco A.Gallego, 2002. "Trends and cycles in real-time," Estudios de Economia, University of Chile, Department of Economics, vol. 29(2 Year 20), pages 211-229, December.
    35. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carola Conces Binder & Rodrigo Sekkel, 2023. "Central Bank Forecasting: A Survey," Staff Working Papers 23-18, Bank of Canada.
    2. Pablo Pincheira & Hernán Rubio, 2010. "The Low Predictive Power of Simple Phillips Curves in Chile: A Real-Time Evaluation," Working Papers Central Bank of Chile 559, Central Bank of Chile.
    3. Abel Rodríguez Tirado & Marcelo Delajara & Federico Hernández Álvarez, 2016. "Nowcasting Mexico’s Short-Term GDP Growth in Real-Time: A Factor Model versus Professional Forecasters," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2016), pages 167-182, October.
    4. Pablo Pincheira & Carlos A. Medel, 2012. "Forecasting Inflation with a Simple and Accurate Benchmark: a Cross-Country Analysis," Working Papers Central Bank of Chile 677, Central Bank of Chile.
    5. Pincheira, Pablo & Hardy, Nicolas, 2021. "The Mean Squared Prediction Error Paradox," MPRA Paper 107403, University Library of Munich, Germany.
    6. Víctor Riquelme & Gabriela Riveros, 2018. "Un Indicador Contemporáneo de Actividad (ICA) para Chile," Notas de Investigación Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 21(1), pages 134-149, April.
    7. Jorge Fornero & Andrés Gatty, 2020. "Back testing fan charts of activity and inflation: the Chilean case," Working Papers Central Bank of Chile 881, Central Bank of Chile.
    8. Pablo M. Pincheira & Carlos A. Medel, 2015. "Forecasting Inflation with a Simple and Accurate Benchmark: The Case of the US and a Set of Inflation Targeting Countries," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 65(1), pages 2-29, January.
    9. Pincheira, Pablo & Hardy, Nicolas, 2022. "Correlation Based Tests of Predictability," MPRA Paper 112014, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Olivier Gervais & Ilan Kolet & René Lalonde, 2010. "A Larger Slice of a Growing Pie: the Role of Emerging Asia in Forecasting Commodity Prices," Money Affairs, CEMLA, vol. 0(1), pages 75-95, January-J.
    2. Dwight S. Jackson, 2010. "The Dynamics of Bank Spreads in the Jamaican Banking Sector: an Empirical Assessment," Money Affairs, CEMLA, vol. 0(1), pages 1-35, January-J.
    3. Andrea Betancor & Pablo Pincheira, 2008. "Forecasting Inflation Forecast Errors," Working Papers Central Bank of Chile 477, Central Bank of Chile.
    4. Pablo Pincheira & Roberto Álvarez, 2012. "Evaluation of Short Run Inflation Forecasts in Chile," Working Papers Central Bank of Chile 674, Central Bank of Chile.
    5. Pablo Pincheira, 2012. "A Joint Test of Superior Predictive Ability for Chilean Inflation Forecasts," Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 15(3), pages 04-39, December.
    6. Pablo Pincheira & Hernán Rubio, 2010. "The Low Predictive Power of Simple Phillips Curves in Chile: A Real-Time Evaluation," Working Papers Central Bank of Chile 559, Central Bank of Chile.
    7. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    8. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    9. René Lalonde & Zhenhua Zhu & Frédérick Demers, 2003. "Forecasting and Analyzing World Commodity Prices," Money Affairs, CEMLA, vol. 0(1), pages 1-30, January-J.
    10. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    11. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
    12. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    13. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    14. Luis Eduardo Arango & Fernando Arias & Luz Adriana Flórez, 2008. "Trends, Fluctuations, and Determinants of Commodity Prices," Borradores de Economia 521, Banco de la Republica de Colombia.
    15. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    16. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    17. Dichtl, Hubert & Drobetz, Wolfgang & Neuhierl, Andreas & Wendt, Viktoria-Sophie, 2021. "Data snooping in equity premium prediction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 72-94.
    18. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.
    19. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    20. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:chb:bcchwp:556. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alvaro Castillo (email available below). General contact details of provider: https://edirc.repec.org/data/bccgvcl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.