IDEAS home Printed from https://ideas.repec.org/p/bca/bocawp/18-52.html
   My bibliography  Save this paper

Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts

Author

Listed:
  • Julien Champagne
  • Guillaume Poulin-Bellisle
  • Rodrigo Sekkel

Abstract

We present a novel database of real-time data and forecasts from the Bank of Canada’s staff economic projections. We then provide a forecast evaluation for GDP growth and CPI inflation since 1982: we compare the staff forecasts with those from commonly used time-series models estimated with real-time data and with forecasts from other professional forecasters and provide standard bias tests. Finally, we study changes in the predictability of the Canadian economy following the announcement of the inflation-targeting regime in 1991. Our database is unprecedented outside the United States, and our evidence is particularly interesting, as it includes over 30 years of staff forecasts, two severe recessions and different monetary policy regimes. The database will be made available publicly and updated annually.

Suggested Citation

  • Julien Champagne & Guillaume Poulin-Bellisle & Rodrigo Sekkel, 2018. "Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts," Staff Working Papers 18-52, Bank of Canada.
  • Handle: RePEc:bca:bocawp:18-52
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2018/10/swp2018-52.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Barbara Rossi & Tatevik Sekhposyan, 2016. "Forecast Rationality Tests in the Presence of Instabilities, with Applications to Federal Reserve and Survey Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 507-532, April.
    2. Champagne, Julien & Sekkel, Rodrigo, 2018. "Changes in monetary regimes and the identification of monetary policy shocks: Narrative evidence from Canada," Journal of Monetary Economics, Elsevier, vol. 99(C), pages 72-87.
    3. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    4. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    5. Chang-Jin Kim & Charles R. Nelson, 1999. "Has The U.S. Economy Become More Stable? A Bayesian Approach Based On A Markov-Switching Model Of The Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 608-616, November.
    6. José Dorich & Michael K. Johnston & Rhys R. Mendes & Stephen Murchison & Yang Zhang, 2013. "ToTEM II: An Updated Version of the Bank of Canada’s Quarterly Projection Model," Technical Reports 100, Bank of Canada.
    7. Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
    8. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    9. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    10. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2018. "The Real‐Time Properties of the Bank of Canada's Staff Output Gap Estimates," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 50(6), pages 1167-1188, September.
    11. Anthony Garratt & Shaun P Vahey, 2006. "UK Real-Time Macro Data Characteristics," Economic Journal, Royal Economic Society, vol. 116(509), pages 119-135, February.
    12. Coibion, Olivier & Gorodnichenko, Yuriy & Kueng, Lorenz & Silvia, John, 2017. "Innocent Bystanders? Monetary policy and inequality," Journal of Monetary Economics, Elsevier, vol. 88(C), pages 70-89.
    13. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    14. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, March.
    15. Gregory Mankiw, N. & Shapiro, Matthew D., 1986. "Do we reject too often? : Small sample properties of tests of rational expectations models," Economics Letters, Elsevier, vol. 20(2), pages 139-145.
    16. Domenico Giannone & Jérôme Henry & Magdalena Lalik & Michele Modugno, 2012. "An Area-Wide Real-Time Database for the Euro Area," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1000-1013, November.
    17. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    18. John Murray, 2013. "Monetary Policy Decision Making at the Bank of Canada," Bank of Canada Review, Bank of Canada, vol. 2013(Autumn), pages 1-9.
    19. Olivier Gervais & Marc-André Gosselin, 2014. "Analyzing and Forecasting the Canadian Economy through the LENS Model," Technical Reports 102, Bank of Canada.
    20. Olivier Fortin‐Gagnon & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "A large Canadian database for macroeconomic analysis," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(4), pages 1799-1833, November.
    21. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    22. Groen, Jan J.J. & Kapetanios, George & Price, Simon, 2009. "A real time evaluation of Bank of England forecasts of inflation and growth," International Journal of Forecasting, Elsevier, vol. 25(1), pages 74-80.
    23. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    24. Stephen S. Poloz & David Rose & Robert Tetlow, 1994. "The Bank of Canada's new Quarterly Projection Model (QPM): An introduction," Bank of Canada Review, Bank of Canada, vol. 1994(Autumn), pages 23-38.
    25. James Cloyne & Clodomiro Ferreira & Paolo Surico, 2020. "Monetary Policy when Households have Debt: New Evidence on the Transmission Mechanism," Review of Economic Studies, Oxford University Press, vol. 87(1), pages 102-129.
    26. Orphanides, Athanasios, 2003. "The quest for prosperity without inflation," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 633-663, April.
    27. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    28. David Longworth, 2002. "Inflation and the Macroeconomy: Changes from the 1980s to the 1990s," Bank of Canada Review, Bank of Canada, vol. 2002(Spring), pages 3-18.
    29. Adriana Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2011. "A real-time historical database for the OECD," Globalization Institute Working Papers 96, Federal Reserve Bank of Dallas.
    30. André Binette & Dmitri Tchebotarev, 2017. "Evaluating Real GDP Growth Forecasts in the Bank of Canada Monetary Policy Report," Staff Analytical Notes 17-21, Bank of Canada.
    31. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    32. Olivier Blanchard & John Simon, 2001. "The Long and Large Decline in U.S. Output Volatility," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 32(1), pages 135-174.
    33. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    34. Dean Croushore & Simon van Norden, 2018. "Fiscal Forecasts at the FOMC: Evidence from the Greenbooks," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 933-945, December.
    35. Campbell, Sean D., 2007. "Macroeconomic Volatility, Predictability, and Uncertainty in the Great Moderation: Evidence From the Survey of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 191-200, April.
    36. Joutz, Fred & Stekler, H. O., 2000. "An evaluation of the predictions of the Federal Reserve," International Journal of Forecasting, Elsevier, vol. 16(1), pages 17-38.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Calista Cheung & Luke Frymire & Lise Pichette, 2020. "Can the Business Outlook Survey Help Improve Estimates of the Canadian Output Gap?," Discussion Papers 2020-14, Bank of Canada.
    2. Dany Brouillette & Marie-Noëlle Robitaille & Laurence Savoie-Chabot & Pierre St-Amant & Bassirou Gueye & Elise Martin, 2019. "The Trend Unemployment Rate in Canada: Searching for the Unobservable," Staff Working Papers 19-13, Bank of Canada.
    3. Cars Hommes & Mario He & Sebastian Poledna & Melissa Siqueira & Yang Zhang, 2022. "CANVAS: A Canadian Behavioral Agent-Based Model," Staff Working Papers 22-51, Bank of Canada.
    4. Mr. Troy D Matheson, 2019. "How to Improve Inflation Forecasting in Canada," IMF Working Papers 2019/190, International Monetary Fund.
    5. Gelfer, Sacha, 2021. "Evaluating the forecasting power of an open-economy DSGE model when estimated in a data-Rich environment," Journal of Economic Dynamics and Control, Elsevier, vol. 129(C).
    6. Tony Chernis & Taylor Webley, 2022. "Nowcasting Canadian GDP with Density Combinations," Discussion Papers 2022-12, Bank of Canada.
    7. Poloz, Stephen S., 2021. "Technological progress and monetary policy: Managing the fourth industrial revolution," Journal of International Money and Finance, Elsevier, vol. 114(C).
    8. Stephen S. Poloz, 2019. "Technological Progress and Monetary Policy: Managing the Fourth Industrial Revolution," Discussion Papers 2019-11, Bank of Canada.
    9. Henri Keränen & Sakari Lähdemäki, 2020. "Identification of fiscal SVARs in small open economies using trading partner forecast errors as instruments," Working Papers 330, Työn ja talouden tutkimus LABORE, The Labour Institute for Economic Research LABORE.
    10. Kontogeorgos, Georgios & Lambrias, Kyriacos, 2019. "An analysis of the Eurosystem/ECB projections," Working Paper Series 2291, European Central Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    2. Carola Conces Binder & Rodrigo Sekkel, 2023. "Central Bank Forecasting: A Survey," Staff Working Papers 23-18, Bank of Canada.
    3. Fred Joutz & Michael P. Clements & Herman O. Stekler, 2007. "An evaluation of the forecasts of the federal reserve: a pooled approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(1), pages 121-136.
    4. Paul Hubert, 2015. "Revisiting the Greenbook’s relative forecasting performance," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(1), pages 151-179.
    5. repec:hal:spmain:info:hdl:2441/35kgubh40v9gfpnuruelqjnptb is not listed on IDEAS
    6. Champagne, Julien & Sekkel, Rodrigo, 2018. "Changes in monetary regimes and the identification of monetary policy shocks: Narrative evidence from Canada," Journal of Monetary Economics, Elsevier, vol. 99(C), pages 72-87.
    7. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    8. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    9. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    10. Massimiliano Marcellino, 2008. "A linear benchmark for forecasting GDP growth and inflation?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(4), pages 305-340.
    11. repec:spo:wpmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    12. Gamber, Edward N. & Smith, Julie K., 2009. "Are the Fed's inflation forecasts still superior to the private sector's?," Journal of Macroeconomics, Elsevier, vol. 31(2), pages 240-251, June.
    13. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    14. repec:hal:spmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    15. Marek RUSNAK, 2013. "Revisions to the Czech National Accounts: Properties and Predictability," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 63(3), pages 244-261, July.
    16. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    17. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    18. Ana Beatriz Galvão & James Mitchell, 2023. "Real‐Time Perceptions of Historical GDP Data Uncertainty," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 457-481, June.
    19. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    20. Barbara Rossi & Tatevik Sekhposyan, 2016. "Forecast Rationality Tests in the Presence of Instabilities, with Applications to Federal Reserve and Survey Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 507-532, April.
    21. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    22. Bhatt, Vipul & Kishor, Kundan & Marfatia, Hardik, 2017. "Estimating excess sensitivity and habit persistence in consumption using Greenbook forecast as an instrument," MPRA Paper 79748, University Library of Munich, Germany.
    23. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.

    More about this item

    Keywords

    Econometric and statistical methods; Economic models; Inflation targets; Monetary Policy;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocawp:18-52. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.