IDEAS home Printed from https://ideas.repec.org/p/bca/bocsan/17-21.html
   My bibliography  Save this paper

Evaluating Real GDP Growth Forecasts in the Bank of Canada Monetary Policy Report

Author

Listed:
  • André Binette
  • Dmitri Tchebotarev

Abstract

This paper examines the quality of projections of real GDP growth taken from the Bank of Canada Monetary Policy Report (MPR) since they were first published in 1997. Over the last decade, it has become common practice among the central banking community to discuss forecast performance publicly. The assessment we undertake is on annual forecasts as well as the average prediction over the policy horizon. We find that the MPR is more accurate than a naïve forecast model and marginally superior to a consensus of professional forecasters. The accuracy of the MPR annual predictions, measured by the root-mean-square prediction error (RMSPE), improves from 1.6 to 0.6 percentage points as more data become available. On a two-year average basis, the RMSPEs are about 1.0 percentage point for forecasts made in April and October. Our results also suggest that the bias present in MPR forecasts is often not statistically significant for both annual and two-year projections. Nonetheless, we found a tendency to overpredict growth at the beginning of the forecast cycle. Finally, at the beginning of the forecast cycle, the MPR correctly predicts the sign of the change in annual real GDP growth roughly 50 per cent of the time, improving to about 75 per cent at the end of the cycle. The sign of change is correctly predicted roughly 60 per cent of the time for the two-year average prediction.

Suggested Citation

  • André Binette & Dmitri Tchebotarev, 2017. "Evaluating Real GDP Growth Forecasts in the Bank of Canada Monetary Policy Report," Staff Analytical Notes 17-21, Bank of Canada.
  • Handle: RePEc:bca:bocsan:17-21
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2017/11/san2017-21.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John Murray, 2013. "Monetary Policy Decision Making at the Bank of Canada," Bank of Canada Review, Bank of Canada, vol. 2013(Autumn), pages 1-9.
    2. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    3. Tiff Macklem, 2002. "Information and Analysis for Monetary Policy: Coming to a Decision," Bank of Canada Review, Bank of Canada, vol. 2002(Summer), pages 11-18.
    4. Kenneth F. Wallis, 1999. "Asymmetric density forecasts of inflation and the Bank of England's fan chart," National Institute Economic Review, National Institute of Economic and Social Research, vol. 167(1), pages 106-112, January.
    5. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    6. Kirdan Lees, 2016. "Assessing forecast performance," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 79, pages 1-19., June.
    7. José Dorich & Michael K. Johnston & Rhys R. Mendes & Stephen Murchison & Yang Zhang, 2013. "ToTEM II: An Updated Version of the Bank of Canada’s Quarterly Projection Model," Technical Reports 100, Bank of Canada.
    8. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, March.
    9. Olivier Gervais & Marc-André Gosselin, 2014. "Analyzing and Forecasting the Canadian Economy through the LENS Model," Technical Reports 102, Bank of Canada.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carola Conces Binder & Rodrigo Sekkel, 2023. "Central Bank Forecasting: A Survey," Staff Working Papers 23-18, Bank of Canada.
    2. Thibaut Duprey & Alexander Ueberfeldt, 2018. "How to Manage Macroeconomic and Financial Stability Risks: A New Framework," Staff Analytical Notes 2018-11, Bank of Canada.
    3. Julien Champagne & Guillaume Poulin-Bellisle & Rodrigo Sekkel, 2018. "Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts," Staff Working Papers 18-52, Bank of Canada.
    4. Michael Atingi-Ego & Sayed Timuno & Tiviniton Makuve, 2021. "Public Debt Accumulation in SSA: A Looming Debt Crisis [‘Government Ponzi Games and the Sustainability of Public Deficits Under Uncertainty’]," Journal of African Economies, Centre for the Study of African Economies, vol. 30(Supplemen), pages 103-139.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    2. Julien Champagne & Guillaume Poulin-Bellisle & Rodrigo Sekkel, 2018. "Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts," Staff Working Papers 18-52, Bank of Canada.
    3. Chris D'Souza & Jane Voll, 2021. "Qualitative Field Research in Monetary Policy Making," Discussion Papers 2021-1, Bank of Canada.
    4. Justin-Damien Guénette & Nicholas Labelle & Martin Leduc & Lori Rennison, 2016. "The Case of Serial Disappointment," Staff Analytical Notes 16-10, Bank of Canada.
    5. Baris Soybilgen & Ege Yazgan, 2017. "An evaluation of inflation expectations in Turkey," Central Bank Review, Research and Monetary Policy Department, Central Bank of the Republic of Turkey, vol. 17(1), pages 1-31–38.
    6. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    7. Barbara Rossi & Tatevik Sekhposyan, 2016. "Forecast Rationality Tests in the Presence of Instabilities, with Applications to Federal Reserve and Survey Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 507-532, April.
    8. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    9. Rossi, Barbara & Sekhposyan, Tatevik, 2011. "Understanding models' forecasting performance," Journal of Econometrics, Elsevier, vol. 164(1), pages 158-172, September.
    10. Santos, Douglas G. & Candido, Osvaldo & Tófoli, Paula V., 2022. "Forecasting risk measures using intraday and overnight information," The North American Journal of Economics and Finance, Elsevier, vol. 60(C).
    11. Fabian Hollstein & Marcel Prokopczuk & Chardin Wese Simen, 2020. "The Conditional Capital Asset Pricing Model Revisited: Evidence from High-Frequency Betas," Management Science, INFORMS, vol. 66(6), pages 2474-2494, June.
    12. Hiroyuki Kawakatsu, 2021. "Information in daily data volatility measurements," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(2), pages 1642-1656, April.
    13. Matthieu Verstraete & Lena Suchanek, 2017. "Understanding Monetary Policy and its Effects: Evidence from Canadian Firms Using the Business Outlook Survey," Staff Working Papers 17-24, Bank of Canada.
    14. Khoa Hoang & Robert Faff, 2021. "Is the ex‐ante equity risk premium always positive? Evidence from a new conditional expectations model," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(1), pages 95-124, March.
    15. Astrid Ayala & Szabolcs Blazsek, 2018. "Equity market neutral hedge funds and the stock market: an application of score-driven copula models," Applied Economics, Taylor & Francis Journals, vol. 50(37), pages 4005-4023, August.
    16. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    17. Benchimol, Jonathan & El-Shagi, Makram, 2020. "Forecast performance in times of terrorism," Economic Modelling, Elsevier, vol. 91(C), pages 386-402.
    18. Malte Knüppel & Guido Schultefrankenfeld, 2012. "How Informative Are Central Bank Assessments of Macroeconomic Risks?," International Journal of Central Banking, International Journal of Central Banking, vol. 8(3), pages 87-139, September.
    19. Marek RUSNAK, 2013. "Revisions to the Czech National Accounts: Properties and Predictability," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 63(3), pages 244-261, July.
    20. Jörg Breitung & Malte Knüppel, 2021. "How far can we forecast? Statistical tests of the predictive content," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(4), pages 369-392, June.

    More about this item

    Keywords

    Business fluctuations and cycles; Econometric and statistical methods; Monetary Policy;
    All these keywords.

    JEL classification:

    • C - Mathematical and Quantitative Methods
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E - Macroeconomics and Monetary Economics
    • E3 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E5 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocsan:17-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.