IDEAS home Printed from https://ideas.repec.org/p/cnb/rpnrpn/2014-02.html
   My bibliography  Save this paper

Evaluating a Structural Model Forecast: Decomposition Approach

Author

Listed:
  • Frantisek Brazdik
  • Zuzana Humplova
  • Frantisek Kopriva

Abstract

Macroeconomic forecasters are often criticized for a lack of transparency when presenting their forecasts. To deter such criticism, the transparency of the forecasting process should be enhanced by tracing and explaining the effects of data revisions and expert judgment updates on variations in the forecasts. This paper presents a forecast decomposition analysis framework designed to examine the differences between two forecasts generated by a linear structural model. The differences between the forecasts considered can be decomposed into the contributions of various forecast elements, such as the effect of new data or expert judgment. The framework allows us to evaluate the contributions of forecast assumptions in the presence of expert judgment applied in the expected way. The simplest application of this framework examines alternative forecast scenarios with different forecast assumptions. Next, a one-period difference between the forecasts’ initial periods is added to the examination. Finally, a replication of the Inflation Forecast Evaluation presented in Inflation Report III/2013 is created to illustrate the full capabilities of the decomposition framework.

Suggested Citation

  • Frantisek Brazdik & Zuzana Humplova & Frantisek Kopriva, 2014. "Evaluating a Structural Model Forecast: Decomposition Approach," Research and Policy Notes 2014/02, Czech National Bank.
    • Handle: RePEc:cnb:rpnrpn:2014/02
    as

    Download full text from publisher

    File URL: https://www.cnb.cz/export/sites/cnb/en/economic-research/.galleries/research_publications/irpn/download/rpn_2_2014.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Blanchard, Olivier Jean & Kahn, Charles M, 1980. "The Solution of Linear Difference Models under Rational Expectations," Econometrica, Econometric Society, vol. 48(5), pages 1305-1311, July.
    2. Michal Andrle, 2013. "What Is in Your Output Gap? Unified Framework & Decomposition into Observables," IMF Working Papers 2013/105, International Monetary Fund.
    3. Lars E O Svensson, 2005. "Monetary Policy with Judgment: Forecast Targeting," International Journal of Central Banking, International Journal of Central Banking, vol. 1(1), May.
    4. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    5. Michal Andrle & Tibor Hledik & Ondra Kamenik & Jan Vlcek, 2009. "Implementing the New Structural Model of the Czech National Bank," Working Papers 2009/2, Czech National Bank.
    6. Daniel F. Waggoner & Tao Zha, 1999. "Conditional Forecasts In Dynamic Multivariate Models," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 639-651, November.
    7. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    8. Heilemann, Ullrich, 2002. "Increasing the transparency of macroeconometric forecasts: a report from the trenches," International Journal of Forecasting, Elsevier, vol. 18(1), pages 85-105.
    9. Jan Bruha & Tibor Hledik & Tomas Holub & Jiri Polansky & Jaromir Tonner, 2013. "Incorporating Judgments and Dealing with Data Uncertainty in Forecasting at the Czech National Bank," Research and Policy Notes 2013/02, Czech National Bank.
    10. Thomas Doan & Robert B. Litterman & Christopher A. Sims, 1983. "Forecasting and Conditional Projection Using Realistic Prior Distributions," NBER Working Papers 1202, National Bureau of Economic Research, Inc.
    11. Doran, Howard E, 1992. "Constraining Kalman Filter and Smoothing Estimates to Satisfy Time-Varying Restrictions," The Review of Economics and Statistics, MIT Press, vol. 74(3), pages 568-572, August.
    12. Klein, Paul, 2000. "Using the generalized Schur form to solve a multivariate linear rational expectations model," Journal of Economic Dynamics and Control, Elsevier, vol. 24(10), pages 1405-1423, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Igor Vetlov & Ricardo Mourinho Felix & Laure Frey & Tibor Hledik & Zoltan Jakab & Niki Papadopoulou & Lukas Reiss & Martin Schneider, 2010. "The Implementation of Scenarios using DSGE Models," Working Papers 2010-10, Central Bank of Cyprus.
    3. Pär Österholm, 2009. "Incorporating Judgement in Fan Charts," Scandinavian Journal of Economics, Wiley Blackwell, vol. 111(2), pages 387-415, June.
    4. Huseynov, Salman & Ahmadov, Vugar, 2014. "Azərbaycan üzrə DSÜT modeli: qiymətləndirmə və proqnozlaşdırma [A DSGE model for Azerbaijan: estimation and forecasting]," MPRA Paper 78123, University Library of Munich, Germany.
    5. Brisne J. V. Céspedes & Elcyon C. R. Lima & Alexis Maka & Mário J. C. Mendonça, 2005. "Measuring Monetary Policy Stance in Brazil," Discussion Papers 1128, Instituto de Pesquisa Econômica Aplicada - IPEA.
    6. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    7. Smets, Frank & Warne, Anders & Wouters, Rafael, 2014. "Professional forecasters and real-time forecasting with a DSGE model," International Journal of Forecasting, Elsevier, vol. 30(4), pages 981-995.
    8. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    9. Kuo‐Hsuan Chin, 2022. "Forecast evaluation of DSGE models: Linear and nonlinear likelihood," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1099-1130, September.
    10. Burgess, Stephen & Fernandez-Corugedo, Emilio & Groth, Charlotta & Harrison, Richard & Monti, Francesca & Theodoridis, Konstantinos & Waldron, Matt, 2013. "The Bank of England's forecasting platform: COMPASS, MAPS, EASE and the suite of models," Bank of England working papers 471, Bank of England.
    11. Michal Franta & Tomas Holub & Petr Kral & Ivana Kubicova & Katerina Smidkova & Borek Vasicek, 2014. "The Exchange Rate as an Instrument at Zero Interest Rates: The Case of the Czech Republic," Research and Policy Notes 2014/03, Czech National Bank.
    12. Gomme, Paul & Klein, Paul, 2011. "Second-order approximation of dynamic models without the use of tensors," Journal of Economic Dynamics and Control, Elsevier, vol. 35(4), pages 604-615, April.
    13. Summers, Peter M., 2001. "Forecasting Australia's economic performance during the Asian crisis," International Journal of Forecasting, Elsevier, vol. 17(3), pages 499-515.
    14. Jonathan J Adams, 2023. "Equilibrium Determinacy With Behavioral Expectations," Working Papers 001008, University of Florida, Department of Economics.
    15. Rangan Gupta & Alain Kabundi & Stephen Miller & Josine Uwilingiye, 2014. "Using large data sets to forecast sectoral employment," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(2), pages 229-264, June.
    16. Giannone, Domenico & Lenza, Michele & Momferatou, Daphne & Onorante, Luca, 2014. "Short-term inflation projections: A Bayesian vector autoregressive approach," International Journal of Forecasting, Elsevier, vol. 30(3), pages 635-644.
    17. Carlo A. Favero, 2007. "Model Evaluation in Macroeconometrics: from early empirical macroeconomic models to DSGE models," Working Papers 327, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    18. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    19. Pesaran, M.H. & Smith, L.V. & Smith, R.P, 2005. "What if the UK has Joined the Euro in 1999? An Empirical Evaluation using a Global VAR," Cambridge Working Papers in Economics 0528, Faculty of Economics, University of Cambridge.
    20. Sergio Ocampo Díaz, 2012. "A Model of Rule-of-Thumb Consumers With Nominal Price and Wage Rigidities," Borradores de Economia 9595, Banco de la Republica.

    More about this item

    Keywords

    Data revisions; DSGE models; forecasting; forecast revisions;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E01 - Macroeconomics and Monetary Economics - - General - - - Measurement and Data on National Income and Product Accounts and Wealth; Environmental Accounts
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cnb:rpnrpn:2014/02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jan Babecky (email available below). General contact details of provider: https://edirc.repec.org/data/cnbgvcz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.