IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/6012.html
   My bibliography  Save this paper

A Simple Benchmark for Forecasts of Growth and Inflation

Author

Listed:
  • Marcellino, Massimiliano

Abstract

A theoretical model for growth or inflation should be able to reproduce the empirical features of these variables better than competing alternatives. Therefore, it is common practice in the literature, whenever a new model is suggested, to compare its performance with that of a benchmark model. However, while the theoretical models become more and more sophisticated, the benchmark typically remains a simple linear time series model. Recent examples are provided, e.g., by articles in the real business cycle literature or by new-keynesian studies on inflation persistence. While a time series model can provide a reasonable benchmark to evaluate the value added of economic theory relative to the pure explanatory power of the past behavior of the variable, recent developments in time series analysis suggest that more sophisticated time series models could provide more serious benchmarks for economic models. In this paper we evaluate whether these complicated time series models can really outperform standard linear models for GDP growth and inflation, and should therefore substitute them as benchmarks for economic theory based models. Since a complicated model specification can over-fit in sample, i.e. the model can spuriously perform very well compared to simpler alternatives, we conduct the model comparison based on the out of sample forecasting performance. We consider a large variety of models and evaluation criteria, using real time data and a sophisticated bootstrap algorithm to evaluate the statistical significance of our results. Our main conclusion is that in general linear time series models can be hardly beaten if they are carefully specified, and therefore still provide a good benchmark for theoretical models of growth and inflation. However, we also identify some important cases where the adoption of a more complicated benchmark can alter the conclusions of economic analyses about the driving forces of GDP growth and inflation. Therefore, comparing theoretical models also with more sophisticated time series benchmarks can guarantee more robust conclusions.

Suggested Citation

  • Marcellino, Massimiliano, 2006. "A Simple Benchmark for Forecasts of Growth and Inflation," CEPR Discussion Papers 6012, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:6012
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP6012
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carlo A. Favero & Massimiliano Marcellino, 2005. "Modelling and Forecasting Fiscal Variables for the Euro Area," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 755-783, December.
    2. Clements, Michael P & Hendry, David F, 1996. "Multi-step Estimation for Forecasting," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 58(4), pages 657-684, November.
    3. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    4. Croushore, Dean, 2006. "Forecasting with Real-Time Macroeconomic Data," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 17, pages 961-982, Elsevier.
    5. Timothy Cogley & Thomas J. Sargent, 2002. "Evolving Post-World War II US Inflation Dynamics," NBER Chapters, in: NBER Macroeconomics Annual 2001, Volume 16, pages 331-388, National Bureau of Economic Research, Inc.
    6. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anindya Banerjee & Massimiliano Marcellino & Igor Masten, 2008. "Forecasting Macroeconomic Variables Using Diffusion Indexes in Short Samples with Structural Change," Working Papers 334, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    2. Groen, Jan J.J. & Kapetanios, George & Price, Simon, 2009. "A real time evaluation of Bank of England forecasts of inflation and growth," International Journal of Forecasting, Elsevier, vol. 25(1), pages 74-80.
    3. Angelini, Elena & Marcellino, Massimiliano, 2011. "Econometric analyses with backdated data: Unified Germany and the euro area," Economic Modelling, Elsevier, vol. 28(3), pages 1405-1414, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Massimiliano Marcellino, 2008. "A linear benchmark for forecasting GDP growth and inflation?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(4), pages 305-340.
    2. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    3. Todd E. Clark & Michael W. McCracken, 2006. "Forecasting of small macroeconomic VARs in the presence of instabilities," Research Working Paper RWP 06-09, Federal Reserve Bank of Kansas City.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
    6. Kevin Lansing, 2009. "Time Varying U.S. Inflation Dynamics and the New Keynesian Phillips Curve," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 12(2), pages 304-326, April.
    7. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    8. Céline Gauthier & Fuchun Li, 2006. "Linking Real Activity and Financial Markets: The Bonds, Equity, and Money (BEAM) Model," Staff Working Papers 06-42, Bank of Canada.
    9. Timothy Cogley & Giorgio E. Primiceri & Thomas J. Sargent, 2010. "Inflation-Gap Persistence in the US," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(1), pages 43-69, January.
    10. Trecroci, Carmine & Vega, Juan Luis, 2000. "The information content of M3 for future inflation," Working Paper Series 0033, European Central Bank.
    11. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, University Library of Munich, Germany.
    12. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    13. Clements, Michael P. & Galvao, Ana Beatriz, 2006. "Macroeconomic Forecasting with Mixed Frequency Data: Forecasting US output growth and inflation," Economic Research Papers 269743, University of Warwick - Department of Economics.
    14. Philippe Goulet Coulombe, 2020. "The Macroeconomy as a Random Forest," Papers 2006.12724, arXiv.org, revised Mar 2021.
    15. Janine Aron & John Muellbauer, 2013. "New Methods for Forecasting Inflation, Applied to the US," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(5), pages 637-661, October.
    16. Sabaj, Ernil & Kahveci, Mustafa, 2018. "Forecasting tax revenues in an emerging economy: The case of Albania," MPRA Paper 84404, University Library of Munich, Germany.
    17. Bańbura, Marta & Leiva-León, Danilo & Menz, Jan-Oliver, 2021. "Do inflation expectations improve model-based inflation forecasts?," Discussion Papers 48/2021, Deutsche Bundesbank.
    18. Clements, Michael P., 2016. "Real-time factor model forecasting and the effects of instability," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 661-675.
    19. Ericsson, Neil R., 2017. "Economic forecasting in theory and practice: An interview with David F. Hendry," International Journal of Forecasting, Elsevier, vol. 33(2), pages 523-542.
    20. Jennifer Castle & David Hendry, 2012. "Forecasting by factors, by variables, or both?," Economics Series Working Papers 600, University of Oxford, Department of Economics.

    More about this item

    Keywords

    Growth; inflation; Non-linear models; Time-varying models;
    All these keywords.

    JEL classification:

    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E30 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - General (includes Measurement and Data)

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:6012. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.