IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v27y2008i3p237-265.html
   My bibliography  Save this article

How successful are dynamic factor models at forecasting output and inflation? A meta-analytic approach

Author

Listed:
  • Sandra Eickmeier

    (Deutsche Bundesbank, Economic Research Centre, Frankfurt am Main and University of Cologne, Germany)

  • Christina Ziegler

    (University of Leipzig and Ifo Institute for Economic Research, Munich, Germany)

Abstract

This paper uses a meta-analysis to survey existing factor forecast applications for output and inflation and assesses what causes large factor models to perform better or more poorly at forecasting than other models. Our results suggest that factor models tend to outperform small models, whereas factor forecasts are slightly worse than pooled forecasts. Factor models deliver better predictions for US variables than for UK variables, for US output than for euro-area output and for euro-area inflation than for US inflation. The size of the dataset from which factors are extracted positively affects the relative factor forecast performance, whereas pre-selecting the variables included in the dataset did not improve factor forecasts in the past. Finally, the factor estimation technique may matter as well. Copyright © 2008 John Wiley & Sons, Ltd.

Suggested Citation

  • Sandra Eickmeier & Christina Ziegler, 2008. "How successful are dynamic factor models at forecasting output and inflation? A meta-analytic approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(3), pages 237-265.
    • Handle: RePEc:jof:jforec:v:27:y:2008:i:3:p:237-265
    DOI: 10.1002/for.1056
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/for.1056
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: https://libkey.io/10.1002/for.1056?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Elena Angelini & Jérôme Henry & Ricardo Mestre, 2001. "Diffusion index-based inflation forecasts for the euro area," BIS Papers chapters, in: Bank for International Settlements (ed.), Empirical studies of structural changes and inflation, volume 3, pages 109-138, Bank for International Settlements.
    2. Filippo Altissimo & Antonio Bassanetti & Riccardo Cristadoro & Lucrezia Reichlin & Giovanni Veronese, 2001. "The construction of coincident and leading indicators for the euro area business cycler of the euro area business cycle," Temi di discussione (Economic working papers) 434, Bank of Italy, Economic Research and International Relations Area.
    3. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    4. Martin Schneider & Martin Spitzer, 2004. "Forecasting Austrian GDP using the generalized dynamic factor model," Working Papers 89, Oesterreichische Nationalbank (Austrian Central Bank).
    5. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2003. "Do financial variables help forecasting inflation and real activity in the euro area?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1243-1255, September.
    6. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    7. Carlo A. Favero & Ottavio Ricchi & Cristian Tegami, 2004. "Forecasting Italian inflation with large datasets and many models," Working Papers 269, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    8. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    9. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    10. Olaf Hübler & Jachim Frohn (ed.), 2006. "Modern Econometric Analysis," Springer Books, Springer, number 978-3-540-32693-9, September.
    11. Christian Schumacher, 2007. "Forecasting German GDP using alternative factor models based on large datasets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(4), pages 271-302.
    12. repec:onb:oenbwp:y::i:89:b:1 is not listed on IDEAS
    13. Doris Weichselbaumer & Rudolf Winter‐Ebmer, 2005. "A Meta‐Analysis of the International Gender Wage Gap," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 479-511, July.
    14. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic Factor Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 3, pages 25-40, Springer.
    15. Reichlin, Lucrezia & Sala, Luca & Giannone, Domenico, 2002. "Tracking Greenspan: Systematic and Unsystematic Monetary Policy Revisited," CEPR Discussion Papers 3550, C.E.P.R. Discussion Papers.
    16. Dreger, Christian & Schumacher, Christian, 2002. "Estimating Large-Scale Factor Models for Economic Activity in Germany: Do They Outperform Simpler Models?," Discussion Paper Series 26321, Hamburg Institute of International Economics.
    17. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    18. Israel Sancho & maximo Camacho, 2002. "Spanish diffusion indexes," Computing in Economics and Finance 2002 276, Society for Computational Economics.
    19. Simonetta Longhi & Peter Nijkamp & Jacques Poot, 2005. "A Meta‐Analytic Assessment of the Effect of Immigration on Wages," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 451-477, July.
    20. O. De Bandt & E. Michaux & C. Bruneau & A. Flageollet, 2007. "Forecasting inflation using economic indicators: the case of France," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(1), pages 1-22.
    21. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    22. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    23. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    24. Roberto Tatiwa Ferreira & Herman Bierens & Ivan Castelar, 2005. "Forecasting Quarterly Brazilian GDP Growth Rate With Linear and NonLinear Diffusion Index Models," Economia, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics], vol. 6(3), pages 261-292.
    25. Troy D. Matheson, 2006. "Factor Model Forecasts for New Zealand," International Journal of Central Banking, International Journal of Central Banking, vol. 2(2), May.
    26. Lippi, Marco & Reichlin, Lucrezia & Hallin, Marc & Forni, Mario & Altissimo, Filippo & Cristadoro, Riccardo & Veronese, Giovanni & Bassanetti, Antonio, 2001. "EuroCOIN: A Real Time Coincident Indicator of the Euro Area Business Cycle," CEPR Discussion Papers 3108, C.E.P.R. Discussion Papers.
    27. Marc-André Gosselin & Greg Tkacz, 2001. "Evaluating Factor Models: An Application to Forecasting Inflation in Canada," Staff Working Papers 01-18, Bank of Canada.
    28. Reichlin, Lucrezia & Giannone, Domenico & De Mol, Christine, 2006. "Forecasting Using a Large Number of Predictors: Is Bayesian Regression a Valid Alternative to Principal Components?," CEPR Discussion Papers 5829, C.E.P.R. Discussion Papers.
    29. Anindya Banerjee & Massimiliano Marcellino & Igor Masten, 2008. "Forecasting Macroeconomic Variables Using Diffusion Indexes in Short Samples with Structural Change," Working Papers 334, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    30. Christophe van Nieuwenhuyze, 2006. "A Generalized Dynamic Factor Model for the Belgian Economy: Identification of the Business Cycle and GDP Growth Forecasts," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2005(2), pages 213-247.
    31. Banerjee, Anindya & Marcellino, Massimiliano, 2006. "Are there any reliable leading indicators for US inflation and GDP growth?," International Journal of Forecasting, Elsevier, vol. 22(1), pages 137-151.
    32. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    33. Michael Artis & Anindya Banerjee & Massimiliano Marcellino, "undated". "Factor forecasts for the UK," Working Papers 203, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    34. Arthur F. Burns & Wesley C. Mitchell, 1946. "Measuring Business Cycles," NBER Books, National Bureau of Economic Research, Inc, number burn46-1, March.
    35. William T. Gavin & Kevin L. Kliesen, 2008. "Forecasting inflation and output: comparing data-rich models with simple rules," Review, Federal Reserve Bank of St. Louis, vol. 90(May), pages 175-192.
    36. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February.
    37. Mr. Emil Stavrev, 2006. "Measures of Underlying Inflation in the Euro Area: Assessment and Role for Informing Monetary Policy," IMF Working Papers 2006/197, International Monetary Fund.
    38. Anindya Banerjee & Massimiliano Marcellino & Igor Masten, 2005. "Leading Indicators for Euro‐area Inflation and GDP Growth," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 785-813, December.
    39. Gary Koop & Simon Potter, 2004. "Forecasting in dynamic factor models using Bayesian model averaging," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 550-565, December.
    40. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecasting Using Bayesian and Information-Theoretic Model Averaging: An Application to U.K. Inflation," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 33-41, January.
    41. Jean Boivin & Serena Ng, 2005. "Understanding and Comparing Factor-Based Forecasts," International Journal of Central Banking, International Journal of Central Banking, vol. 1(3), December.
    42. Markus Knell & Helmut Stix, 2005. "The Income Elasticity of Money Demand: A Meta‐Analysis of Empirical Results," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 513-533, July.
    43. Mathias Dewatripont & Lars Peter Hansen & Stephen Turnovsky, 2003. "Advances in Economics and Econometrics: Theory and Applications, Eighth World Congress," ULB Institutional Repository 2013/176003, ULB -- Universite Libre de Bruxelles.
    44. Cristadoro, Riccardo & Forni, Mario & Reichlin, Lucrezia & Veronese, Giovanni, 2005. "A Core Inflation Indicator for the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 539-560, June.
    45. Schumacher, Christian & Breitung, Jörg, 2006. "Real-time forecasting of GDP based on a large factor model with monthly and quarterly data," Discussion Paper Series 1: Economic Studies 2006,33, Deutsche Bundesbank.
    46. Kapetanios, George, 2004. "A note on modelling core inflation for the UK using a new dynamic factor estimation method and a large disaggregated price index dataset," Economics Letters, Elsevier, vol. 85(1), pages 63-69, October.
    47. George Kapetanios & Gonzalo Camba-Mendez, 2005. "Forecasting euro area inflation using dynamic factor measures of underlying inflation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(7), pages 491-503.
    48. Filippo Altissimo & Antonio Bassanetti & Riccardo Cristadoro & Mario Forni & Marco Lippi & Lucrezia Reichlin & Giovanni Veronese, 2001. "A real time coincident indicator of the euro area business cycle," Temi di discussione (Economic working papers) 436, Bank of Italy, Economic Research and International Relations Area.
    49. Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
    50. Hofmann, Boris, 2006. "Do monetary indicators (still) predict euro area inflation?," Discussion Paper Series 1: Economic Studies 2006,18, Deutsche Bundesbank.
    51. Moser, Gabriel & Rumler, Fabio & Scharler, Johann, 2007. "Forecasting Austrian inflation," Economic Modelling, Elsevier, vol. 24(3), pages 470-480, May.
    52. Reichlin, Lucrezia, 2002. "Factor Models in Large Cross-Sections of Time Series," CEPR Discussion Papers 3285, C.E.P.R. Discussion Papers.
    53. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    54. Antonello D’ Agostino & Domenico Giannone, 2012. "Comparing Alternative Predictors Based on Large‐Panel Factor Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 306-326, April.
    55. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    56. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    57. Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
    58. James H. Stock & Mark W. Watson, 1998. "Diffusion Indexes," NBER Working Papers 6702, National Bureau of Economic Research, Inc.
    59. Calista Cheung & Frédérick Demers, 2007. "Evaluating Forecasts from Factor Models for Canadian GDP Growth and Core Inflation," Staff Working Papers 07-8, Bank of Canada.
    60. Domenico Giannone & Troy D. Matheson, 2007. "A New Core Inflation Indicator for New Zealand," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 145-180, December.
    61. Alain N. Kabundi, 2004. "Estimation of Economic Growth in France Using Business Survey Data," IMF Working Papers 2004/069, International Monetary Fund.
    62. Álvaro Aguirre R. & Luis Felipe Céspedes C., 2004. "Uso de Análisis Factorial Dinámico para Proyecciones Macroeconómicas," Working Papers Central Bank of Chile 274, Central Bank of Chile.
    63. Bruneau, C. & De Bandt, O. & Flageollet, A., 2003. "Forecasting Inflation in the Euro Area," Working papers 102, Banque de France.
    64. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    65. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    66. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer.
    67. Daniel Grenouilleau, 2004. "A sorted leading indicators dynamic (SLID) factor model for short-run euro-area GDP forecasting," European Economy - Economic Papers 2008 - 2015 219, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    2. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    3. Christian Schumacher, 2007. "Forecasting German GDP using alternative factor models based on large datasets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(4), pages 271-302.
    4. Gupta, Rangan & Kabundi, Alain & Miller, Stephen M., 2011. "Forecasting the US real house price index: Structural and non-structural models with and without fundamentals," Economic Modelling, Elsevier, vol. 28(4), pages 2013-2021, July.
    5. Vladimir Kuzin & Massimiliano Marcellino & Christian Schumacher, 2009. "Pooling versus Model Selection for Nowcasting with Many Predictors: An Application to German GDP," Economics Working Papers ECO2009/13, European University Institute.
    6. Massimiliano Marcellino & Christian Schumacher, 2008. "Factor-MIDAS for Now- and Forecasting with Ragged-Edge Data: A Model Comparison for German GDP1," Working Papers 333, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    7. Marcellino, Massimiliano & Schumacher, Christian, 2007. "Factor-MIDAS for now- and forecasting with ragged-edge data: a model comparison for German GDP," Discussion Paper Series 1: Economic Studies 2007,34, Deutsche Bundesbank.
    8. Hallin, Marc & Liska, Roman, 2011. "Dynamic factors in the presence of blocks," Journal of Econometrics, Elsevier, vol. 163(1), pages 29-41, July.
    9. Gupta, Rangan & Kabundi, Alain, 2011. "A large factor model for forecasting macroeconomic variables in South Africa," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1076-1088, October.
    10. Viktors Ajevskis & Gundars Davidsons, 2008. "Dynamic Factor Models in Forecasting Latvia's Gross Domestic Product," Working Papers 2008/02, Latvijas Banka.
    11. Guido Bulligan & Roberto Golinelli & Giuseppe Parigi, 2010. "Forecasting monthly industrial production in real-time: from single equations to factor-based models," Empirical Economics, Springer, vol. 39(2), pages 303-336, October.
    12. In Choi & Hanbat Jeong, 2019. "Model selection for factor analysis: Some new criteria and performance comparisons," Econometric Reviews, Taylor & Francis Journals, vol. 38(6), pages 577-596, July.
    13. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic Factor Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 3, pages 25-40, Springer.
    14. Marc Hallin & Roman Liska, 2008. "Dynamic Factors in the Presence of Block Structure," Working Papers ECARES 2008_012, ULB -- Universite Libre de Bruxelles.
    15. In Choi, 2011. "Efficient Estimation of Nonstationary Factor Models," Working Papers 1101, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy), revised Jun 2011.
    16. Rua, António, 2017. "A wavelet-based multivariate multiscale approach for forecasting," International Journal of Forecasting, Elsevier, vol. 33(3), pages 581-590.
    17. Luciani, Matteo, 2014. "Forecasting with approximate dynamic factor models: The role of non-pervasive shocks," International Journal of Forecasting, Elsevier, vol. 30(1), pages 20-29.
    18. Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
    19. In Choi & Dukpa Kim & Yun Jung Kim & Noh‐Sun Kwark, 2018. "A multilevel factor model: Identification, asymptotic theory and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(3), pages 355-377, April.
    20. Van Nieuwenhuyze, Christophe & Benk, Szilard & Rünstler, Gerhard & Cristadoro, Riccardo & Den Reijer, Ard & Jakaitiene, Audrone & Jelonek, Piotr & Rua, António & Ruth, Karsten & Barhoumi, Karim, 2008. "Short-term forecasting of GDP using large monthly datasets: a pseudo real-time forecast evaluation exercise," Occasional Paper Series 84, European Central Bank.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:27:y:2008:i:3:p:237-265. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.