IDEAS home Printed from https://ideas.repec.org/p/eui/euiwps/eco2009-13.html
   My bibliography  Save this paper

Pooling versus Model Selection for Nowcasting with Many Predictors: An Application to German GDP

Author

Listed:
  • Vladimir Kuzin
  • Massimiliano Marcellino
  • Christian Schumacher

Abstract

This paper discusses pooling versus model selection for now- and forecasting in the presence of model uncertainty with large, unbalanced datasets. Empirically, unbalanced data is pervasive in economics and typically due to di¤erent sampling frequencies and publication delays. Two model classes suited in this context are factor models based on large datasets and mixed-data sampling (MIDAS) regressions with few predictors. The specification of these models requires several choices related to, amongst others, the factor estimation method and the number of factors, lag length and indicator selection. Thus, there are many sources of mis-specification when selecting a particular model, and an alternative could be pooling over a large set of models with di¤erent specifications. We evaluate the relative performance of pooling and model selection for now- and forecasting quarterly German GDP, a key macroeconomic indicator for the largest country in the euro area, with a large set of about one hundred monthly indicators. Our empirical findings provide strong support for pooling over many speci.cations rather than selecting a specific model.

Suggested Citation

  • Vladimir Kuzin & Massimiliano Marcellino & Christian Schumacher, 2009. "Pooling versus Model Selection for Nowcasting with Many Predictors: An Application to German GDP," Economics Working Papers ECO2009/13, European University Institute.
  • Handle: RePEc:eui:euiwps:eco2009/13
    as

    Download full text from publisher

    File URL: http://cadmus.eui.eu/dspace/bitstream/1814/10681/1/ECO_2009_13.pdf
    File Function: main text
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
    2. Roberto S. Mariano & Yasutomo Murasawa, 2003. "A new coincident index of business cycles based on monthly and quarterly series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 427-443.
    3. Eric Ghysels & Arthur Sinko & Rossen Valkanov, 2007. "MIDAS Regressions: Further Results and New Directions," Econometric Reviews, Taylor & Francis Journals, vol. 26(1), pages 53-90.
    4. Domenico Giannone & Lucrezia Reichlin & Luca Sala, 2005. "Monetary Policy in Real Time," NBER Chapters,in: NBER Macroeconomics Annual 2004, Volume 19, pages 161-224 National Bureau of Economic Research, Inc.
    5. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    6. Martin Schneider & Martin Spitzer, 2004. "Forecasting Austrian GDP using the generalized dynamic factor model," Working Papers 89, Oesterreichische Nationalbank (Austrian Central Bank).
    7. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2003. "Do financial variables help forecasting inflation and real activity in the euro area?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1243-1255, September.
    8. Anindya Banerjee & Massimiliano Marcellino & Igor Masten, 2005. "Leading Indicators for Euro-area Inflation and GDP Growth," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 785-813, December.
    9. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    10. Banbura, Marta & Rünstler, Gerhard, 2011. "A look into the factor model black box: Publication lags and the role of hard and soft data in forecasting GDP," International Journal of Forecasting, Elsevier, vol. 27(2), pages 333-346, April.
    11. Inoue, Atsushi & Kilian, Lutz, 2006. "On the selection of forecasting models," Journal of Econometrics, Elsevier, vol. 130(2), pages 273-306, February.
    12. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic factor models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 27-42, March.
    13. Chevillon, Guillaume & Hendry, David F., 2005. "Non-parametric direct multi-step estimation for forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 21(2), pages 201-218.
    14. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    15. Katrin Assenmacher-Wesche & M. Hashem Pesaran, 2008. "Forecasting the Swiss Economy Using VECX* Models: An Exercise in Forecast Combination Across Modelsand Observation Windows," Working Papers 2008-03, Swiss National Bank.
    16. Christian Schumacher, 2007. "Forecasting German GDP using alternative factor models based on large datasets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(4), pages 271-302.
    17. Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
    18. Marcellino, Massimiliano & Schumacher, Christian, 2007. "Factor-MIDAS for now- and forecasting with ragged-edge data: a model comparison for German GDP," Discussion Paper Series 1: Economic Studies 2007,34, Deutsche Bundesbank.
    19. George Kapetanios & Massimiliano Marcellino, 2009. "A parametric estimation method for dynamic factor models of large dimensions," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 208-238, March.
    20. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    21. Bernanke, Ben S. & Boivin, Jean, 2003. "Monetary policy in a data-rich environment," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 525-546, April.
    22. Filippo Altissimo & Riccardo Cristadoro & Mario Forni & Marco Lippi & Giovanni Veronese, 2010. "New Eurocoin: Tracking Economic Growth in Real Time," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1024-1034, November.
    23. Antonello D’ Agostino & Domenico Giannone, 2012. "Comparing Alternative Predictors Based on Large‐Panel Factor Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 306-326, April.
    24. Schumacher, Christian & Breitung, Jörg, 2008. "Real-time forecasting of German GDP based on a large factor model with monthly and quarterly data," International Journal of Forecasting, Elsevier, vol. 24(3), pages 386-398.
    25. Sandra Eickmeier & Christina Ziegler, 2008. "How successful are dynamic factor models at forecasting output and inflation? A meta-analytic approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(3), pages 237-265.
    26. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    27. Helmut Lütkepohl & Ralf Brüggemann, 2006. "A small monetary system for the euro area based on German data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 683-702.
    28. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecast combination and the Bank of England's suite of statistical forecasting models," Economic Modelling, Elsevier, vol. 25(4), pages 772-792, July.
    29. Banerjee, Anindya & Marcellino, Massimiliano, 2006. "Are there any reliable leading indicators for US inflation and GDP growth?," International Journal of Forecasting, Elsevier, vol. 22(1), pages 137-151.
    30. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, EconWPA.
    31. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.
    32. Michael P. Clements & Ana Beatriz Galvao, 2009. "Forecasting US output growth using leading indicators: an appraisal using MIDAS models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(7), pages 1187-1206.
    33. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    34. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, June.
    35. Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
    36. K. Barhoumi & S. Benk & R. Cristadoro & A. Den Reijer & A. Jakaitiene & P. Jelonek & A. Rua & K. Ruth & C. Van Nieuwenhuyze & G. Rünstler, 2008. "Short-term forecasting of GDP using large monthly datasets – A pseudo real-time forecast evaluation exercise," Working Paper Research 133, National Bank of Belgium.
    37. Anindya Banerjee & Massimiliano Marcellino & Igor Masten, 2008. "Forecasting Macroeconomic Variables Using Diffusion Indexes in Short Samples with Structural Change," Working Papers 334, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    38. Garratt, Anthony & Koop, Gary & Mise, Emi & Vahey, Shaun P., 2009. "Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 480-491.
    39. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, Elsevier.
    40. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February.
    41. Massimiliano Marcellino, "undated". "Forecast pooling for short time series of macroeconomic variables," Working Papers 212, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    42. Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
    43. K. Barhoumi & S. Benk & R. Cristadoro & A. Den Reijer & A. Jakaitiene & P. Jelonek & A. Rua & K. Ruth & C. Van Nieuwenhuyze & G. Rünstler, 2008. "Short-term forecasting of GDP using large monthly datasets – A pseudo real-time forecast evaluation exercise," Working Paper Research 133, National Bank of Belgium.
    44. Jean Boivin & Serena Ng, 2005. "Understanding and Comparing Factor-Based Forecasts," International Journal of Central Banking, International Journal of Central Banking, vol. 1(3), December.
    45. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    46. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
    47. Katrin Assenmacher-Wesche & M. Hashem Pesaran, 2008. "Forecasting the Swiss Economy Using Vecx* Models: an Exercise in Forecast Combination Across Models and Observation Windows," National Institute Economic Review, National Institute of Economic and Social Research, vol. 203(1), pages 91-108, January.
    48. Clements, Michael P & Galvão, Ana Beatriz, 2008. "Macroeconomic Forecasting With Mixed-Frequency Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 546-554.
    49. Campbell, Sean D., 2007. "Macroeconomic Volatility, Predictability, and Uncertainty in the Great Moderation: Evidence From the Survey of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 191-200, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Claudia FORONI & Massimiliano MARCELLINO, 2012. "A Comparison of Mixed Frequency Approaches for Modelling Euro Area Macroeconomic Variables," Economics Working Papers ECO2012/07, European University Institute.
    2. Drechsel, Katja & Scheufele, Rolf, 2010. "Should We Trust in Leading Indicators? Evidence from the Recent Recession," IWH Discussion Papers 10/2010, Halle Institute for Economic Research (IWH).
    3. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    4. Kuzin, Vladimir & Marcellino, Massimiliano & Schumacher, Christian, 2011. "MIDAS vs. mixed-frequency VAR: Nowcasting GDP in the euro area," International Journal of Forecasting, Elsevier, vol. 27(2), pages 529-542.
    5. Lenza Michele & Warmedinger Thomas, 2011. "A Factor Model for Euro-area Short-term Inflation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(1), pages 50-62, February.
    6. Bušs, Ginters, 2009. "Comparing forecasts of Latvia's GDP using simple seasonal ARIMA models and direct versus indirect approach," MPRA Paper 16684, University Library of Munich, Germany.
    7. Schumacher Christian, 2011. "Forecasting with Factor Models Estimated on Large Datasets: A Review of the Recent Literature and Evidence for German GDP," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(1), pages 28-49, February.
    8. Kai Carstensen & Steffen Henzel & Johannes Mayr & Klaus Wohlrabe, 2009. "IFOCAST: Methoden der ifo-Kurzfristprognose," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 62(23), pages 15-28, December.
    9. Drechsel, Katja & Scheufele, Rolf, 2012. "The performance of short-term forecasts of the German economy before and during the 2008/2009 recession," International Journal of Forecasting, Elsevier, vol. 28(2), pages 428-445.
    10. Siliverstovs Boriss & Kholodilin Konstantin A., 2012. "Assessing the Real-Time Informational Content of Macroeconomic Data Releases for Now-/Forecasting GDP: Evidence for Switzerland," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 232(4), pages 429-444, August.
    11. Katja Heinisch & Rolf Scheufele, 2018. "Bottom-up or direct? Forecasting German GDP in a data-rich environment," Empirical Economics, Springer, vol. 54(2), pages 705-745, March.
    12. Robert Lehmann & Klaus Wohlrabe, 2015. "Forecasting GDP at the Regional Level with Many Predictors," German Economic Review, Verein für Socialpolitik, vol. 16(2), pages 226-254, May.
    13. Kuzin, Vladimir N. & Marcellino, Massimiliano & Schumacher, Christian, 2009. "MIDAS versus mixed-frequency VAR: nowcasting GDP in the euro area," Discussion Paper Series 1: Economic Studies 2009,07, Deutsche Bundesbank.
    14. Marcus Scheiblecker, 2010. "Can the Inclusion of Calendar and Temperature Effects Improve Nowcasts and Forecasts of Construction Sector Output Based on Business Surveys?," WIFO Working Papers 374, WIFO.
    15. Klaus Wohlrabe, 2009. "Makroökonomische Prognosen mit gemischten Frequenzen," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 62(21), pages 22-33, November.
    16. Philipp an de Meulen & Martin Micheli & Torsten Schmidt, 2014. "Forecasting real estate prices in Germany: the role of consumer confidence," Journal of Property Research, Taylor & Francis Journals, vol. 31(3), pages 244-263, September.

    More about this item

    Keywords

    nowcasting; forecast combination; forecast pooling; model selection; mixed-frequency data; factor models; MIDAS;

    JEL classification:

    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eui:euiwps:eco2009/13. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Julia Valerio). General contact details of provider: http://edirc.repec.org/data/deiueit.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.