IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v64y2023i3d10.1007_s00181-022-02289-3.html
   My bibliography  Save this article

Mixing mixed frequency and diffusion indices in good times and in bad: an assessment based on historical data around the great recession of 2008

Author

Listed:
  • Kihwan Kim

    (Korea Energy Economics Institute)

  • Hyun Hak Kim

    (Kookmin University)

  • Norman R. Swanson

    (Rutgers University)

Abstract

In this paper, we analyze the forecasting performance associated with using machine learning, shrinkage, and variable selection methods during a historical period that contains the Great Recession of 2008. We find that these methods are most useful during “low” GDP growth periods, while simple autoregressive models are adequate during “high growth” periods. This finding stems from the introduction of very simple “hybrid” models that employ dynamic recursive (rolling) thresholding in order to switch between benchmark linear models and more complex index-driven models, depending on GDP growth conditions. In the context of predicting both quarterly real GDP growth and CPI inflation, these hybrid models are found to be superior, for all forecast horizons. When comparing the hybrid models against a host of alternatives, mean square forecast error gains reach as high as 35%, during the Great Recession, and remain significant throughout our entire prediction period. Additionally, the very best short-term GDP forecasting models contain variants of the Aruoba et al. (2009) business conditions index, although these models are most useful when diffusion indices are also incorporated. Thus, mixing mixed frequency and diffusion indices matters. Finally, across all experiments, we find strong new evidence of the usefulness of survey predictions, including those from the Survey of Professional Forecasters, and those from the Livingston Survey. While we leave the examination of alternative datasets, such as those including other recessionary periods, episodes of war, and epidemics to future research, we hypothesize that the findings in this paper point to the potential usefulness of machine learning, shrinkage, and variable selection methods during recessions, as well as to the usefulness of the hybrid models that we introduce.

Suggested Citation

  • Kihwan Kim & Hyun Hak Kim & Norman R. Swanson, 2023. "Mixing mixed frequency and diffusion indices in good times and in bad: an assessment based on historical data around the great recession of 2008," Empirical Economics, Springer, vol. 64(3), pages 1421-1469, March.
  • Handle: RePEc:spr:empeco:v:64:y:2023:i:3:d:10.1007_s00181-022-02289-3
    DOI: 10.1007/s00181-022-02289-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-022-02289-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-022-02289-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Roberto S. Mariano & Yasutomo Murasawa, 2003. "A new coincident index of business cycles based on monthly and quarterly series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 427-443.
    2. Eric Ghysels & Arthur Sinko & Rossen Valkanov, 2007. "MIDAS Regressions: Further Results and New Directions," Econometric Reviews, Taylor & Francis Journals, vol. 26(1), pages 53-90.
    3. S. Boragan Aruoba & Francis X. Diebold, 2010. "Real-Time Macroeconomic Monitoring: Real Activity, Inflation, and Interactions," American Economic Review, American Economic Association, vol. 100(2), pages 20-24, May.
    4. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    5. Camacho, Maximo & Perez Quiros, Gabriel & Poncela, Pilar, 2014. "Green shoots and double dips in the euro area: A real time measure," International Journal of Forecasting, Elsevier, vol. 30(3), pages 520-535.
    6. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    7. Camacho, Maximo & Perez-Quiros, Gabriel & Poncela, Pilar, 2018. "Markov-switching dynamic factor models in real time," International Journal of Forecasting, Elsevier, vol. 34(4), pages 598-611.
    8. Bai, Jushan & Ng, Serena, 2013. "Principal components estimation and identification of static factors," Journal of Econometrics, Elsevier, vol. 176(1), pages 18-29.
    9. Hyun Hak Kim & Norman R. Swanson, 2018. "Methods for backcasting, nowcasting and forecasting using factor†MIDAS: With an application to Korean GDP," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(3), pages 281-302, April.
    10. Ghysels, Eric & Santa-Clara, Pedro & Valkanov, Rossen, 2006. "Predicting volatility: getting the most out of return data sampled at different frequencies," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 59-95.
    11. Rossi, Barbara & Sekhposyan, Tatevik, 2010. "Have economic models' forecasting performance for US output growth and inflation changed over time, and when?," International Journal of Forecasting, Elsevier, vol. 26(4), pages 808-835, October.
    12. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    13. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    14. Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
    15. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    16. Bai, Jushan & Ng, Serena, 2006. "Evaluating latent and observed factors in macroeconomics and finance," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 507-537.
    17. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    18. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    19. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    20. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    21. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    22. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    23. Alexei Onatski, 2009. "Testing Hypotheses About the Number of Factors in Large Factor Models," Econometrica, Econometric Society, vol. 77(5), pages 1447-1479, September.
    24. Aruoba, S. BoraÄŸan & Diebold, Francis X. & Scotti, Chiara, 2009. "Real-Time Measurement of Business Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 417-427.
    25. Tibor F. Liska, 2007. "The Liska model," Society and Economy, Akadémiai Kiadó, Hungary, vol. 29(3), pages 363-381, December.
    26. Jushan Bai & Serena Ng, 2009. "Boosting diffusion indices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 607-629.
    27. Jushan Bai, 2003. "Testing Parametric Conditional Distributions of Dynamic Models," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 531-549, August.
    28. James H. Stock & Mark W. Watson, 1988. "A Probability Model of The Coincident Economic Indicators," NBER Working Papers 2772, National Bureau of Economic Research, Inc.
    29. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    30. Mario Forni & Lucrezia Reichlin, 1998. "Let's Get Real: A Factor Analytical Approach to Disaggregated Business Cycle Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 453-473.
    31. Corradi, Valentina & Swanson, Norman R., 2014. "Testing for structural stability of factor augmented forecasting models," Journal of Econometrics, Elsevier, vol. 182(1), pages 100-118.
    32. Jean Boivin & Serena Ng, 2005. "Understanding and Comparing Factor-Based Forecasts," International Journal of Central Banking, International Journal of Central Banking, vol. 1(3), December.
    33. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    34. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    35. Hallin, Marc & Liska, Roman, 2007. "Determining the Number of Factors in the General Dynamic Factor Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 603-617, June.
    36. Nathan S. Balke & Michael Fulmer & Ren Zhang, 2017. "Incorporating the Beige Book into a Quantitative Index of Economic Activity," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(5), pages 497-514, August.
    37. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    38. Clements, Michael P & Galvão, Ana Beatriz, 2008. "Macroeconomic Forecasting With Mixed-Frequency Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 546-554.
    39. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    2. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," PSE Working Papers halshs-02262202, HAL.
    3. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
    4. Kihwan Kim & Norman Swanson, 2013. "Diffusion Index Model Specification and Estimation Using Mixed Frequency Datasets," Departmental Working Papers 201315, Rutgers University, Department of Economics.
    5. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    6. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    7. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    8. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    9. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 51(3), pages 695-746, August.
    10. Pilar Poncela & Esther Ruiz, 2016. "Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 401-434, Emerald Group Publishing Limited.
    11. Gupta, Rangan & Kabundi, Alain, 2011. "A large factor model for forecasting macroeconomic variables in South Africa," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1076-1088, October.
    12. Nii Ayi Armah & Norman Swanson, 2010. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 476-510.
    13. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    14. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    15. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    16. Stock, James H. & Watson, Mark, 2011. "Dynamic Factor Models," Scholarly Articles 28469541, Harvard University Department of Economics.
    17. Guido Bulligan & Roberto Golinelli & Giuseppe Parigi, 2010. "Forecasting monthly industrial production in real-time: from single equations to factor-based models," Empirical Economics, Springer, vol. 39(2), pages 303-336, October.
    18. Proietti, Tommaso, 2008. "Estimation of Common Factors under Cross-Sectional and Temporal Aggregation Constraints: Nowcasting Monthly GDP and its Main Components," MPRA Paper 6860, University Library of Munich, Germany.
    19. Norman R. Swanson & Weiqi Xiong & Xiye Yang, 2020. "Predicting interest rates using shrinkage methods, real‐time diffusion indexes, and model combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 587-613, August.
    20. Luciani, Matteo, 2014. "Forecasting with approximate dynamic factor models: The role of non-pervasive shocks," International Journal of Forecasting, Elsevier, vol. 30(1), pages 20-29.

    More about this item

    Keywords

    Forecasting; Diffusion index; Mixed frequency data; Factor model; Recursive estimation; Kalman filter;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:64:y:2023:i:3:d:10.1007_s00181-022-02289-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.