IDEAS home Printed from https://ideas.repec.org/p/cte/wsrepe/ws1502.html
   My bibliography  Save this paper

Small versus big-data factor extraction in Dynamic Factor Models: An empirical assessment

Author

Listed:
  • Ruiz Ortega, Esther
  • Poncela, Pilar

Abstract

In the context of Dynamic Factor Models (DFM), we compare point and interval estimates of the underlying unobserved factors extracted using small and big-data procedures. Our paper differs from previous works in the related literature in several ways. First, we focus on factor extraction rather than on prediction of a given variable in the system. Second, the comparisons are carried out by implementing the procedures considered to the same data. Third, we are interested not only on point estimates but also on confidence intervals for the factors. Based on a simulated system and the macroeconomic data set popularized by Stock and Watson (2012), we show that, for a given procedure, factor estimates based on different cross-sectional dimensions are highly correlated. On the other hand, given the cross-sectional dimension, the Maximum Likelihood Kalman filter and smoother (KFS) factor estimates are highly correlated with those obtained using hybrid Principal Components (PC) and KFS procedures. The PC estimates are somehow less correlated. Finally, the PC intervals based on asymptotic approximations are unrealistically tiny.

Suggested Citation

  • Ruiz Ortega, Esther & Poncela, Pilar, 2015. "Small versus big-data factor extraction in Dynamic Factor Models: An empirical assessment," DES - Working Papers. Statistics and Econometrics. WS ws1502, Universidad Carlos III de Madrid. Departamento de Estadística.
  • Handle: RePEc:cte:wsrepe:ws1502
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/20103/ws1502.pdf?sequence=1
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Banerjee, Anindya & Marcellino, Massimiliano & Masten, Igor, 2014. "Forecasting with factor-augmented error correction models," International Journal of Forecasting, Elsevier, vol. 30(3), pages 589-612.
    2. Kapetanios, George, 2010. "A Testing Procedure for Determining the Number of Factors in Approximate Factor Models With Large Datasets," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(3), pages 397-409.
    3. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    4. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.
    5. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    6. Olaf Hübler & Jachim Frohn (ed.), 2006. "Modern Econometric Analysis," Springer Books, Springer, number 978-3-540-32693-9, September.
    7. Diebold, Francis X & Nerlove, Marc, 1989. "The Dynamics of Exchange Rate Volatility: A Multivariate Latent Factor Arch Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(1), pages 1-21, Jan.-Mar..
    8. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic Factor Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 3, pages 25-40, Springer.
    9. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    10. Banbura, Marta & Rünstler, Gerhard, 2011. "A look into the factor model black box: Publication lags and the role of hard and soft data in forecasting GDP," International Journal of Forecasting, Elsevier, vol. 27(2), pages 333-346, April.
    11. Alexei Onatski, 2009. "Testing Hypotheses About the Number of Factors in Large Factor Models," Econometrica, Econometric Society, vol. 77(5), pages 1447-1479, September.
    12. Maximiano Pinheiro & António Rua & Francisco Dias, 2013. "Dynamic Factor Models with Jagged Edge Panel Data: Taking on Board the Dynamics of the Idiosyncratic Components," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(1), pages 80-102, February.
    13. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    14. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    15. Claudia M. Buch & Sandra Eickmeier & Esteban Prieto, 2014. "Macroeconomic Factors and Microlevel Bank Behavior," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 46(4), pages 715-751, June.
    16. Fiorentini, Gabriele & Galesi, Alessandro & Sentana, Enrique, 2018. "A spectral EM algorithm for dynamic factor models," Journal of Econometrics, Elsevier, vol. 205(1), pages 249-279.
    17. Choi, In, 2012. "Efficient Estimation Of Factor Models," Econometric Theory, Cambridge University Press, vol. 28(2), pages 274-308, April.
    18. Stock, James H. & Watson, Mark, 2011. "Dynamic Factor Models," Scholarly Articles 28469541, Harvard University Department of Economics.
    19. Koopman, Siem Jan & van der Wel, Michel, 2013. "Forecasting the US term structure of interest rates using a macroeconomic smooth dynamic factor model," International Journal of Forecasting, Elsevier, vol. 29(4), pages 676-694.
    20. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
    21. Aruoba, S. BoraÄŸan & Diebold, Francis X. & Scotti, Chiara, 2009. "Real-Time Measurement of Business Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 417-427.
    22. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818742, October.
    23. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524117, October.
    24. Maximo Camacho & Gabriel Perez-Quiros, 2010. "Introducing the euro-sting: Short-term indicator of euro area growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 663-694.
    25. Cecilia Frale & Massimiliano Marcellino & Gian Luigi Mazzi & Tommaso Proietti, 2011. "EUROMIND: a monthly indicator of the euro area economic conditions," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 439-470, April.
    26. Alejandro Rodriguez & Esther Ruiz, 2009. "Bootstrap prediction intervals in state–space models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 167-178, March.
    27. Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
    28. Bai, Jushan & Ng, Serena, 2006. "Evaluating latent and observed factors in macroeconomics and finance," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 507-537.
    29. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    30. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    31. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    32. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    33. Giovanni Caggiano & George Kapetanios & Vincent Labhard, 2011. "Are more data always better for factor analysis? Results for the euro area, the six largest euro area countries and the UK," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(8), pages 736-752, December.
    34. Bräuning, Falk & Koopman, Siem Jan, 2014. "Forecasting macroeconomic variables using collapsed dynamic factor analysis," International Journal of Forecasting, Elsevier, vol. 30(3), pages 572-584.
    35. M. Ayhan Kose & Christopher Otrok & Charles H. Whiteman, 2003. "International Business Cycles: World, Region, and Country-Specific Factors," American Economic Review, American Economic Association, vol. 93(4), pages 1216-1239, September.
    36. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818735, October.
    37. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524124, October.
    38. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    39. Onatski, Alexei, 2012. "Asymptotics of the principal components estimator of large factor models with weakly influential factors," Journal of Econometrics, Elsevier, vol. 168(2), pages 244-258.
    40. Rodríguez, Alejandro & Ruiz, Esther, 2012. "Bootstrap prediction mean squared errors of unobserved states based on the Kalman filter with estimated parameters," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 62-74, January.
    41. Filippo Altissimo & Riccardo Cristadoro & Mario Forni & Marco Lippi & Giovanni Veronese, 2010. "New Eurocoin: Tracking Economic Growth in Real Time," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1024-1034, November.
    42. Alessi, Lucia & Barigozzi, Matteo & Capasso, Marco, 2010. "Improved penalization for determining the number of factors in approximate factor models," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1806-1813, December.
    43. Bai, Jushan & Wang, Peng, 2014. "Identification theory for high dimensional static and dynamic factor models," Journal of Econometrics, Elsevier, vol. 178(2), pages 794-804.
    44. Romain Houssa & Lasse Bork & Hans Dewachter, 2008. "Identification of Macroeconomic Factors in Large Panels," Working Papers 1010, University of Namur, Department of Economics.
    45. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818728, October.
    46. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    47. repec:hal:journl:peer-00844811 is not listed on IDEAS
    48. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524131, October.
    49. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," Review of Economic Studies, Oxford University Press, vol. 61(2), pages 247-264.
    50. Alvarez, Rocio & Camacho, Maximo & Pérez-Quirós, Gabriel, 2012. "Finite sample performance of small versus large scale dynamic factor models," CEPR Discussion Papers 8867, C.E.P.R. Discussion Papers.
    51. Amengual, Dante & Watson, Mark W., 2007. "Consistent Estimation of the Number of Dynamic Factors in a Large N and T Panel," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 91-96, January.
    52. Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
    53. Jörg Breitung & Uta Pigorsch, 2013. "A Canonical Correlation Approach for Selecting the Number of Dynamic Factors," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(1), pages 23-36, February.
    54. Jungbacker, B. & Koopman, S.J. & van der Wel, M., 2011. "Maximum likelihood estimation for dynamic factor models with missing data," Journal of Economic Dynamics and Control, Elsevier, vol. 35(8), pages 1358-1368, August.
    55. Buch, Claudia M. & Eickmeier, Sandra & Prieto, Esteban, 2010. "Macroeconomic factors and micro-level bank risk," Discussion Paper Series 1: Economic Studies 2010,20, Deutsche Bundesbank.
    56. Hallin, Marc & Liska, Roman, 2007. "Determining the Number of Factors in the General Dynamic Factor Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 603-617, June.
    57. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    58. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    59. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    60. Tibor F. Liska, 2007. "The Liska model," Society and Economy, Akadémiai Kiadó, Hungary, vol. 29(3), pages 363-381, December.
    61. Bai, Jushan & Ng, Serena, 2008. "Large Dimensional Factor Analysis," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(2), pages 89-163, June.
    62. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maldonado, Javier & Ruiz Ortega, Esther, 2017. "Accurate Subsampling Intervals of Principal Components Factors," DES - Working Papers. Statistics and Econometrics. WS 23974, Universidad Carlos III de Madrid. Departamento de Estadística.
    2. Miranda Gualdrón, Karen Alejandra & Poncela, Pilar & Ruiz Ortega, Esther, 2021. "Dynamic factor models: does the specification matter?," DES - Working Papers. Statistics and Econometrics. WS 32210, Universidad Carlos III de Madrid. Departamento de Estadística.
    3. Francisco Corona & Pilar Poncela & Esther Ruiz, 2020. "Estimating Non-stationary Common Factors: Implications for Risk Sharing," Computational Economics, Springer;Society for Computational Economics, vol. 55(1), pages 37-60, January.
    4. Kaufmann, Daniel & Scheufele, Rolf, 2017. "Business tendency surveys and macroeconomic fluctuations," International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
    5. Francisco Corona & Pilar Poncela & Esther Ruiz, 2017. "Determining the number of factors after stationary univariate transformations," Empirical Economics, Springer, vol. 53(1), pages 351-372, August.
    6. Alonso, Andrés M. & Galeano, Pedro & Peña, Daniel, 2020. "A robust procedure to build dynamic factor models with cluster structure," Journal of Econometrics, Elsevier, vol. 216(1), pages 35-52.
    7. Francisco Corona & Pedro Orraca, 2019. "Remittances in Mexico and their unobserved components," The Journal of International Trade & Economic Development, Taylor & Francis Journals, vol. 28(8), pages 1047-1066, November.
    8. Poncela, Pilar & Ruiz, Esther, 2020. "A comment on the dynamic factor model with dynamic factors," Economics Discussion Papers 2020-7, Kiel Institute for the World Economy (IfW Kiel).
    9. Francisco Corona & Graciela Gonz'alez-Far'ias & Jes'us L'opez-P'erez, 2021. "A nowcasting approach to generate timely estimates of Mexican economic activity: An application to the period of COVID-19," Papers 2101.10383, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," PSE Working Papers halshs-02262202, HAL.
    2. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
    3. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    4. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    5. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    6. Francisco Corona & Pilar Poncela & Esther Ruiz, 2017. "Determining the number of factors after stationary univariate transformations," Empirical Economics, Springer, vol. 53(1), pages 351-372, August.
    7. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    8. Kihwan Kim & Norman Swanson, 2013. "Diffusion Index Model Specification and Estimation Using Mixed Frequency Datasets," Departmental Working Papers 201315, Rutgers University, Department of Economics.
    9. Jörg Breitung & In Choi, 2013. "Factor models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 11, pages 249-265, Edward Elgar Publishing.
      • In Choi & Jorg Breitung, 2011. "Factor models," Working Papers 1121, Research Institute for Market Economy, Sogang University, revised Dec 2011.
    10. Poncela, Pilar & Ruiz Ortega, Esther, 2012. "More is not always better : back to the Kalman filter in dynamic factor models," DES - Working Papers. Statistics and Econometrics. WS ws122317, Universidad Carlos III de Madrid. Departamento de Estadística.
    11. Matteo Barigozzi & Marco Lippi & Matteo Luciani, 2016. "Non-Stationary Dynamic Factor Models for Large Datasets," Finance and Economics Discussion Series 2016-024, Board of Governors of the Federal Reserve System (U.S.).
    12. Helmut Lütkepohl, 2014. "Structural Vector Autoregressive Analysis in a Data Rich Environment: A Survey," Discussion Papers of DIW Berlin 1351, DIW Berlin, German Institute for Economic Research.
    13. Francisco Corona & Graciela González-Farías & Pedro Orraca, 2017. "A dynamic factor model for the Mexican economy: are common trends useful when predicting economic activity?," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 26(1), pages 1-35, December.
    14. Matteo Barigozzi & Antonio M. Conti & Matteo Luciani, 2014. "Do Euro Area Countries Respond Asymmetrically to the Common Monetary Policy?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 693-714, October.
    15. Vladimir Kuzin & Massimiliano Marcellino & Christian Schumacher, 2009. "Pooling versus Model Selection for Nowcasting with Many Predictors: An Application to German GDP," Economics Working Papers ECO2009/13, European University Institute.
    16. Bai, Jushan & Liao, Yuan, 2016. "Efficient estimation of approximate factor models via penalized maximum likelihood," Journal of Econometrics, Elsevier, vol. 191(1), pages 1-18.
    17. Marcellino, Massimiliano & Schumacher, Christian, 2007. "Factor-MIDAS for now- and forecasting with ragged-edge data: a model comparison for German GDP," Discussion Paper Series 1: Economic Studies 2007,34, Deutsche Bundesbank.
    18. Barigozzi, Matteo & Lippi, Marco & Luciani, Matteo, 2021. "Large-dimensional Dynamic Factor Models: Estimation of Impulse–Response Functions with I(1) cointegrated factors," Journal of Econometrics, Elsevier, vol. 221(2), pages 455-482.
    19. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2015. "Dynamic factor models with infinite-dimensional factor spaces: One-sided representations," Journal of Econometrics, Elsevier, vol. 185(2), pages 359-371.
    20. Stock, James H. & Watson, Mark, 2011. "Dynamic Factor Models," Scholarly Articles 28469541, Harvard University Department of Economics.

    More about this item

    Keywords

    Confidence intervals;

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:wsrepe:ws1502. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://portal.uc3m.es/portal/page/portal/dpto_estadistica .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ana Poveda (email available below). General contact details of provider: http://portal.uc3m.es/portal/page/portal/dpto_estadistica .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.