IDEAS home Printed from https://ideas.repec.org/p/cmf/wpaper/wp2014_1411.html
   My bibliography  Save this paper

A Spectral EM Algorithm for Dynamic Factor Models

Author

Listed:

Abstract

We introduce a frequency domain version of the EM algorithm for general dynamic factor models. We consider both AR and ARMA processes, for which we develop iterative indirect inference procedures analogous to the algorithms in Hannan (1969). Although our proposed procedure allows researchers to estimate such models by maximum likelihood with many series even without good initial values, we recommend switching to a gradient method that uses the EM principle to swiftly compute frequency domain analytical scores near the optimum. We successfully employ our algorithm to construct an index that captures the common movements of US sectoral employment growth rates.

Suggested Citation

  • Gabriele Fiorentini & Alessandro Galesi & Enrique Sentana, 2014. "A Spectral EM Algorithm for Dynamic Factor Models," Working Papers wp2014_1411, CEMFI.
    • Handle: RePEc:cmf:wpaper:wp2014_1411
    as

    Download full text from publisher

    File URL: https://www.cemfi.es/ftp/wp/1411.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Narasimhan Jegadeesh & George Pennacchi, 1996. "The behavior of interest rates implied by the term structure of Eurodollar future," Proceedings, Federal Reserve Bank of Cleveland, issue Aug, pages 426-451.
    2. Gabriele Fiorentini & Enrique Sentana & Neil Shephard, 2004. "Likelihood-Based Estimation of Latent Generalized ARCH Structures," Econometrica, Econometric Society, vol. 72(5), pages 1481-1517, September.
    3. Eric Ghysels & Lynda Khalaf & Cosmé Vodounou, 2003. "Simulation Based Inference In Moving Average Models," Annals of Economics and Statistics, GENES, issue 69, pages 85-99.
    4. Forni, Mario & Lippi, Marco, 2001. "The Generalized Dynamic Factor Model: Representation Theory," Econometric Theory, Cambridge University Press, vol. 17(6), pages 1113-1141, December.
    5. Danny Quah & Thomas J. Sargent, 1993. "A Dynamic Index Model for Large Cross Sections," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 285-310, National Bureau of Economic Research, Inc.
    6. Abraham, Katharine G & Katz, Lawrence F, 1986. "Cyclical Unemployment: Sectoral Shifts or Aggregate Disturbances?," Journal of Political Economy, University of Chicago Press, vol. 94(3), pages 507-522, June.
    7. Ruud, Paul A., 1991. "Extensions of estimation methods using the EM algorithm," Journal of Econometrics, Elsevier, vol. 49(3), pages 305-341, September.
    8. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    9. Gabriele Fiorentini & Enrique Sentana, 2019. "Dynamic specification tests for dynamic factor models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 325-346, April.
    10. James H. Stock & Mark W. Watson, 1993. "Business Cycles, Indicators, and Forecasting," NBER Books, National Bureau of Economic Research, Inc, number stoc93-1, March.
    11. Peter Arcidiacono & John Bailey Jones, 2003. "Finite Mixture Distributions, Sequential Likelihood and the EM Algorithm," Econometrica, Econometric Society, vol. 71(3), pages 933-946, May.
    12. Lilien, David M, 1982. "Sectoral Shifts and Cyclical Unemployment," Journal of Political Economy, University of Chicago Press, vol. 90(4), pages 777-793, August.
    13. Mody, Ashoka & Taylor, Mark P., 2007. "Regional vulnerability: The case of East Asia," Journal of International Money and Finance, Elsevier, vol. 26(8), pages 1292-1310, December.
    14. Sentana, Enrique & Calzolari, Giorgio & Fiorentini, Gabriele, 2008. "Indirect estimation of large conditionally heteroskedastic factor models, with an application to the Dow 30 stocks," Journal of Econometrics, Elsevier, vol. 146(1), pages 10-25, September.
    15. Bergstrom, A.R., 1984. "Continuous time stochastic models and issues of aggregation over time," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 20, pages 1145-1212, Elsevier.
    16. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    17. Rogerson, Richard, 1987. "An Equilibrium Model of Sectoral Reallocation," Journal of Political Economy, University of Chicago Press, vol. 95(4), pages 824-834, August.
    18. Gabriele Fiorentini & Alessandro Galesi & Enrique Sentana, 2016. "Fast ML Estimation of Dynamic Bifactor Models: An Application to European Inflation," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 215-282, Emerald Group Publishing Limited.
    19. Gregory, Allan W & Head, Allen C & Raynauld, Jacques, 1997. "Measuring World Business Cycles," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 38(3), pages 677-701, August.
    20. Enrique Sentana, 1998. "The relation between conditionally heteroskedastic factor models and factor GARCH models," Econometrics Journal, Royal Economic Society, vol. 1(RegularPa), pages 1-9.
    21. Demos, Antonis & Sentana, Enrique, 1998. "An EM Algorithm for Conditionally Heteroscedastic Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(3), pages 357-361, July.
    22. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    23. Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 47(1), pages 69-76, March.
    24. Maravall, Agustin, 1993. "Stochastic linear trends : Models and estimators," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 5-37, March.
    25. Stock, James H. & Watson, Mark W. (ed.), 1993. "Business Cycles, Indicators, and Forecasting," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226774886, December.
    26. Enrique Sentana, 2000. "The Likelihood Function of Conditionally Heteroskedastic Factor Models," Annals of Economics and Statistics, GENES, issue 58, pages 1-19.
    27. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2015. "Dynamic factor models with infinite-dimensional factor spaces: One-sided representations," Journal of Econometrics, Elsevier, vol. 185(2), pages 359-371.
    28. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    29. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    30. Mardi Dungey & Vance L Martin & Adrian R Pagan, 2000. "A multivariate latent factor decomposition of international bond yield spreads," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 697-715.
    31. Diebold, Francis X & Rudebusch, Glenn D, 1996. "Measuring Business Cycles: A Modern Perspective," The Review of Economics and Statistics, MIT Press, vol. 78(1), pages 67-77, February.
    32. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
    33. R. H. Shumway & D. S. Stoffer, 1982. "An Approach To Time Series Smoothing And Forecasting Using The Em Algorithm," Journal of Time Series Analysis, Wiley Blackwell, vol. 3(4), pages 253-264, July.
    34. repec:adr:anecst:y:2003:i:69:p:04 is not listed on IDEAS
    35. Gabriele Fiorentini & Enrique Sentana, 2016. "Neglected serial correlation tests in UCARIMA models," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 7(1), pages 121-178, March.
    36. Watson, Mark W. & Kraft, Dennis F., 1984. "Testing the interpretation of indices in a macroeconomic index model," Journal of Monetary Economics, Elsevier, vol. 13(2), pages 165-181, March.
    37. Chambers, Marcus J. & Thornton, Michael A., 2012. "Discrete Time Representation Of Continuous Time Arma Processes," Econometric Theory, Cambridge University Press, vol. 28(1), pages 219-238, February.
    38. Lehmann, Bruce N. & Modest, David M., 1988. "The empirical foundations of the arbitrage pricing theory," Journal of Financial Economics, Elsevier, vol. 21(2), pages 213-254, September.
    39. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    40. Bai, Jushan & Ng, Serena, 2008. "Large Dimensional Factor Analysis," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(2), pages 89-163, June.
    41. James H. Stock & Mark W. Watson, 1993. "A Procedure for Predicting Recessions with Leading Indicators: Econometric Issues and Recent Experience," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 95-156, National Bureau of Economic Research, Inc.
    42. repec:adr:anecst:y:2000:i:58:p:01 is not listed on IDEAS
    43. Forni, Mario & Lippi, Marco, 2011. "The general dynamic factor model: One-sided representation results," Journal of Econometrics, Elsevier, vol. 163(1), pages 23-28, July.
    44. Diebold, Francis X. & Rudebusch, Glenn D. & Borag[caron]an Aruoba, S., 2006. "The macroeconomy and the yield curve: a dynamic latent factor approach," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 309-338.
    45. Chris Heaton & Victor Solo, 2004. "Identification of causal factor models of stationary time series," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 618-627, December.
    46. Watson, Mark W. & Engle, Robert F., 1983. "Alternative algorithms for the estimation of dynamic factor, mimic and varying coefficient regression models," Journal of Econometrics, Elsevier, vol. 23(3), pages 385-400, December.
    47. Hannan, E J & Nicholls, D F, 1972. "The Estimation of Mixed Regression, Autoregression, Moving Average, and Distributed Lag Models," Econometrica, Econometric Society, vol. 40(3), pages 529-547, May.
    48. Borus Jungbacker & Siem Jan Koopman, 2015. "Likelihood‐based dynamic factor analysis for measurement and forecasting," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 1-21, June.
    49. Chumacero Rómulo A., 2001. "Estimating ARMA Models Efficiently," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 5(2), pages 1-14, July.
    50. Barndorff-Nielsen, O. & Schou, G., 1973. "On the parametrization of autoregressive models by partial autocorrelations," Journal of Multivariate Analysis, Elsevier, vol. 3(4), pages 408-419, December.
    51. Sentana, Enrique, 2004. "Factor representing portfolios in large asset markets," Journal of Econometrics, Elsevier, vol. 119(2), pages 257-289, April.
    52. Geweke, John F & Singleton, Kenneth J, 1981. "Maximum Likelihood "Confirmatory" Factor Analysis of Economic Time Series," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 22(1), pages 37-54, February.
    53. Nidhan Choudhuri, 2004. "Contiguity of the Whittle measure for a Gaussian time series," Biometrika, Biometrika Trust, vol. 91(1), pages 211-218, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gabriele Fiorentini & Alessandro Galesi & Enrique Sentana, 2016. "Fast ML Estimation of Dynamic Bifactor Models: An Application to European Inflation," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 215-282, Emerald Group Publishing Limited.
    2. Gabriele Fiorentini & Enrique Sentana, 2016. "Neglected serial correlation tests in UCARIMA models," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 7(1), pages 121-178, March.
    3. Martín Almuzara & Gabriele Fiorentini & Enrique Sentana, 2023. "Aggregate Output Measurements: A Common Trend Approach," Advances in Econometrics, in: Essays in Honor of Joon Y. Park: Econometric Methodology in Empirical Applications, volume 45, pages 3-33, Emerald Group Publishing Limited.
    4. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    5. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    6. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    7. Gabriele Fiorentini & Enrique Sentana, 2019. "Dynamic specification tests for dynamic factor models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 325-346, April.
    8. Dickhaus, Thorsten & Sirotko-Sibirskaya, Natalia, 2019. "Simultaneous statistical inference in dynamic factor models: Chi-square approximation and model-based bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 30-46.
    9. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," PSE Working Papers halshs-02262202, HAL.
    10. Pilar Poncela & Esther Ruiz, 2016. "Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 401-434, Emerald Group Publishing Limited.
    11. Martín Almuzara & Dante Amengual & Enrique Sentana, 2019. "Normality tests for latent variables," Quantitative Economics, Econometric Society, vol. 10(3), pages 981-1017, July.
    12. Matteo Barigozzi, 2023. "Quasi Maximum Likelihood Estimation of High-Dimensional Factor Models: A Critical Review," Papers 2303.11777, arXiv.org, revised Dec 2023.
    13. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
    14. Riccardo (Jack) Lucchetti & Ioannis A. Venetis, 2019. "Dynamic Factor Models in gretl. The DFM package," gretl working papers 7, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    15. Michael Creel, 2021. "Inference Using Simulated Neural Moments," Econometrics, MDPI, vol. 9(4), pages 1-15, September.
    16. Alonso Fernández, Andrés Modesto & Bastos, Guadalupe & García-Martos, Carolina, 2017. "BIAS correction for dynamic factor models," DES - Working Papers. Statistics and Econometrics. WS 24029, Universidad Carlos III de Madrid. Departamento de Estadística.
    17. Matteo Barigozzi & Matteo Luciani, 2019. "Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm," Papers 1910.03821, arXiv.org, revised Feb 2022.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriele Fiorentini & Enrique Sentana, 2019. "Dynamic specification tests for dynamic factor models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 325-346, April.
    2. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    3. Gabriele Fiorentini & Alessandro Galesi & Enrique Sentana, 2016. "Fast ML Estimation of Dynamic Bifactor Models: An Application to European Inflation," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 215-282, Emerald Group Publishing Limited.
    4. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," PSE Working Papers halshs-02262202, HAL.
    5. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    6. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
    7. Borus Jungbacker & Siem Jan Koopman, 2015. "Likelihood‐based dynamic factor analysis for measurement and forecasting," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 1-21, June.
    8. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    9. Koopman, Siem Jan & van der Wel, Michel, 2013. "Forecasting the US term structure of interest rates using a macroeconomic smooth dynamic factor model," International Journal of Forecasting, Elsevier, vol. 29(4), pages 676-694.
    10. Borus Jungbacker & Siem Jan Koopman, 2008. "Likelihood-based Analysis for Dynamic Factor Models," Tinbergen Institute Discussion Papers 08-007/4, Tinbergen Institute, revised 20 Mar 2014.
    11. Matteo Barigozzi, 2023. "Quasi Maximum Likelihood Estimation of High-Dimensional Factor Models: A Critical Review," Papers 2303.11777, arXiv.org, revised Dec 2023.
    12. Borus Jungbacker & Siem Jan Koopman & Michel van der Wel, 0000. "Dynamic Factor Models with Smooth Loadings for Analyzing the Term Structure of Interest Rates," Tinbergen Institute Discussion Papers 09-041/4, Tinbergen Institute, revised 17 Sep 2010.
    13. Bork, Lasse, 2009. "Estimating US Monetary Policy Shocks Using a Factor-Augmented Vector Autoregression: An EM Algorithm Approach," Finance Research Group Working Papers F-2009-03, University of Aarhus, Aarhus School of Business, Department of Business Studies.
    14. Gabriele Fiorentini & Enrique Sentana, 2009. "Dynamic Specification Tests for Static Factor Models," Working Papers wp2009_0912, CEMFI.
    15. Reichlin, Lucrezia, 2002. "Factor Models in Large Cross-Sections of Time Series," CEPR Discussion Papers 3285, C.E.P.R. Discussion Papers.
    16. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    17. Diebold, Francis X & Rudebusch, Glenn D, 1996. "Measuring Business Cycles: A Modern Perspective," The Review of Economics and Statistics, MIT Press, vol. 78(1), pages 67-77, February.
    18. George Kapetanios & Massimiliano Marcellino, 2009. "A parametric estimation method for dynamic factor models of large dimensions," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 208-238, March.
    19. Gabriele Fiorentini & Enrique Sentana, 2012. "Tests for Serial Dependence in Static, Non-Gaussian Factor Models," Working Papers wp2012_1211, CEMFI.
    20. Grace Lee, 2011. "Aggregate shocks decomposition for eight East Asian countries," Journal of the Asia Pacific Economy, Taylor & Francis Journals, vol. 16(2), pages 215-232.

    More about this item

    Keywords

    Indirect inference; Kalman filter; sectoral employment; spectral maximum likelihood; Wiener-Kolmogorov filter.;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cmf:wpaper:wp2014_1411. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Araceli Requerey (email available below). General contact details of provider: https://edirc.repec.org/data/cemfies.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.