IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v78y2013i2p380-394.html
   My bibliography  Save this article

Factor Analysis with EM Algorithm Never Gives Improper Solutions when Sample Covariance and Initial Parameter Matrices Are Proper

Author

Listed:
  • Kohei Adachi

Abstract

Rubin and Thayer (Psychometrika, 47:69–76, 1982 ) proposed the EM algorithm for exploratory and confirmatory maximum likelihood factor analysis. In this paper, we prove the following fact: the EM algorithm always gives a proper solution with positive unique variances and factor correlations with absolute values that do not exceed one, when the covariance matrix to be analyzed and the initial matrices including unique variances and inter-factor correlations are positive definite. We further numerically demonstrate that the EM algorithm yields proper solutions for the data which lead the prevailing gradient algorithms for factor analysis to produce improper solutions. The numerical studies also show that, in real computations with limited numerical precision, Rubin and Thayer’s (Psychometrika, 47:69–76, 1982 ) original formulas for confirmatory factor analysis can make factor correlation matrices asymmetric, so that the EM algorithm fails to converge. However, this problem can be overcome by using an EM algorithm in which the original formulas are replaced by those guaranteeing the symmetry of factor correlation matrices, or by formulas used to prove the above fact. Copyright The Psychometric Society 2013

Suggested Citation

  • Kohei Adachi, 2013. "Factor Analysis with EM Algorithm Never Gives Improper Solutions when Sample Covariance and Initial Parameter Matrices Are Proper," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 380-394, April.
    • Handle: RePEc:spr:psycho:v:78:y:2013:i:2:p:380-394
    DOI: 10.1007/s11336-012-9299-8
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11336-012-9299-8
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11336-012-9299-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David Gerbing & James Anderson, 1987. "Improper solutions in the analysis of covariance structures: Their interpretability and a comparison of alternate respecifications," Psychometrika, Springer;The Psychometric Society, vol. 52(1), pages 99-111, March.
    2. Kuroda, Masahiro & Sakakihara, Michio, 2006. "Accelerating the convergence of the EM algorithm using the vector [epsilon] algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 51(3), pages 1549-1561, December.
    3. Otto Driel, 1978. "On various causes of improper solutions in maximum likelihood factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 43(2), pages 225-243, June.
    4. Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 47(1), pages 69-76, March.
    5. James Anderson & David Gerbing, 1984. "The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 49(2), pages 155-173, June.
    6. Robert Jennrich & Stephen Robinson, 1969. "A Newton-Raphson algorithm for maximum likelihood factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 34(1), pages 111-123, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kohei Adachi, 2022. "Factor Analysis Procedures Revisited from the Comprehensive Model with Unique Factors Decomposed into Specific Factors and Errors," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 967-991, September.
    2. Lorenzo Finesso & Peter Spreij, 2016. "Factor analysis models via I-divergence optimization," Psychometrika, Springer;The Psychometric Society, vol. 81(3), pages 702-726, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kei Hirose & Miyuki Imada, 2018. "Sparse factor regression via penalized maximum likelihood estimation," Statistical Papers, Springer, vol. 59(2), pages 633-662, June.
    2. Ihara, Masamori & Kano, Yutaka, 1995. "Identifiability of full, marginal, and conditional factor analysis models," Statistics & Probability Letters, Elsevier, vol. 23(4), pages 343-350, June.
    3. Ke-Hai Yuan & Ying Cheng & Wei Zhang, 2010. "Determinants of Standard Errors of MLEs in Confirmatory Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 633-648, December.
    4. Clement Stone & Michael Sobel, 1990. "The robustness of estimates of total indirect effects in covariance structure models estimated by maximum," Psychometrika, Springer;The Psychometric Society, vol. 55(2), pages 337-352, June.
    5. Yutaka Kano, 1990. "Noniterative estimation and the choice of the number of factors in exploratory factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 55(2), pages 277-291, June.
    6. Feinian Chen & Kenneth A. Bollen & Pamela Paxton & Patrick J. Curran & James B. Kirby, 2001. "Improper Solutions in Structural Equation Models," Sociological Methods & Research, , vol. 29(4), pages 468-508, May.
    7. P. M. Bentler & Chih-Ping Chou, 1987. "Practical Issues in Structural Modeling," Sociological Methods & Research, , vol. 16(1), pages 78-117, August.
    8. Roderick McDonald, 1986. "Describing the elephant: Structure and function in multivariate data," Psychometrika, Springer;The Psychometric Society, vol. 51(4), pages 513-534, December.
    9. Anne Boomsma, 1985. "Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation," Psychometrika, Springer;The Psychometric Society, vol. 50(2), pages 229-242, June.
    10. Lorenzo Finesso & Peter Spreij, 2016. "Factor analysis models via I-divergence optimization," Psychometrika, Springer;The Psychometric Society, vol. 81(3), pages 702-726, September.
    11. Luke Butcher & Ian Phau & Min Teah, 2016. "Brand prominence in luxury consumption: Will emotional value adjudicate our longing for status?," Journal of Brand Management, Palgrave Macmillan, vol. 23(6), pages 701-715, November.
    12. Enno Siemsen & Kenneth A. Bollen, 2007. "Least Absolute Deviation Estimation in Structural Equation Modeling," Sociological Methods & Research, , vol. 36(2), pages 227-265, November.
    13. Aßmann, Christian & Boysen-Hogrefe, Jens & Pape, Markus, 2012. "The directional identification problem in Bayesian factor analysis: An ex-post approach," Kiel Working Papers 1799, Kiel Institute for the World Economy (IfW Kiel).
    14. Mansoora Ahmed & Sun Zehou & Syed Ali Raza & Muhammad Asif Qureshi & Sara Qamar Yousufi, 2020. "Impact of CSR and environmental triggers on employee green behavior: The mediating effect of employee well‐being," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 27(5), pages 2225-2239, September.
    15. Chen, Derek H. C. & Gawande, Kishore, 2007. "Underlying dimensions of knowledge assessment : factor analysis of the knowledge assessment methodology data," Policy Research Working Paper Series 4216, The World Bank.
    16. Wen Tang & Xiangyang Zhang & Youyi Tian, 2023. "Investigating Lifelong Learners’ Continuing Learning Intention Moderated by Affective Support in Online Learning," Sustainability, MDPI, vol. 15(3), pages 1-18, January.
    17. Sharifah Rahama Amirul & Khairul Hanim Pazim & Sharifah Milda Amirul & Rasid Mail & Jakaria Dasan, 2022. "Developing and validating the qualitative labour productivity measurement in service industry," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(4), pages 2853-2874, August.
    18. María Luisa Pajuelo Moreno & Teresa Duarte-Atoche, 2019. "Relationship between Sustainable Disclosure and Performance—An Extension of Ullmann’s Model," Sustainability, MDPI, vol. 11(16), pages 1-33, August.
    19. Jin, Shaobo & Moustaki, Irini & Yang-Wallentin, Fan, 2018. "Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case," LSE Research Online Documents on Economics 88118, London School of Economics and Political Science, LSE Library.
    20. Kailun Fang & Suzana Ariff Azizan & Yifei Wu, 2023. "Low-Carbon Community Regeneration in China: A Case Study in Dadong," Sustainability, MDPI, vol. 15(5), pages 1-15, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:78:y:2013:i:2:p:380-394. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.