IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v89y2024i1d10.1007_s11336-022-09874-6.html
   My bibliography  Save this article

Regularized Variational Estimation for Exploratory Item Factor Analysis

Author

Listed:
  • April E. Cho

    (University of Michigan)

  • Jiaying Xiao

    (University of Washington)

  • Chun Wang

    (University of Washington)

  • Gongjun Xu

    (University of Michigan)

Abstract

Item factor analysis (IFA), also known as Multidimensional Item Response Theory (MIRT), is a general framework for specifying the functional relationship between respondents’ multiple latent traits and their responses to assessment items. The key element in MIRT is the relationship between the items and the latent traits, so-called item factor loading structure. The correct specification of this loading structure is crucial for accurate calibration of item parameters and recovery of individual latent traits. This paper proposes a regularized Gaussian Variational Expectation Maximization (GVEM) algorithm to efficiently infer item factor loading structure directly from data. The main idea is to impose an adaptive $$L_1$$ L 1 -type penalty to the variational lower bound of the likelihood to shrink certain loadings to 0. This new algorithm takes advantage of the computational efficiency of GVEM algorithm and is suitable for high-dimensional MIRT applications. Simulation studies show that the proposed method accurately recovers the loading structure and is computationally efficient. The new method is also illustrated using the National Education Longitudinal Study of 1988 (NELS:88) mathematics and science assessment data.

Suggested Citation

  • April E. Cho & Jiaying Xiao & Chun Wang & Gongjun Xu, 2024. "Regularized Variational Estimation for Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 89(1), pages 347-375, March.
    • Handle: RePEc:spr:psycho:v:89:y:2024:i:1:d:10.1007_s11336-022-09874-6
    DOI: 10.1007/s11336-022-09874-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-022-09874-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-022-09874-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John Horn, 1965. "A rationale and test for the number of factors in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 30(2), pages 179-185, June.
    2. Gongjun Xu & Zhuoran Shang, 2018. "Identifying Latent Structures in Restricted Latent Class Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1284-1295, July.
    3. David Thissen & Howard Wainer, 1982. "Some standard errors in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 47(4), pages 397-412, December.
    4. Jianan Sun & Yunxiao Chen & Jingchen Liu & Zhiliang Ying & Tao Xin, 2016. "Latent Variable Selection for Multidimensional Item Response Theory Models via $$L_{1}$$ L 1 Regularization," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 921-939, December.
    5. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    6. Li Cai, 2010. "High-dimensional Exploratory Item Factor Analysis by A Metropolis–Hastings Robbins–Monro Algorithm," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 33-57, March.
    7. Yingying Fan & Cheng Yong Tang, 2013. "Tuning parameter selection in high dimensional penalized likelihood," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 531-552, June.
    8. Yoshio Takane & Jan Leeuw, 1987. "On the relationship between item response theory and factor analysis of discretized variables," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 393-408, September.
    9. Wendy Yen, 1987. "A comparison of the efficiency and accuracy of BILOG and LOGIST," Psychometrika, Springer;The Psychometric Society, vol. 52(2), pages 275-291, June.
    10. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    11. Henry Kaiser, 1958. "The varimax criterion for analytic rotation in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 23(3), pages 187-200, September.
    12. Haoran Zhang & Yunxiao Chen & Xiaoou Li, 2020. "A Note on Exploratory Item Factor Analysis by Singular Value Decomposition," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 358-372, June.
    13. Rabe-Hesketh, Sophia & Skrondal, Anders & Pickles, Andrew, 2005. "Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects," Journal of Econometrics, Elsevier, vol. 128(2), pages 301-323, October.
    14. Wang, Tao & Xu, Pei-Rong & Zhu, Li-Xing, 2012. "Non-convex penalized estimation in high-dimensional models with single-index structure," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 221-235.
    15. Li Cai, 2010. "Metropolis-Hastings Robbins-Monro Algorithm for Confirmatory Item Factor Analysis," Journal of Educational and Behavioral Statistics, , vol. 35(3), pages 307-335, June.
    16. Robert Jennrich, 2006. "Rotation to Simple Loadings Using Component Loss Functions: The Oblique Case," Psychometrika, Springer;The Psychometric Society, vol. 71(1), pages 173-191, March.
    17. Robert Jennrich, 2004. "Rotation to simple loadings using component loss functions: The orthogonal case," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 257-273, June.
    18. Zhang, Haoran & Chen, Yunxiao & Li, Xiaoou, 2020. "A note on exploratory item factor analysis by singular value decomposition," LSE Research Online Documents on Economics 104166, London School of Economics and Political Science, LSE Library.
    19. Yunxiao Chen & Xiaoou Li & Siliang Zhang, 2019. "Joint Maximum Likelihood Estimation for High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 124-146, March.
    20. Xiaotong Shen & Wei Pan & Yunzhang Zhu, 2012. "Likelihood-Based Selection and Sharp Parameter Estimation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 223-232, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher J. Urban & Daniel J. Bauer, 2021. "A Deep Learning Algorithm for High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 1-29, March.
    2. Xinyi Liu & Gabriel Wallin & Yunxiao Chen & Irini Moustaki, 2023. "Rotation to Sparse Loadings Using $$L^p$$ L p Losses and Related Inference Problems," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 527-553, June.
    3. Liu, Xinyi Lin & Wallin, Gabriel & Chen, Yunxiao & Moustaki, Irini, 2023. "Rotation to sparse loadings using Lp losses and related inference problems," LSE Research Online Documents on Economics 118349, London School of Economics and Political Science, LSE Library.
    4. Siliang Zhang & Yunxiao Chen, 2022. "Computation for Latent Variable Model Estimation: A Unified Stochastic Proximal Framework," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1473-1502, December.
    5. Zhang, Siliang & Chen, Yunxiao, 2022. "Computation for latent variable model estimation: a unified stochastic proximal framework," LSE Research Online Documents on Economics 114489, London School of Economics and Political Science, LSE Library.
    6. Jin, Shaobo & Moustaki, Irini & Yang-Wallentin, Fan, 2018. "Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case," LSE Research Online Documents on Economics 88118, London School of Economics and Political Science, LSE Library.
    7. Chenchen Ma & Jing Ouyang & Chun Wang & Gongjun Xu, 2024. "A Note on Improving Variational Estimation for Multidimensional Item Response Theory," Psychometrika, Springer;The Psychometric Society, vol. 89(1), pages 172-204, March.
    8. Shaobo Jin & Irini Moustaki & Fan Yang-Wallentin, 2018. "Approximated Penalized Maximum Likelihood for Exploratory Factor Analysis: An Orthogonal Case," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 628-649, September.
    9. Ling Chen & Yuqi Gu, 2024. "A Spectral Method for Identifiable Grade of Membership Analysis with Binary Responses," Psychometrika, Springer;The Psychometric Society, vol. 89(2), pages 626-657, June.
    10. Kwon, Sunghoon & Oh, Seungyoung & Lee, Youngjo, 2016. "The use of random-effect models for high-dimensional variable selection problems," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 401-412.
    11. Kei Hirose & Yoshikazu Terada, 2023. "Sparse and Simple Structure Estimation via Prenet Penalization," Psychometrika, Springer;The Psychometric Society, vol. 88(4), pages 1381-1406, December.
    12. Yoav Bergner & Peter Halpin & Jill-Jênn Vie, 2022. "Multidimensional Item Response Theory in the Style of Collaborative Filtering," Psychometrika, Springer;The Psychometric Society, vol. 87(1), pages 266-288, March.
    13. Cardenas Hurtado, Camilo & Moustaki, Irini & Chen, Yunxiao & Marra, Giampiero, 2025. "Generalized latent variable models for location, scale, and shape parameters," LSE Research Online Documents on Economics 127387, London School of Economics and Political Science, LSE Library.
    14. Xiaotong Shen & Wei Pan & Yunzhang Zhu & Hui Zhou, 2013. "On constrained and regularized high-dimensional regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(5), pages 807-832, October.
    15. Chenchen Ma & Jing Ouyang & Gongjun Xu, 2023. "Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 175-207, March.
    16. Zhang, Tonglin, 2024. "Variables selection using L0 penalty," Computational Statistics & Data Analysis, Elsevier, vol. 190(C).
    17. Dong, Ruipeng & Li, Daoji & Zheng, Zemin, 2021. "Parallel integrative learning for large-scale multi-response regression with incomplete outcomes," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    18. Dai, Linlin & Chen, Kani & Sun, Zhihua & Liu, Zhenqiu & Li, Gang, 2018. "Broken adaptive ridge regression and its asymptotic properties," Journal of Multivariate Analysis, Elsevier, vol. 168(C), pages 334-351.
    19. Joel L. Horowitz, 2015. "Variable selection and estimation in high-dimensional models," CeMMAP working papers 35/15, Institute for Fiscal Studies.
    20. Zhang, Haoran & Chen, Yunxiao & Li, Xiaoou, 2020. "A note on exploratory item factor analysis by singular value decomposition," LSE Research Online Documents on Economics 104166, London School of Economics and Political Science, LSE Library.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:89:y:2024:i:1:d:10.1007_s11336-022-09874-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.