IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v4y2021i4p48-836d648643.html
   My bibliography  Save this article

A Comprehensive Simulation Study of Estimation Methods for the Rasch Model

Author

Listed:
  • Alexander Robitzsch

    (IPN—Leibniz Institute for Science and Mathematics Education, Olshausenstraße 62, 24118 Kiel, Germany
    Centre for International Student Assessment (ZIB), Olshausenstraße 62, 24118 Kiel, Germany)

Abstract

The Rasch model is one of the most prominent item response models. In this article, different item parameter estimation methods for the Rasch model are systematically compared through a comprehensive simulation study: Different alternatives of joint maximum likelihood (JML) estimation, different alternatives of marginal maximum likelihood (MML) estimation, conditional maximum likelihood (CML) estimation, and several limited information methods (LIM). The type of ability distribution (i.e., nonnormality), the number of items, sample size, and the distribution of item difficulties were systematically varied. Across different simulation conditions, MML methods with flexible distributional specifications can be at least as efficient as CML. Moreover, in many situations (i.e., for long tests), penalized JML and JML with ε adjustment resulted in very efficient estimates and might be considered alternatives to JML implementations currently used in statistical software. Moreover, minimum chi-square (MINCHI) estimation was the best-performing LIM method. These findings demonstrate that JML estimation and LIM can still prove helpful in applied research.

Suggested Citation

  • Alexander Robitzsch, 2021. "A Comprehensive Simulation Study of Estimation Methods for the Rasch Model," Stats, MDPI, vol. 4(4), pages 1-23, October.
    • Handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:48-836:d:648643
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/4/4/48/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-905X/4/4/48/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.
    2. David Andrich, 2010. "Sufficiency and Conditional Estimation of Person Parameters in the Polytomous Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 292-308, June.
    3. Hadfield, Jarrod D., 2010. "MCMC Methods for Multi-Response Generalized Linear Mixed Models: The MCMCglmm R Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i02).
    4. Monika E. Finger & Reuben Escorpizo & Alan Tennant, 2019. "Measuring Work-Related Functioning Using the Work Rehabilitation Questionnaire (WORQ)," IJERPH, MDPI, vol. 16(15), pages 1-15, August.
    5. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    6. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    7. Paul Holland, 1990. "The Dutch Identity: A new tool for the study of item response models," Psychometrika, Springer;The Psychometric Society, vol. 55(1), pages 5-18, March.
    8. Yoonsang Kim & Young-Ku Choi & Sherry Emery, 2013. "Logistic Regression With Multiple Random Effects: A Simulation Study of Estimation Methods and Statistical Packages," The American Statistician, Taylor & Francis Journals, vol. 67(3), pages 171-182, August.
    9. David Magis & Gilles Raîche, 2012. "On the Relationships Between Jeffreys Modal and Weighted Likelihood Estimation of Ability Under Logistic IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 163-169, January.
    10. Anderson, Carolyn J. & Li, Zhushan & Vermunt, Jeroen K., 2007. "Estimation of Models in a Rasch Family for Polytomous Items and Multiple Latent Variables," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i06).
    11. Katsikatsou, Myrsini & Moustaki, Irini & Yang-Wallentin, Fan & Jöreskog, Karl G., 2012. "Pairwise likelihood estimation for factor analysis models with ordinal data," LSE Research Online Documents on Economics 43182, London School of Economics and Political Science, LSE Library.
    12. Carolyn Anderson & Ulf Böckenholt, 2000. "Graphical regression models for polytomous variables," Psychometrika, Springer;The Psychometric Society, vol. 65(4), pages 497-509, December.
    13. Lancaster, Tony, 2000. "The incidental parameter problem since 1948," Journal of Econometrics, Elsevier, vol. 95(2), pages 391-413, April.
    14. Bartolucci, Francesco & Pigini, Claudia, 2017. "cquad: An R and Stata Package for Conditional Maximum Likelihood Estimation of Dynamic Binary Panel Data Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 78(i07).
    15. Clemens Draxler & Rainer Alexandrowicz, 2015. "Sample Size Determination Within the Scope of Conditional Maximum Likelihood Estimation with Special Focus on Testing the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 897-919, December.
    16. Katsikatsou, Myrsini & Moustaki, Irini & Yang-Wallentin, Fan & Jöreskog, Karl G., 2012. "Pairwise likelihood estimation for factor analysis models with ordinal data," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 4243-4258.
    17. Xiaohui Zheng & Sophia Rabe-Hesketh, 2007. "Estimating parameters of dichotomous and ordinal item response models with gllamm," Stata Journal, StataCorp LP, vol. 7(3), pages 313-333, September.
    18. Doran, Harold & Bates, Douglas & Bliese, Paul & Dowling, Maritza, 2007. "Estimating the Multilevel Rasch Model: With the lme4 Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i02).
    19. Paul Boeck, 2008. "Random Item IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 73(4), pages 533-559, December.
    20. Chalmers, R. Philip, 2012. "mirt: A Multidimensional Item Response Theory Package for the R Environment," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i06).
    21. Ewa Genge, 2021. "LC and LC-IRT Models in the Identification of Polish Households with Similar Perception of Financial Position," Sustainability, MDPI, vol. 13(8), pages 1-22, April.
    22. Yunxiao Chen & Xiaoou Li & Siliang Zhang, 2019. "Joint Maximum Likelihood Estimation for High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 124-146, March.
    23. Thomas L. Saaty & Luis G. Vargas, 2012. "Models, Methods, Concepts & Applications of the Analytic Hierarchy Process," International Series in Operations Research and Management Science, Springer, edition 2, number 978-1-4614-3597-6, September.
    24. Carolyn Anderson & Hsiu-Ting Yu, 2007. "Log-Multiplicative Association Models as Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 72(1), pages 5-23, March.
    25. Feddag, M.-L. & Bacci, S., 2009. "Pairwise likelihood for the longitudinal mixed Rasch model," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1027-1037, February.
    26. Renard, Didier & Molenberghs, Geert & Geys, Helena, 2004. "A pairwise likelihood approach to estimation in multilevel probit models," Computational Statistics & Data Analysis, Elsevier, vol. 44(4), pages 649-667, January.
    27. Thomas Warm, 1989. "Weighted likelihood estimation of ability in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 427-450, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vidina Tais Díaz-Padilla & Irena Travar & Zamira Acosta-Rubio & Eduardo Parra-López, 2023. "Tourism Competitiveness versus Sustainability: Impact on the World Economic Forum Model Using the Rasch Methodology," Sustainability, MDPI, vol. 15(18), pages 1-18, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Haoran & Chen, Yunxiao & Li, Xiaoou, 2020. "A note on exploratory item factor analysis by singular value decomposition," LSE Research Online Documents on Economics 104166, London School of Economics and Political Science, LSE Library.
    2. Haoran Zhang & Yunxiao Chen & Xiaoou Li, 2020. "A Note on Exploratory Item Factor Analysis by Singular Value Decomposition," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 358-372, June.
    3. Felix Zimmer & Clemens Draxler & Rudolf Debelak, 2023. "Power Analysis for the Wald, LR, Score, and Gradient Tests in a Marginal Maximum Likelihood Framework: Applications in IRT," Psychometrika, Springer;The Psychometric Society, vol. 88(4), pages 1249-1298, December.
    4. Yoav Bergner & Peter Halpin & Jill-Jênn Vie, 2022. "Multidimensional Item Response Theory in the Style of Collaborative Filtering," Psychometrika, Springer;The Psychometric Society, vol. 87(1), pages 266-288, March.
    5. Joshua B. Gilbert & James S. Kim & Luke W. Miratrix, 2023. "Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 889-913, December.
    6. repec:jss:jstsof:39:i12 is not listed on IDEAS
    7. repec:jss:jstsof:20:i06 is not listed on IDEAS
    8. Battauz, Michela & Vidoni, Paolo, 2022. "A likelihood-based boosting algorithm for factor analysis models with binary data," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    9. Harold Doran, 2023. "A Collection of Numerical Recipes Useful for Building Scalable Psychometric Applications," Journal of Educational and Behavioral Statistics, , vol. 48(1), pages 37-69, February.
    10. Christopher J. Urban & Daniel J. Bauer, 2021. "A Deep Learning Algorithm for High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 1-29, March.
    11. Ting Wang & Carolin Strobl & Achim Zeileis & Edgar C. Merkle, 2018. "Score-Based Tests of Differential Item Functioning via Pairwise Maximum Likelihood Estimation," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 132-155, March.
    12. Carolyn Anderson, 2013. "Multidimensional Item Response Theory Models with Collateral Information as Poisson Regression Models," Journal of Classification, Springer;The Classification Society, vol. 30(2), pages 276-303, July.
    13. Myrsini Katsikatsou & Irini Moustaki, 2016. "Pairwise Likelihood Ratio Tests and Model Selection Criteria for Structural Equation Models with Ordinal Variables," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 1046-1068, December.
    14. Nuo Xi & Michael W. Browne, 2014. "Contributions to the Underlying Bivariate Normal Method for Factor Analyzing Ordinal Data," Journal of Educational and Behavioral Statistics, , vol. 39(6), pages 583-611, December.
    15. Ogasawara, Haruhiko, 2013. "Asymptotic properties of the Bayes and pseudo Bayes estimators of ability in item response theory," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 359-377.
    16. J. R. Lockwood & D. McCaffrey, 2020. "Using hidden information and performance level boundaries to study student–teacher assignments: implications for estimating teacher causal effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1333-1362, October.
    17. Ping Chen & Chun Wang, 2021. "Using EM Algorithm for Finite Mixtures and Reformed Supplemented EM for MIRT Calibration," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 299-326, March.
    18. John Patrick Lalor & Pedro Rodriguez, 2023. "py-irt : A Scalable Item Response Theory Library for Python," INFORMS Journal on Computing, INFORMS, vol. 35(1), pages 5-13, January.
    19. Ting Wang & Benjamin Graves & Yves Rosseel & Edgar C. Merkle, 2022. "Computation and application of generalized linear mixed model derivatives using lme4," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 1173-1193, September.
    20. Ting Wang & Carolin Strobl & Achim Zeileis & Edgar C. Merkle, 2016. "Score-Based Tests of Differential Item Functioning in the Two-Parameter Model," Working Papers 2016-05, Faculty of Economics and Statistics, Universität Innsbruck.
    21. M.-L. Feddag, 2016. "Pairwise likelihood estimation for the normal ogive model with binary data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 100(2), pages 223-237, April.
    22. Sun-Joo Cho & Sarah Brown-Schmidt & Woo-yeol Lee, 2018. "Autoregressive Generalized Linear Mixed Effect Models with Crossed Random Effects: An Application to Intensive Binary Time Series Eye-Tracking Data," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 751-771, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:48-836:d:648643. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.