IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v43y2018i6p635-662.html
   My bibliography  Save this article

Estimating Diffusion-Based Item Response Theory Models: Exploring the Robustness of Three Old and Two New Estimators

Author

Listed:
  • Jochen Ranger

    (Martin-Luther-University Halle-Wittenberg)

  • Jörg-Tobias Kuhn

    (University of Dortmund)

Abstract

Diffusion-based item response theory models for responses and response times in tests have attracted increased attention recently in psychometrics. Analyzing response time data, however, is delicate as response times are often contaminated by unusual observations. This can have serious effects on the validity of statistical inference. In this article, we compare three established and two new estimation approaches for diffusion-based item response theory models with respect to their robustness. The three established approaches are the marginal maximum likelihood (ML) estimator for continuous time, the marginal ML estimator for discrete time, and the weighted least squares (WLS) estimator. The new approaches are two modifications of the WLS estimator with better robustness properties. The performance of the estimators is compared in a simulation study. The simulation study illustrates that the new approaches are robust against some forms of random independent contamination. The marginal ML estimator for discrete time also performs well. The marginal ML estimator for continuous time is heavily affected by contamination.

Suggested Citation

  • Jochen Ranger & Jörg-Tobias Kuhn, 2018. "Estimating Diffusion-Based Item Response Theory Models: Exploring the Robustness of Three Old and Two New Estimators," Journal of Educational and Behavioral Statistics, , vol. 43(6), pages 635-662, December.
    • Handle: RePEc:sae:jedbes:v:43:y:2018:i:6:p:635-662
    DOI: 10.3102/1076998618787791
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998618787791
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998618787791?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Francis Tuerlinckx & Paul Boeck, 2005. "Two interpretations of the discrimination parameter," Psychometrika, Springer;The Psychometric Society, vol. 70(4), pages 629-650, December.
    2. Molenaar, Dylan & Tuerlinckx, Francis & van der Maas, Han L. J., 2015. "Fitting Diffusion Item Response Theory Models for Responses and Response Times Using the R Package diffIRT," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 66(i04).
    3. Chun Wang & Gongjun Xu & Zhuoran Shang, 2018. "A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 223-254, March.
    4. Albert Maydeu-Olivares & Harry Joe, 2006. "Limited Information Goodness-of-fit Testing in Multidimensional Contingency Tables," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 713-732, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Inhan Kang & Paul Boeck & Roger Ratcliff, 2022. "Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 725-748, June.
    2. Inhan Kang & Minjeong Jeon & Ivailo Partchev, 2023. "A Latent Space Diffusion Item Response Theory Model to Explore Conditional Dependence between Responses and Response Times," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 830-864, September.
    3. Inhan Kang & Dylan Molenaar & Roger Ratcliff, 2023. "A Modeling Framework to Examine Psychological Processes Underlying Ordinal Responses and Response Times of Psychometric Data," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 940-974, September.
    4. Udo Boehm & Maarten Marsman & Han L. J. Maas & Gunter Maris, 2021. "An Attention-Based Diffusion Model for Psychometric Analyses," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 938-972, December.
    5. Kang, Inhan & De Boeck, Paul & Partchev, Ivailo, 2022. "A randomness perspective on intelligence processes," Intelligence, Elsevier, vol. 91(C).
    6. Bunji, Kyosuke & Okada, Kensuke, 2019. "Item Response and Response Time Model for Personality Assessment via Linear Ballistic Accumulation," OSF Preprints knuy7, Center for Open Science.
    7. Alberto Maydeu-Olivares & Rosa Montaño, 2013. "How Should We Assess the Fit of Rasch-Type Models? Approximating the Power of Goodness-of-Fit Statistics in Categorical Data Analysis," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 116-133, January.
    8. Vassilis Vasdekis & Silvia Cagnone & Irini Moustaki, 2012. "A Composite Likelihood Inference in Latent Variable Models for Ordinal Longitudinal Responses," Psychometrika, Springer;The Psychometric Society, vol. 77(3), pages 425-441, July.
    9. Prince Destiny Ugo, 2017. "Project Quality Management Performance: An Insight to Sustainable Development Initiatives in Oil and Gas Host Communities," Journal of Management and Sustainability, Canadian Center of Science and Education, vol. 7(4), pages 76-88, December.
    10. Chen, Yunxiao & Moustaki, Irini & Zhang, H, 2020. "A note on likelihood ratio tests for models with latent variables," LSE Research Online Documents on Economics 107490, London School of Economics and Political Science, LSE Library.
    11. Aristidis Nikoloulopoulos & Harry Joe, 2015. "Factor Copula Models for Item Response Data," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 126-150, March.
    12. Shaobo Jin & Fan Yang-Wallentin, 2017. "Asymptotic Robustness Study of the Polychoric Correlation Estimation," Psychometrika, Springer;The Psychometric Society, vol. 82(1), pages 67-85, March.
    13. Ick Hoon Jin & Minjeong Jeon, 2019. "A Doubly Latent Space Joint Model for Local Item and Person Dependence in the Analysis of Item Response Data," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 236-260, March.
    14. Shaw, Amy & Elizondo, Fabian & Wadlington, Patrick L., 2020. "Reasoning, fast and slow: How noncognitive factors may alter the ability-speed relationship," Intelligence, Elsevier, vol. 83(C).
    15. Li Cai, 2010. "A Two-Tier Full-Information Item Factor Analysis Model with Applications," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 581-612, December.
    16. Lisa D. Wijsen & Denny Borsboom & Tiago Cabaço & Willem J. Heiser, 2019. "An Academic Genealogy of Psychometric Society Presidents," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 562-588, June.
    17. Peter W. Rijn & Usama S. Ali, 2018. "A Generalized Speed–Accuracy Response Model for Dichotomous Items," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 109-131, March.
    18. Kim, Sung-Ho & Choi, Hyemi & Lee, Sangjin, 2009. "Estimate-based goodness-of-fit test for large sparse multinomial distributions," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1122-1131, February.
    19. Dylan Molenaar & Paul Boeck, 2018. "Response Mixture Modeling: Accounting for Heterogeneity in Item Characteristics across Response Times," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 279-297, June.
    20. Gunter Maris & Han Maas, 2012. "Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 77(4), pages 615-633, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:43:y:2018:i:6:p:635-662. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.