IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v48y2023i6p866-888.html
   My bibliography  Save this article

IRT Models for Learning With Item-Specific Learning Parameters

Author

Listed:
  • Albert Yu
  • Jeffrey A. Douglas

    (University of Illinois Urbana-Champaign)

Abstract

We propose a new item response theory growth model with item-specific learning parameters, or ISLP, and two variations of this model. In the ISLP model, either items or blocks of items have their own learning parameters. This model may be used to improve the efficiency of learning in a formative assessment. We show ways that the ISLP model’s learning parameters can be estimated in simulation using Markov chain Monte Carlo (MCMC), demonstrate a way that the model could be used in the context of adaptive item selection to increase the rate of learning, and estimate the learning parameters in an empirical data analysis using the ISLP. In the simulation studies, the one-parameter logistic model was used as the measurement model to generate random response data with various test lengths and sample sizes. Ability growth was modeled with a few variations of the ISLP model, and it was verified that the parameters were accurately recovered. Secondly, we generated data using the linear logistic test model with known Q-matrix structure for the item difficulties. Using a two-step procedure gave very comparable results for the estimation of the learning parameters even when item difficulties were unknown. The potential benefit of using an adaptive selection method in conjunction with the ISLP model was shown by comparing total improvement in the examinees’ ability parameter to two other methods of item selection that do not utilize this growth model. If the ISLP holds, adaptive item selection consistently led to larger improvements over the other methods. A real data application of the ISLP was given to illustrate its use in a spatial reasoning study designed to promote learning. In this study, interventions were given after each block of ten items to increase ability. Learning parameters were estimated using MCMC.

Suggested Citation

  • Albert Yu & Jeffrey A. Douglas, 2023. "IRT Models for Learning With Item-Specific Learning Parameters," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 866-888, December.
    • Handle: RePEc:sae:jedbes:v:48:y:2023:i:6:p:866-888
    DOI: 10.3102/10769986231193096
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986231193096
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986231193096?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Erling Andersen, 1985. "Estimating latent correlations between repeated testings," Psychometrika, Springer;The Psychometric Society, vol. 50(1), pages 3-16, March.
    2. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    3. R. Darrell Bock, 1972. "Estimating item parameters and latent ability when responses are scored in two or more nominal categories," Psychometrika, Springer;The Psychometric Society, vol. 37(1), pages 29-51, March.
    4. Stephen Joseph & Marlene Thomas & Gerard Simonette & Leela Ramsook, 2013. "The Impact of Differentiated Instruction in a Teacher Education Setting: Successes and Challenges," International Journal of Higher Education, Sciedu Press, vol. 2(3), pages 1-28, August.
    5. Gerhard Fischer, 1981. "On the existence and uniqueness of maximum-likelihood estimates in the Rasch model," Psychometrika, Springer;The Psychometric Society, vol. 46(1), pages 59-77, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Steven Andrew Culpepper & Gongjun Xu, 2023. "Introduction to JEBS Special Issue on Diagnostic Statistical Models," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 687-689, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cees Glas, 1999. "Modification indices for the 2-PL and the nominal response model," Psychometrika, Springer;The Psychometric Society, vol. 64(3), pages 273-294, September.
    2. Björn Andersson & Tao Xin, 2021. "Estimation of Latent Regression Item Response Theory Models Using a Second-Order Laplace Approximation," Journal of Educational and Behavioral Statistics, , vol. 46(2), pages 244-265, April.
    3. Cees Glas, 1988. "The derivation of some tests for the rasch model from the multinomial distribution," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 525-546, December.
    4. Javier Revuelta, 2004. "Analysis of distractor difficulty in multiple-choice items," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 217-234, June.
    5. Peida Zhan & Hong Jiao & Dandan Liao & Feiming Li, 2019. "A Longitudinal Higher-Order Diagnostic Classification Model," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 251-281, June.
    6. Gerhard Fischer, 1983. "Logistic latent trait models with linear constraints," Psychometrika, Springer;The Psychometric Society, vol. 48(1), pages 3-26, March.
    7. Ulf Böckenholt, 2012. "The Cognitive-Miser Response Model: Testing for Intuitive and Deliberate Reasoning," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 388-399, April.
    8. Albert Maydeu-Olivares & Harry Joe, 2006. "Limited Information Goodness-of-fit Testing in Multidimensional Contingency Tables," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 713-732, December.
    9. Yang Liu & Jan Hannig, 2017. "Generalized Fiducial Inference for Logistic Graded Response Models," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1097-1125, December.
    10. Salim Moussa, 2016. "A two-step item response theory procedure for a better measurement of marketing constructs," Journal of Marketing Analytics, Palgrave Macmillan, vol. 4(1), pages 28-50, March.
    11. Yoshio Takane & Jan Leeuw, 1987. "On the relationship between item response theory and factor analysis of discretized variables," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 393-408, September.
    12. Dylan Molenaar, 2015. "Heteroscedastic Latent Trait Models for Dichotomous Data," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 625-644, September.
    13. Yang Liu & Weimeng Wang, 2022. "Semiparametric Factor Analysis for Item-Level Response Time Data," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 666-692, June.
    14. Ji Seung Yang & Xiaying Zheng, 2018. "Item Response Data Analysis Using Stata Item Response Theory Package," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 116-129, February.
    15. Singh, Jagdip, 2004. "Tackling measurement problems with Item Response Theory: Principles, characteristics, and assessment, with an illustrative example," Journal of Business Research, Elsevier, vol. 57(2), pages 184-208, February.
    16. Mark Reiser, 1989. "An Application of the Item-Response Model to Psychiatric Epidemiology," Sociological Methods & Research, , vol. 18(1), pages 66-103, August.
    17. Andersson, Björn & Jin, Shaobo & Zhang, Maoxin, 2023. "Fast estimation of multiple group generalized linear latent variable models for categorical observed variables," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    18. Anne Thissen-Roe & David Thissen, 2013. "A Two-Decision Model for Responses to Likert-Type Items," Journal of Educational and Behavioral Statistics, , vol. 38(5), pages 522-547, October.
    19. Javier Revuelta, 2009. "Identifiability and Equivalence of GLLIRM Models," Psychometrika, Springer;The Psychometric Society, vol. 74(2), pages 257-272, June.
    20. Silvana Bortolotti & Rafael Tezza & Dalton Andrade & Antonio Bornia & Afonso Sousa Júnior, 2013. "Relevance and advantages of using the item response theory," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2341-2360, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:48:y:2023:i:6:p:866-888. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.