IDEAS home Printed from https://ideas.repec.org/a/jss/jstsof/v071i05.html
   My bibliography  Save this article

Generating Adaptive and Non-Adaptive Test Interfaces for Multidimensional Item Response Theory Applications

Author

Listed:
  • Chalmers, R. Philip

Abstract

Computerized adaptive testing (CAT) is a powerful technique to help improve measurement precision and reduce the total number of items required in educational, psychological, and medical tests. In CATs, tailored test forms are progressively constructed by capitalizing on information available from responses to previous items. CAT applications primarily have relied on unidimensional item response theory (IRT) to help select which items should be administered during the session. However, multidimensional CATs may be constructed to improve measurement precision and further reduce the number of items required to measure multiple traits simultaneously. A small selection of CAT simulation packages exist for the R environment; namely, catR (Magis and Raîche 2012), catIrt (Nydick 2014), and MAT (Choi and King 2014). However, the ability to generate graphical user interfaces for administering CATs in realtime has not been implemented in R to date, support for multidimensional CATs have been limited to the multidimensional three-parameter logistic model, and CAT designs were required to contain IRT models from the same modeling family. This article describes a new R package for implementing unidimensional and multidimensional CATs using a wide variety of IRT models, which can be unique for each respective test item, and demonstrates how graphical user interfaces and Monte Carlo simulation designs can be constructed with the mirtCAT package.

Suggested Citation

  • Chalmers, R. Philip, 2016. "Generating Adaptive and Non-Adaptive Test Interfaces for Multidimensional Item Response Theory Applications," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 71(i05).
    • Handle: RePEc:jss:jstsof:v:071:i05
    DOI: http://hdl.handle.net/10.18637/jss.v071.i05
    as

    Download full text from publisher

    File URL: https://www.jstatsoft.org/index.php/jss/article/view/v071i05/v71i05.pdf
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v071i05/mirtCAT_1.0.tar.gz
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v071i05/v71i05.R
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v071i05/v71i05-figures.zip
    Download Restriction: no
    File URL: https://libkey.io/http://hdl.handle.net/10.18637/jss.v071.i05?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Thissen, 1982. "Marginal maximum likelihood estimation for the one-parameter logistic model," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 175-186, June.
    2. Joris Mulder & Wim Linden, 2009. "Multidimensional Adaptive Testing with Optimal Design Criteria for Item Selection," Psychometrika, Springer;The Psychometric Society, vol. 74(2), pages 273-296, June.
    3. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    4. Youngsuk Suh & Daniel Bolt, 2010. "Nested Logit Models for Multiple-Choice Item Response Data," Psychometrika, Springer;The Psychometric Society, vol. 75(3), pages 454-473, September.
    5. Magis, David & Raîche, Gilles, 2012. "Random Generation of Response Patterns under Computerized Adaptive Testing with the R Package catR," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i08).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mi Jung Lee & Daejin Kim & Sergio Romero & Ickpyo Hong & Nikolay Bliznyuk & Craig Velozo, 2022. "Examining Older Adults’ Home Functioning Using the American Housing Survey," IJERPH, MDPI, vol. 19(8), pages 1-13, April.
    2. Sara Fernandes & Guillaume Fond & Xavier Zendjidjian & Pierre Michel & Karine Baumstarck & Christophe Lançon & Ludovic Samalin & Pierre-Michel Llorca & Magali Coldefy & Pascal Auquier & Laurent Boyer , 2022. "Development and Calibration of the PREMIUM Item Bank for Measuring Respect and Dignity for Patients with Severe Mental Illness," Post-Print hal-03649277, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anne Thissen-Roe & David Thissen, 2013. "A Two-Decision Model for Responses to Likert-Type Items," Journal of Educational and Behavioral Statistics, , vol. 38(5), pages 522-547, October.
    2. Alberto Maydeu-Olivares & Rosa Montaño, 2013. "How Should We Assess the Fit of Rasch-Type Models? Approximating the Power of Goodness-of-Fit Statistics in Categorical Data Analysis," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 116-133, January.
    3. Cees Glas, 1988. "The derivation of some tests for the rasch model from the multinomial distribution," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 525-546, December.
    4. Haruhiko Ogasawara, 2013. "Asymptotic properties of the Bayes modal estimators of item parameters in item response theory," Computational Statistics, Springer, vol. 28(6), pages 2559-2583, December.
    5. Li Cai, 2010. "A Two-Tier Full-Information Item Factor Analysis Model with Applications," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 581-612, December.
    6. Ulf Böckenholt, 2012. "The Cognitive-Miser Response Model: Testing for Intuitive and Deliberate Reasoning," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 388-399, April.
    7. Yoshio Takane & Jan Leeuw, 1987. "On the relationship between item response theory and factor analysis of discretized variables," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 393-408, September.
    8. Singh, Jagdip, 2004. "Tackling measurement problems with Item Response Theory: Principles, characteristics, and assessment, with an illustrative example," Journal of Business Research, Elsevier, vol. 57(2), pages 184-208, February.
    9. Robert Mislevy, 1986. "Bayes modal estimation in item response models," Psychometrika, Springer;The Psychometric Society, vol. 51(2), pages 177-195, June.
    10. David J. Hessen, 2010. "Likelihood Ratio Tests for Special Rasch Models," Journal of Educational and Behavioral Statistics, , vol. 35(6), pages 611-628, December.
    11. Herbert Hoijtink, 1990. "A latent trait model for dichotomous choice data," Psychometrika, Springer;The Psychometric Society, vol. 55(4), pages 641-656, December.
    12. J. Ramsay, 1989. "A comparison of three simple test theory models," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 487-499, September.
    13. Hyeon-Ah Kang & Yi Zheng & Hua-Hua Chang, 2020. "Online Calibration of a Joint Model of Item Responses and Response Times in Computerized Adaptive Testing," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 175-208, April.
    14. Javier Revuelta, 2010. "Estimating Difficulty from Polytomous Categorical Data," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 331-350, June.
    15. N. Verhelst & C. Glas, 1993. "A dynamic generalization of the Rasch model," Psychometrika, Springer;The Psychometric Society, vol. 58(3), pages 395-415, September.
    16. Olsbjerg, Maja & Christensen, Karl Bang, 2015. "%lrasch_mml: A SAS Macro for Marginal Maximum Likelihood Estimation in Longitudinal Polytomous Rasch Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(c02).
    17. Ying Cheng & Ke-Hai Yuan, 2010. "The Impact of Fallible Item Parameter Estimates on Latent Trait Recovery," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 280-291, June.
    18. Carolina Navarro & Luis Ayala & José Labeaga, 2010. "Housing deprivation and health status: evidence from Spain," Empirical Economics, Springer, vol. 38(3), pages 555-582, June.
    19. Chun Wang & David J. Weiss & Zhuoran Shang, 2019. "Variable-Length Stopping Rules for Multidimensional Computerized Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 749-771, September.
    20. Joel A. Martínez-Regalado & Cinthia Leonora Murillo-Avalos & Purificación Vicente-Galindo & Mónica Jiménez-Hernández & José Luis Vicente-Villardón, 2021. "Using HJ-Biplot and External Logistic Biplot as Machine Learning Methods for Corporate Social Responsibility Practices for Sustainable Development," Mathematics, MDPI, vol. 9(20), pages 1-16, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jss:jstsof:v:071:i05. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.jstatsoft.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.