IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v80y2015i3p665-688.html
   My bibliography  Save this article

Saddlepoint Approximations of the Distribution of the Person Parameter in the Two Parameter Logistic Model

Author

Listed:
  • Martin Biehler
  • Heinz Holling
  • Philipp Doebler

Abstract

Large sample theory states the asymptotic normality of the maximum likelihood estimator of the person parameter in the two parameter logistic (2PL) model. In short tests, however, the assumption of normality can be grossly wrong. As a consequence, intended coverage rates may be exceeded and confidence intervals are revealed to be overly conservative. Methods belonging to the higher-order-theory, more specifically saddlepoint approximations, are a convenient way to deal with small-sample problems. Confidence bounds obtained by these means hold the approximate confidence level for a broad range of the person parameter. Moreover, an approximation to the exact distribution permits to compute median unbiased estimates (MUE) that are as likely to overestimate as to underestimate the true person parameter. Additionally, in small samples, these MUE are less mean-biased than the often-used maximum likelihood estimator. Copyright The Psychometric Society 2015

Suggested Citation

  • Martin Biehler & Heinz Holling & Philipp Doebler, 2015. "Saddlepoint Approximations of the Distribution of the Person Parameter in the Two Parameter Logistic Model," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 665-688, September.
    • Handle: RePEc:spr:psycho:v:80:y:2015:i:3:p:665-688
    DOI: 10.1007/s11336-014-9405-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11336-014-9405-1
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11336-014-9405-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anna Doebler & Philipp Doebler & Heinz Holling, 2013. "Optimal and Most Exact Confidence Intervals for Person Parameters in Item Response Theory Models," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 98-115, January.
    2. A. C. Davison & D. A. S. Fraser & N. Reid, 2006. "Improved likelihood inference for discrete data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 495-508, June.
    3. J. Pfanzagl, 1972. "On median unbiased estimates," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 18(1), pages 154-173, December.
    4. Agresti, Alan & Gottard, Anna, 2007. "Nonconservative exact small-sample inference for discrete data," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6447-6458, August.
    5. Ogasawara, Haruhiko, 2012. "Supplement to the paper“ Asymptotic expansions for the ability estimator in item response theory”," 商学討究 (Shogaku Tokyu), Otaru University of Commerce, vol. 63(2/3), pages 329-336.
    6. Karl Klauer, 1991. "Exact and best confidence intervals for the ability parameter of the Rasch model," Psychometrika, Springer;The Psychometric Society, vol. 56(3), pages 535-547, September.
    7. J. Pfanzagl, 1970. "Median unbiased estimates for M.L.R.-families," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 15(1), pages 30-39, December.
    8. Ai[dieresis]t-Sahalia, Yacine & Yu, Jialin, 2006. "Saddlepoint approximations for continuous-time Markov processes," Journal of Econometrics, Elsevier, vol. 134(2), pages 507-551, October.
    9. Ivo Molenaar & Herbert Hoijtink, 1990. "The many null distributions of person fit indices," Psychometrika, Springer;The Psychometric Society, vol. 55(1), pages 75-106, March.
    10. Karl Klauer, 1991. "An exact and optimal standardized person test for assessing consistency with the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 56(2), pages 213-228, June.
    11. Frederic Lord, 1983. "Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability," Psychometrika, Springer;The Psychometric Society, vol. 48(2), pages 233-245, June.
    12. Alan Agresti & Yongyi Min, 2001. "On Small-Sample Confidence Intervals for Parameters in Discrete Distributions," Biometrics, The International Biometric Society, vol. 57(3), pages 963-971, September.
    13. Srivastava, M. S. & Yau, Wai Kwok, 1989. "Saddlepoint method for obtaining tail probability of Wilks' likelihood ratio test," Journal of Multivariate Analysis, Elsevier, vol. 31(1), pages 117-126, October.
    14. Michelle Liou & Lien-Chi Yu, 1991. "Assessing statistical accuracy in ability estimation: A bootstrap approach," Psychometrika, Springer;The Psychometric Society, vol. 56(1), pages 55-67, March.
    15. Ogasawara, Haruhiko, 2013. "Asymptotic properties of the Bayes and pseudo Bayes estimators of ability in item response theory," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 359-377.
    16. Denny Borsboom, 2006. "The attack of the psychometricians," Psychometrika, Springer;The Psychometric Society, vol. 71(3), pages 425-440, September.
    17. Haruhiko Ogasawara, 2012. "Asymptotic expansions for the ability estimator in item response theory," Computational Statistics, Springer, vol. 27(4), pages 661-683, December.
    18. Edward Bedrick, 1997. "Approximating the conditional distribution of person FIT indexes for checking the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 62(2), pages 191-199, June.
    19. Thomas Warm, 1989. "Weighted likelihood estimation of ability in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 427-450, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sandip Sinharay, 2017. "Detection of Item Preknowledge Using Likelihood Ratio Test and Score Test," Journal of Educational and Behavioral Statistics, , vol. 42(1), pages 46-68, February.
    2. Peter W. Rijn & Usama S. Ali, 2018. "A Generalized Speed–Accuracy Response Model for Dichotomous Items," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 109-131, March.
    3. Sandip Sinharay & Jens Ledet Jensen, 2019. "Higher-Order Asymptotics and Its Application to Testing the Equality of the Examinee Ability Over Two Sets of Items," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 484-510, June.
    4. Yang Liu & Jan Hannig & Abhishek Pal Majumder, 2019. "Second-Order Probability Matching Priors for the Person Parameter in Unidimensional IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 701-718, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiang Liu & James Yang & Hui Soo Chae & Gary Natriello, 2020. "Power Divergence Family of Statistics for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 502-525, June.
    2. Piero Veronese & Eugenio Melilli, 2021. "Confidence Distribution for the Ability Parameter of the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 131-166, March.
    3. Yang Liu & Jan Hannig & Abhishek Pal Majumder, 2019. "Second-Order Probability Matching Priors for the Person Parameter in Unidimensional IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 701-718, September.
    4. Sandip Sinharay, 2015. "The Asymptotic Distribution of Ability Estimates," Journal of Educational and Behavioral Statistics, , vol. 40(5), pages 511-528, October.
    5. Ogasawara, Haruhiko, 2013. "Asymptotic cumulants of ability estimators using fallible item parameters," Journal of Multivariate Analysis, Elsevier, vol. 119(C), pages 144-162.
    6. Xiang Liu & Zhuangzhuang Han & Matthew S. Johnson, 2018. "The UMP Exact Test and the Confidence Interval for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 182-202, March.
    7. Ogasawara, Haruhiko, 2013. "Asymptotic properties of the Bayes and pseudo Bayes estimators of ability in item response theory," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 359-377.
    8. Sandip Sinharay & Jens Ledet Jensen, 2019. "Higher-Order Asymptotics and Its Application to Testing the Equality of the Examinee Ability Over Two Sets of Items," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 484-510, June.
    9. Georg Gittler & Gerhard Fischer, 2011. "IRT-Based Measurement of Short-Term Changes of Ability, With an Application to Assessing the “Mozart Effectâ€," Journal of Educational and Behavioral Statistics, , vol. 36(1), pages 33-75, February.
    10. Sandip Sinharay, 2016. "Asymptotically Correct Standardization of Person-Fit Statistics Beyond Dichotomous Items," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 992-1013, December.
    11. Ying Cheng & Cheng Liu & John Behrens, 2015. "Standard Error of Ability Estimates and the Classification Accuracy and Consistency of Binary Decisions," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 645-664, September.
    12. David Magis, 2016. "Efficient Standard Error Formulas of Ability Estimators with Dichotomous Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 81(1), pages 184-200, March.
    13. Maxwell Hong & Lizhen Lin & Ying Cheng, 2021. "Asymptotically Corrected Person Fit Statistics for Multidimensional Constructs with Simple Structure and Mixed Item Types," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 464-488, June.
    14. Joseph B. Lang, 2017. "Mean-Minimum Exact Confidence Intervals," The American Statistician, Taylor & Francis Journals, vol. 71(4), pages 354-368, October.
    15. Chun Wang, 2015. "On Latent Trait Estimation in Multidimensional Compensatory Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 428-449, June.
    16. Seonghoon Kim, 2012. "A Note on the Reliability Coefficients for Item Response Model-Based Ability Estimates," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 153-162, January.
    17. Anna Doebler & Philipp Doebler & Heinz Holling, 2013. "Optimal and Most Exact Confidence Intervals for Person Parameters in Item Response Theory Models," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 98-115, January.
    18. Kevin Carl P. Santos & Jimmy Torre & Matthias Davier, 2020. "Adjusting Person Fit Index for Skewness in Cognitive Diagnosis Modeling," Journal of Classification, Springer;The Classification Society, vol. 37(2), pages 399-420, July.
    19. Oberrauch, Luis & Kaiser, Tim, 2020. "Economic competence in early secondary school: Evidence from a large-scale assessment in Germany," International Review of Economics Education, Elsevier, vol. 35(C).
    20. Haruhiko Ogasawara, 2012. "Asymptotic expansions for the ability estimator in item response theory," Computational Statistics, Springer, vol. 27(4), pages 661-683, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:80:y:2015:i:3:p:665-688. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.