IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v83y2018i2d10.1007_s11336-017-9583-8.html
   My bibliography  Save this article

Improving the Crossing-SIBTEST Statistic for Detecting Non-uniform DIF

Author

Listed:
  • R. Philip Chalmers

    (The University of Georgia)

Abstract

This paper demonstrates that, after applying a simple modification to Li and Stout’s (Psychometrika 61(4):647–677, 1996) CSIBTEST statistic, an improved variant of the statistic could be realized. It is shown that this modified version of CSIBTEST has a more direct association with the SIBTEST statistic presented by Shealy and Stout (Psychometrika 58(2):159–194, 1993). In particular, the asymptotic sampling distributions and general interpretation of the effect size estimates are the same for SIBTEST and the new CSIBTEST. Given the more natural connection to SIBTEST, it is shown that Li and Stout’s hypothesis testing approach is insufficient for CSIBTEST; thus, an improved hypothesis testing procedure is required. Based on the presented arguments, a new chi-squared-based hypothesis testing approach is proposed for the modified CSIBTEST statistic. Positive results from a modest Monte Carlo simulation study strongly suggest the original CSIBTEST procedure and randomization hypothesis testing approach should be replaced by the modified statistic and hypothesis testing method.

Suggested Citation

  • R. Philip Chalmers, 2018. "Improving the Crossing-SIBTEST Statistic for Detecting Non-uniform DIF," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 376-386, June.
    • Handle: RePEc:spr:psycho:v:83:y:2018:i:2:d:10.1007_s11336-017-9583-8
    DOI: 10.1007/s11336-017-9583-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-017-9583-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-017-9583-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Louis Guttman, 1945. "A basis for analyzing test-retest reliability," Psychometrika, Springer;The Psychometric Society, vol. 10(4), pages 255-282, December.
    2. G. Kuder & M. Richardson, 1937. "The theory of the estimation of test reliability," Psychometrika, Springer;The Psychometric Society, vol. 2(3), pages 151-160, September.
    3. Chalmers, R. Philip, 2012. "mirt: A Multidimensional Item Response Theory Package for the R Environment," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i06).
    4. Hsin-Hung Li & William Stout, 1996. "A new procedure for detection of crossing DIF," Psychometrika, Springer;The Psychometric Society, vol. 61(4), pages 647-677, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. R. Philip Chalmers, 2018. "Model-Based Measures for Detecting and Quantifying Response Bias," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 696-732, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. R. Philip Chalmers, 2018. "Model-Based Measures for Detecting and Quantifying Response Bias," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 696-732, September.
    2. Mary F. Zhang & Julie Selwyn, 2020. "The Subjective Well-Being of Children and Young People in out of Home Care: Psychometric Analyses of the “Your Life, your Care” Survey," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 13(5), pages 1549-1572, October.
    3. Klaas Sijtsma & Julius M. Pfadt, 2021. "Part II: On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha: Discussing Lower Bounds and Correlated Errors," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 843-860, December.
    4. Harold Gulliksen, 1950. "The reliability of speeded tests," Psychometrika, Springer;The Psychometric Society, vol. 15(3), pages 259-269, September.
    5. W. Nicewander, 1990. "A latent-trait based reliability estimate and upper bound," Psychometrika, Springer;The Psychometric Society, vol. 55(1), pages 65-74, March.
    6. Eunseong Cho, 2021. "Neither Cronbach’s Alpha nor McDonald’s Omega: A Commentary on Sijtsma and Pfadt," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 877-886, December.
    7. von Borzyskowski, Inken & Wahman, Michael, 2018. "Systematic measurement error in election violence data: causes and consequences," LSE Research Online Documents on Economics 90450, London School of Economics and Political Science, LSE Library.
    8. repec:jss:jstsof:39:i08 is not listed on IDEAS
    9. Melissa Gladstone & Gillian Lancaster & Gareth McCray & Vanessa Cavallera & Claudia R. L. Alves & Limbika Maliwichi & Muneera A. Rasheed & Tarun Dua & Magdalena Janus & Patricia Kariger, 2021. "Validation of the Infant and Young Child Development (IYCD) Indicators in Three Countries: Brazil, Malawi and Pakistan," IJERPH, MDPI, vol. 18(11), pages 1-19, June.
    10. Björn Andersson & Tao Xin, 2021. "Estimation of Latent Regression Item Response Theory Models Using a Second-Order Laplace Approximation," Journal of Educational and Behavioral Statistics, , vol. 46(2), pages 244-265, April.
    11. Victoria T. Tanaka & George Engelhard & Matthew P. Rabbitt, 2020. "Using a Bifactor Model to Measure Food Insecurity in Households with Children," Journal of Family and Economic Issues, Springer, vol. 41(3), pages 492-504, September.
    12. Çetin Toraman & Güneş Korkmaz, 2023. "What is the “Meaning of School†to High School Students? A Scale Development and Implementation Study Based on IRT and CTT," SAGE Open, , vol. 13(3), pages 21582440231, September.
    13. Nongyao Kasatpibal & Nongkran Viseskul & Wimonsiri Srikantha & Warunee Fongkaew & Natthakarn Surapagdee & Richard M. Grimes, 2014. "Effects of Internet‐based instruction on HIV‐prevention knowledge and practices among men who have sex with men," Nursing & Health Sciences, John Wiley & Sons, vol. 16(4), pages 514-520, December.
    14. Samuel A. Markolf & Kelly Klima & Terrence L. Wong, 2015. "Adaptation frameworks used by US decision-makers: a literature review," Environment Systems and Decisions, Springer, vol. 35(4), pages 427-436, December.
    15. Peitzmeier, Sarah M. & Wirtz, Andrea L. & Humes, Elizabeth & Hughto, Jaclyn M.W. & Cooney, Erin & Reisner, Sari L., 2021. "The transgender-specific intimate partner violence scale for research and practice: Validation in a sample of transgender women," Social Science & Medicine, Elsevier, vol. 291(C).
    16. Cervantes, Víctor H., 2017. "DFIT: An R Package for Raju's Differential Functioning of Items and Tests Framework," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i05).
    17. Elina Tsigeman & Sebastian Silas & Klaus Frieler & Maxim Likhanov & Rebecca Gelding & Yulia Kovas & Daniel Müllensiefen, 2022. "The Jack and Jill Adaptive Working Memory Task: Construction, Calibration and Validation," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-29, January.
    18. Robert Wherry & Richard Gaylord, 1943. "The concept of test and item reliability in relation to factor pattern," Psychometrika, Springer;The Psychometric Society, vol. 8(4), pages 247-264, December.
    19. Joshua B. Gilbert & James S. Kim & Luke W. Miratrix, 2023. "Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 889-913, December.
    20. Bing Li & Cody Ding & Huiying Shi & Fenghui Fan & Liya Guo, 2023. "Assessment of Psychological Zone of Optimal Performance among Professional Athletes: EGA and Item Response Theory Analysis," Sustainability, MDPI, vol. 15(10), pages 1-15, May.
    21. Ick Hoon Jin & Minjeong Jeon, 2019. "A Doubly Latent Space Joint Model for Local Item and Person Dependence in the Analysis of Item Response Data," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 236-260, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:83:y:2018:i:2:d:10.1007_s11336-017-9583-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.