IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v39y2014i3p180-202.html
   My bibliography  Save this article

Measuring Student Ability, Classifying Schools, and Detecting Item Bias at School Level, Based on Student-Level Dichotomous Items

Author

Listed:
  • Margot Bennink
  • Marcel A. Croon

    (Tilburg University)

  • Jos Keuning

    (Psychometric Research Center)

  • Jeroen K. Vermunt

    (Tilburg University)

Abstract

In educational measurement, responses of students on items are used not only to measure the ability of students, but also to evaluate and compare the performance of schools. Analysis should ideally account for the multilevel structure of the data, and school-level processes not related to ability, such as working climate and administration conditions, need to be separated from student and school ability. However, in educational studies such as Programme for International Student Assessment, Trends in International Mathematics and Science Study, and COOL 5–18 , this is hardly ever done. This study presents a model that simultaneously accounts for the nested structure, controls student ability for processes at school level, classifies schools to monitor and compare schools, and tests for school-level item bias.

Suggested Citation

  • Margot Bennink & Marcel A. Croon & Jos Keuning & Jeroen K. Vermunt, 2014. "Measuring Student Ability, Classifying Schools, and Detecting Item Bias at School Level, Based on Student-Level Dichotomous Items," Journal of Educational and Behavioral Statistics, , vol. 39(3), pages 180-202, June.
    • Handle: RePEc:sae:jedbes:v:39:y:2014:i:3:p:180-202
    DOI: 10.3102/1076998614529158
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998614529158
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998614529158?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jean-Paul Fox & Cees Glas, 2001. "Bayesian estimation of a multilevel IRT model using gibbs sampling," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 271-288, June.
    2. Lex Borghans & Huub Meijers & Bas Ter Weel, 2008. "The Role Of Noncognitive Skills In Explaining Cognitive Test Scores," Economic Inquiry, Western Economic Association International, vol. 46(1), pages 2-12, January.
    3. George Leckie & Harvey Goldstein, 2009. "The limitations of using school league tables to inform school choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 835-851, October.
    4. José Dias & Jeroen Vermunt, 2008. "A bootstrap-based aggregate classifier for model-based clustering," Computational Statistics, Springer, vol. 23(4), pages 643-659, October.
    5. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "Generalized multilevel structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 167-190, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sun-Joo Cho & Allan S. Cohen, 2010. "A Multilevel Mixture IRT Model With an Application to DIF," Journal of Educational and Behavioral Statistics, , vol. 35(3), pages 336-370, June.
    2. Minjeong Jeon & Sophia Rabe-Hesketh, 2012. "Profile-Likelihood Approach for Estimating Generalized Linear Mixed Models With Factor Structures," Journal of Educational and Behavioral Statistics, , vol. 37(4), pages 518-542, August.
    3. Isabella Sulis & Mariano Porcu & Vincenza Capursi, 2019. "On the Use of Student Evaluation of Teaching: A Longitudinal Analysis Combining Measurement Issues and Implications of the Exercise," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 142(3), pages 1305-1331, April.
    4. Meredith Langi & Minjeong Jeon, 2023. "Identifying and Supporting Academically Low-Performing Schools in a Developing Country: An Application of a Specialized Multilevel IRT Model to PISA-D Assessment Data," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 332-356, March.
    5. Anders Skrondal & Sophia Rabe‐Hesketh, 2007. "Latent Variable Modelling: A Survey," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 712-745, December.
    6. Sophia Rabe-Hesketh & Anders Skrondal, 2007. "Multilevel and Latent Variable Modeling with Composite Links and Exploded Likelihoods," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 123-140, June.
    7. Li Cai, 2010. "High-dimensional Exploratory Item Factor Analysis by A Metropolis–Hastings Robbins–Monro Algorithm," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 33-57, March.
    8. Steven Andrew Culpepper & Herman Aguinis & Justin L. Kern & Roger Millsap, 2019. "High-Stakes Testing Case Study: A Latent Variable Approach for Assessing Measurement and Prediction Invariance," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 285-309, March.
    9. Ryan Mullins & Raj Agnihotri, 2022. "Digital selling: organizational and managerial influences for frontline readiness and effectiveness," Journal of the Academy of Marketing Science, Springer, vol. 50(4), pages 800-821, July.
    10. By Tyas Prevoo & Bas ter Weel, 2015. "The importance of early conscientiousness for socio-economic outcomes: evidence from the British Cohort Study," Oxford Economic Papers, Oxford University Press, vol. 67(4), pages 918-948.
    11. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    12. Matthew Houser, 2022. "Does adopting a nitrogen best management practice reduce nitrogen fertilizer rates?," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(1), pages 79-94, March.
    13. Arpino, Bruno & Varriale, Roberta, 2009. "Assessing the quality of institutions’ rankings obtained through multilevel linear regression models," MPRA Paper 19873, University Library of Munich, Germany.
    14. Liuyang Yao & Qian Zhang & Kin Keung Lai & Xianyu Cao, 2020. "Explaining Local Residents’ Attitudes toward Shale Gas Exploitation: The Mediating Roles of Risk and Benefit Perceptions," IJERPH, MDPI, vol. 17(19), pages 1-13, October.
    15. Wenjia Zhang & Ming Zhang, 2018. "Incorporating land use and pricing policies for reducing car dependence: Analytical framework and empirical evidence," Urban Studies, Urban Studies Journal Limited, vol. 55(13), pages 3012-3033, October.
    16. Dinand Webbink & Pierre Koning & Sunčica Vujić & Nicholas G. Martin, 2013. "Why Are Criminals Less Educated than Non-Criminals? Evidence from a Cohort of Young Australian Twins," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 29(1), pages 115-144, February.
    17. James J. Heckman & Stefano Mosso, 2014. "The Economics of Human Development and Social Mobility," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 689-733, August.
    18. Borghans, Lex & Meijers, Huub & ter Weel, Bas, 2013. "The importance of intrinsic and extrinsic motivation for measuring IQ," Economics of Education Review, Elsevier, vol. 34(C), pages 17-28.
    19. Christine T Cigolle & Corey L Nagel & Caroline S Blaum & Jersey Liang & Ana R Quiñones, 2018. "Inconsistency in the Self-report of Chronic Diseases in Panel Surveys: Developing an Adjudication Method for the Health and Retirement Study," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 73(5), pages 901-912.
    20. Christopher F. Baum & Hans Lööf & Pardis Nabavi & Andreas Stephan, 2017. "A new approach to estimation of the R&D–innovation–productivity relationship," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 26(1-2), pages 121-133, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:39:y:2014:i:3:p:180-202. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.