IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v46y2021i1p34-57.html
   My bibliography  Save this article

A Bayesian Item Response Model for Examining Item Position Effects in Complex Survey Data

Author

Listed:
  • Matthias Trendtel

    (Center for Research on Education and School Development, 153667TU Dortmund University, Germany)

  • Alexander Robitzsch

    (IPN - 28393Leibniz Institute for Science and Mathematics Education, Kiel, Germany
    Centre for International Student Assessment)

Abstract

A multidimensional Bayesian item response model is proposed for modeling item position effects. The first dimension corresponds to the ability that is to be measured; the second dimension represents a factor that allows for individual differences in item position effects called persistence. This model allows for nonlinear item position effects on the item side as well as on the person side. Moreover, a flexible loading structure on the two dimensions is allowed. A fully Bayesian estimation procedure is proposed, and its performance is investigated by a simulation study. Further, the model is applied to empirical data collected in the Programme for International Student Assessment 2000 in the reading domain. The additional value of the model’s extended flexibility compared to more restrictive models is shown. The findings show that the linear hypothesis of change in performance during a test does not hold in general.

Suggested Citation

  • Matthias Trendtel & Alexander Robitzsch, 2021. "A Bayesian Item Response Model for Examining Item Position Effects in Complex Survey Data," Journal of Educational and Behavioral Statistics, , vol. 46(1), pages 34-57, February.
    • Handle: RePEc:sae:jedbes:v:46:y:2021:i:1:p:34-57
    DOI: 10.3102/1076998620931016
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998620931016
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998620931016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sophia Rabe‐Hesketh & Anders Skrondal, 2006. "Multilevel modelling of complex survey data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(4), pages 805-827, October.
    2. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    3. William Mollenkopf, 1950. "An experimental study of the effects on item-analysis data of changing item placement and test time limit," Psychometrika, Springer;The Psychometric Society, vol. 15(3), pages 291-315, September.
    4. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    5. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    6. Stanislav Kolenikov, 2010. "Resampling variance estimation for complex survey data," Stata Journal, StataCorp LP, vol. 10(2), pages 165-199, June.
    7. Renard, Didier & Molenberghs, Geert & Geys, Helena, 2004. "A pairwise likelihood approach to estimation in multilevel probit models," Computational Statistics & Data Analysis, Elsevier, vol. 44(4), pages 649-667, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christian A. Gregory, 2020. "Are We Underestimating Food Insecurity? Partial Identification with a Bayesian 4-Parameter IRT Model," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 632-655, October.
    2. Rodrigo M. Leifert & Claudio R. Lucinda, 2015. "Linear Symmetric "Fat Taxes": Evidence from Brazil," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 37(4), pages 634-666.
    3. repec:gdk:wpaper:51 is not listed on IDEAS
    4. Per Strömblad & Gunnar Myrberg, 2013. "Urban Inequality and Political Recruitment," Urban Studies, Urban Studies Journal Limited, vol. 50(5), pages 1049-1065, April.
    5. Francis,David C. & Kubinec ,Robert, 2022. "Beyond Political Connections : A Measurement Model Approach to Estimating Firm-levelPolitical Influence in 41 Economies," Policy Research Working Paper Series 10119, The World Bank.
    6. Padilla, Juan L. & Azevedo, Caio L.N. & Lachos, Victor H., 2018. "Multidimensional multiple group IRT models with skew normal latent trait distributions," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 250-268.
    7. Martinovici, A., 2019. "Revealing attention - how eye movements predict brand choice and moment of choice," Other publications TiSEM 7dca38a5-9f78-4aee-bd81-c, Tilburg University, School of Economics and Management.
    8. Yongping Bao & Ludwig Danwitz & Fabian Dvorak & Sebastian Fehrler & Lars Hornuf & Hsuan Yu Lin & Bettina von Helversen, 2022. "Similarity and Consistency in Algorithm-Guided Exploration," CESifo Working Paper Series 10188, CESifo.
    9. Torsten Heinrich & Jangho Yang & Shuanping Dai, 2020. "Growth, development, and structural change at the firm-level: The example of the PR China," Papers 2012.14503, arXiv.org.
    10. Tatiyana V. Apanasovich & David Ruppert & Joanne R. Lupton & Natasa Popovic & Nancy D. Turner & Robert S. Chapkin & Raymond J. Carroll, 2008. "Aberrant Crypt Foci and Semiparametric Modeling of Correlated Binary Data," Biometrics, The International Biometric Society, vol. 64(2), pages 490-500, June.
    11. van Kesteren Erik-Jan & Bergkamp Tom, 2023. "Bayesian analysis of Formula One race results: disentangling driver skill and constructor advantage," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 19(4), pages 273-293, December.
    12. Matthew Robson & Miqdad Asaria & Richard Cookson & Aki Tsuchiya & Shehzad Ali, 2017. "Eliciting the Level of Health Inequality Aversion in England," Health Economics, John Wiley & Sons, Ltd., vol. 26(10), pages 1328-1334, October.
    13. Xin Xu & Yang Lu & Yupeng Zhou & Zhiguo Fu & Yanjie Fu & Minghao Yin, 2021. "An Information-Explainable Random Walk Based Unsupervised Network Representation Learning Framework on Node Classification Tasks," Mathematics, MDPI, vol. 9(15), pages 1-14, July.
    14. de Leeuw, Jan, 2006. "Principal component analysis of binary data by iterated singular value decomposition," Computational Statistics & Data Analysis, Elsevier, vol. 50(1), pages 21-39, January.
    15. Steven Andrew Culpepper & James Joseph Balamuta, 2017. "A Hierarchical Model for Accuracy and Choice on Standardized Tests," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 820-845, September.
    16. Robert E. Hall & Sam Schulhofer-Wohl, 2018. "Measuring Job-Finding Rates and Matching Efficiency with Heterogeneous Job-Seekers," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 1-32, January.
    17. M.-L. Feddag, 2016. "Pairwise likelihood estimation for the normal ogive model with binary data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 100(2), pages 223-237, April.
    18. Xiaoyue Xi & Simon E. F. Spencer & Matthew Hall & M. Kate Grabowski & Joseph Kagaayi & Oliver Ratmann & Rakai Health Sciences Program and PANGEA‐HIV, 2022. "Inferring the sources of HIV infection in Africa from deep‐sequence data with semi‐parametric Bayesian Poisson flow models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(3), pages 517-540, June.
    19. Kuschnig, Nikolas, 2021. "Bayesian Spatial Econometrics and the Need for Software," Department of Economics Working Paper Series 318, WU Vienna University of Economics and Business.
    20. Deniz Aksoy & David Carlson, 2022. "Electoral support and militants’ targeting strategies," Journal of Peace Research, Peace Research Institute Oslo, vol. 59(2), pages 229-241, March.
    21. Li Yu & Peter F. Orazem, 2014. "O-Ring production on U.S. hog farms: joint choices of farm size, technology, and compensation," Agricultural Economics, International Association of Agricultural Economists, vol. 45(4), pages 431-442, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:46:y:2021:i:1:p:34-57. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.