IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v51y2026i2p255-280.html

Bayesian Variable Selection in Dynamic Item Response Theory Models

Author

Listed:
  • Jingyu Sun

    (Revolution Medicines)

  • Yang Liu

    (Upstart)

  • Xiaojing Wang
  • Ming-Hui Chen

    (University of Connecticut)

Abstract

The recent surge in computerized testing brings challenges in the analysis of testing data with classic item response theory (IRT) models. To handle individually varying and irregularly spaced longitudinal dichotomous responses, we adopt a dynamic IRT model framework and then extend the model to link with individual characteristics at a hierarchical level. Further, we have developed an algorithm to select important characteristics of individuals that can capture the growth changes of one’s ability under this multi-level dynamic IRT model, where we can compute the Bayes factor of the proposed model including different covariates using a single Markov chain Monte Carlo output from the full model. In addition, we have shown the model selection consistency under the modified Zellner–Siow prior, and we have conducted simulations to illustrate the properties of the model selection consistency in finite samples. Finally, we have applied our proposed model and computational algorithms to a real data application, called EdSphere dataset, in educational testing.

Suggested Citation

  • Jingyu Sun & Yang Liu & Xiaojing Wang & Ming-Hui Chen, 2026. "Bayesian Variable Selection in Dynamic Item Response Theory Models," Journal of Educational and Behavioral Statistics, , vol. 51(2), pages 255-280, April.
    • Handle: RePEc:sae:jedbes:v:51:y:2026:i:2:p:255-280
    DOI: 10.3102/10769986251314527
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986251314527
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986251314527?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Philip Heidelberger & Peter D. Welch, 1983. "Simulation Run Length Control in the Presence of an Initial Transient," Operations Research, INFORMS, vol. 31(6), pages 1109-1144, December.
    2. Jesper Tijmstra & Maria Bolsinova, 2019. "Bayes Factors for Evaluating Latent Monotonicity in Polytomous Item Response Theory Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 846-869, September.
    3. Fang Liu & Xiaojing Wang & Roeland Hancock & Ming-Hui Chen, 2022. "Bayesian Model Assessment for Jointly Modeling Multidimensional Response Data with Application to Computerized Testing," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1290-1317, December.
    4. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    5. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    6. Smith, Brian J., 2007. "boa: An R Package for MCMC Output Convergence Assessment and Posterior Inference," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 21(i11).
    7. Veronika Ročková & Edward I. George, 2018. "The Spike-and-Slab LASSO," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 431-444, January.
    8. Ming‐Hui Chen, 2005. "Computing marginal likelihoods from a single MCMC output," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 59(1), pages 16-29, February.
    9. Yang Liu & Xiaojing Wang, 2020. "Bayesian Nonparametric Monotone Regression of Dynamic Latent Traits in Item Response Theory Models," Journal of Educational and Behavioral Statistics, , vol. 45(3), pages 274-296, June.
    10. Liang, Feng & Paulo, Rui & Molina, German & Clyde, Merlise A. & Berger, Jim O., 2008. "Mixtures of g Priors for Bayesian Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 410-423, March.
    11. Yingbo Li & Merlise A. Clyde, 2018. "Mixtures of g-Priors in Generalized Linear Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1828-1845, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    2. Arnab Kumar Maity & Sanjib Basu & Santu Ghosh, 2021. "Bayesian criterion‐based variable selection," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(4), pages 835-857, August.
    3. Posch, Konstantin & Arbeiter, Maximilian & Pilz, Juergen, 2020. "A novel Bayesian approach for variable selection in linear regression models," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    4. Hans, Christopher M. & Peruggia, Mario & Wang, Junyan, 2023. "Empirical Bayes Model Averaging with Influential Observations: Tuning Zellner’s g Prior for Predictive Robustness," Econometrics and Statistics, Elsevier, vol. 27(C), pages 102-119.
    5. Zellner, Arnold & Ando, Tomohiro, 2010. "Bayesian and non-Bayesian analysis of the seemingly unrelated regression model with Student-t errors, and its application for forecasting," International Journal of Forecasting, Elsevier, vol. 26(2), pages 413-434, April.
    6. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    7. Zhou, Haiming & Huang, Xianzheng, 2022. "Bayesian beta regression for bounded responses with unknown supports," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    8. Riccardo (Jack) Lucchetti & Luca Pedini, 2020. "ParMA: Parallelised Bayesian Model Averaging for Generalised Linear Models," Working Papers 2020:28, Department of Economics, University of Venice "Ca' Foscari".
    9. Anna Sokolova, 2023. "Marginal Propensity to Consume and Unemployment: a Meta-analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 813-846, December.
    10. Ley, Eduardo & Steel, Mark F.J., 2012. "Mixtures of g-priors for Bayesian model averaging with economic applications," Journal of Econometrics, Elsevier, vol. 171(2), pages 251-266.
    11. Jesus Crespo Cuaresma & Bettina Grün & Paul Hofmarcher & Stefan Humer & Mathias Moser, 2015. "A Comprehensive Approach to Posterior Jointness Analysis in Bayesian Model Averaging Applications," Department of Economics Working Papers wuwp193, Vienna University of Economics and Business, Department of Economics.
    12. Ley, Eduardo & Steel, Mark F. J., 2007. "On the effect of prior assumptions in Bayesian model averaging with applications to growth regression," Policy Research Working Paper Series 4238, The World Bank.
    13. Aart Kraay & Norikazu Tawara, 2013. "Can specific policy indicators identify reform priorities?," Journal of Economic Growth, Springer, vol. 18(3), pages 253-283, September.
    14. Crespo Cuaresma, Jesus & von Schweinitz, Gregor & Wendt, Katharina, 2019. "On the empirics of reserve requirements and economic growth," Journal of Macroeconomics, Elsevier, vol. 60(C), pages 253-274.
    15. Jesús Crespo Cuaresma & Martin Feldkircher, 2013. "Spatial Filtering, Model Uncertainty And The Speed Of Income Convergence In Europe," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(4), pages 720-741, June.
    16. Chen Ray-Bing & Chen Yi-Chi & Chu Chi-Hsiang & Lee Kuo-Jung, 2017. "On the determinants of the 2008 financial crisis: a Bayesian approach to the selection of groups and variables," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 21(5), pages 1-17, December.
    17. Bruns, Stephan B. & Ioannidis, John P.A., 2020. "Determinants of economic growth: Different time different answer?," Journal of Macroeconomics, Elsevier, vol. 63(C).
    18. Gilles Celeux & Mohammed El Anbari & Jean-Michel Marin & Christian P. Robert, 2010. "Regularization in Regression : Comparing Bayesian and Frequentist Methods in a Poorly Informative Situation," Working Papers 2010-43, Center for Research in Economics and Statistics.
    19. Min Wang & Guangying Liu, 2016. "A Simple Two-Sample Bayesian t -Test for Hypothesis Testing," The American Statistician, Taylor & Francis Journals, vol. 70(2), pages 195-201, May.
    20. Hanneke Geerlings & Cees Glas & Wim Linden, 2011. "Modeling Rule-Based Item Generation," Psychometrika, Springer;The Psychometric Society, vol. 76(2), pages 337-359, April.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:51:y:2026:i:2:p:255-280. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.