IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v45y2020i6p639-666.html
   My bibliography  Save this article

A Bayesian Nonparametric Latent Approach for Score Distributions in Test Equating

Author

Listed:
  • Inés M. Varas
  • Jorge González

    (28033Pontificia Universidad Católica de Chile
    Laboratorio Interdisciplinario de Estadística Social (LIES))

  • Fernando A. Quintana

    (28033Pontificia Universidad Católica de Chile
    Millennium Nucleus Center for the Discovery of Structures in Complex Data)

Abstract

Equating is a family of statistical models and methods used to adjust scores on different test forms so that they can be comparable and used interchangeably. Equated scores are obtained estimating the equating transformation function, which maps the scores on the scale of one test form into their equivalents on the scale of other one. All the statistical models that have been proposed for estimating this function are based on continuous approximations of the score distributions, leading to equated scores lying on a continuous scale even though score scales are usually subsets of the integer numbers (e.g., the total number of correct answers). In this article, we develop a new equating method from which equated scores defined on the original discrete scale are obtained. Considering scores as ordinal random variables, we propose a continuous latent variable formulation to perform an equipercentile-like equating based on a Bayesian nonparametric model for score distributions. The proposed model is applied to simulated and real data collected under an equivalent group design. Some methods to assess the performance of our model are also discussed. Compared with discrete versions of equated scored obtained from traditional equating methods, the results show that the proposed method has better performance.

Suggested Citation

  • Inés M. Varas & Jorge González & Fernando A. Quintana, 2020. "A Bayesian Nonparametric Latent Approach for Score Distributions in Test Equating," Journal of Educational and Behavioral Statistics, , vol. 45(6), pages 639-666, December.
    • Handle: RePEc:sae:jedbes:v:45:y:2020:i:6:p:639-666
    DOI: 10.3102/1076998620907381
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998620907381
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998620907381?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. De Iorio, Maria & Muller, Peter & Rosner, Gary L. & MacEachern, Steven N., 2004. "An ANOVA Model for Dependent Random Measures," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 205-215, January.
    2. George Karabatsos & Stephen Walker, 2009. "A Bayesian Nonparametric Approach to Test Equating," Psychometrika, Springer;The Psychometric Society, vol. 74(2), pages 211-232, June.
    3. Haber, Michael, 1985. "Maximum likelihood methods for linear and log-linear models in categorical data," Computational Statistics & Data Analysis, Elsevier, vol. 3(1), pages 1-10, May.
    4. Ishwaran H. & James L. F, 2001. "Gibbs Sampling Methods for Stick Breaking Priors," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 161-173, March.
    5. González, Jorge & Barrientos, Andrés F. & Quintana, Fernando A., 2015. "Bayesian nonparametric estimation of test equating functions with covariates," Computational Statistics & Data Analysis, Elsevier, vol. 89(C), pages 222-244.
    6. Ghosh, Sujit K. & Burns, Christopher B. & Prager, Daniel L. & Zhang, Li & Hui, Glenn, 2018. "On nonparametric estimation of the latent distribution for ordinal data," Computational Statistics & Data Analysis, Elsevier, vol. 119(C), pages 86-98.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    2. Abel Rodriguez & Enrique ter Horst, 2008. "Measuring expectations in options markets: An application to the SP500 index," Papers 0901.0033, arXiv.org.
    3. Bassetti, Federico & Casarin, Roberto & Leisen, Fabrizio, 2014. "Beta-product dependent Pitman–Yor processes for Bayesian inference," Journal of Econometrics, Elsevier, vol. 180(1), pages 49-72.
    4. González, Jorge & Barrientos, Andrés F. & Quintana, Fernando A., 2015. "Bayesian nonparametric estimation of test equating functions with covariates," Computational Statistics & Data Analysis, Elsevier, vol. 89(C), pages 222-244.
    5. Bassetti, Federico & Casarin, Roberto & Leisen, Fabrizio, 2011. "Beta-product Poisson-Dirichlet Processes," DES - Working Papers. Statistics and Econometrics. WS 12160, Universidad Carlos III de Madrid. Departamento de Estadística.
    6. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2023. "Forecasting with a panel Tobit model," Quantitative Economics, Econometric Society, vol. 14(1), pages 117-159, January.
    7. Igari, Ryosuke & Hoshino, Takahiro, 2018. "A Bayesian data combination approach for repeated durations under unobserved missing indicators: Application to interpurchase-timing in marketing," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 150-166.
    8. Pati, Debdeep & Dunson, David B. & Tokdar, Surya T., 2013. "Posterior consistency in conditional distribution estimation," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 456-472.
    9. Mahsa Samsami & Ralf Wagner, 2021. "Investment Decisions with Endogeneity: A Dirichlet Tree Analysis," JRFM, MDPI, vol. 14(7), pages 1-19, July.
    10. Ryo Kato & Takahiro Hoshino, 2020. "Semiparametric Bayesian multiple imputation for regression models with missing mixed continuous–discrete covariates," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 803-825, June.
    11. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2009. "Regression density estimation using smooth adaptive Gaussian mixtures," Journal of Econometrics, Elsevier, vol. 153(2), pages 155-173, December.
    12. Fuentes-García, Ruth & Mena, Ramsés H. & Walker, Stephen G., 2009. "A nonparametric dependent process for Bayesian regression," Statistics & Probability Letters, Elsevier, vol. 79(8), pages 1112-1119, April.
    13. Weixuan Zhu & Fabrizio Leisen, 2015. "A multivariate extension of a vector of two-parameter Poisson-Dirichlet processes," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 27(1), pages 89-105, March.
    14. Michael L. Pennell & David B. Dunson, 2008. "Nonparametric Bayes Testing of Changes in a Response Distribution with an Ordinal Predictor," Biometrics, The International Biometric Society, vol. 64(2), pages 413-423, June.
    15. Laura Liu, 2018. "Density Forecasts in Panel Data Models : A Semiparametric Bayesian Perspective," Finance and Economics Discussion Series 2018-036, Board of Governors of the Federal Reserve System (U.S.).
    16. Trippa, Lorenzo & Muliere, Pietro, 2009. "Bayesian nonparametric binary regression via random tessellations," Statistics & Probability Letters, Elsevier, vol. 79(21), pages 2273-2280, November.
    17. Bruno Scarpa & David B. Dunson, 2009. "Bayesian Hierarchical Functional Data Analysis Via Contaminated Informative Priors," Biometrics, The International Biometric Society, vol. 65(3), pages 772-780, September.
    18. Hatjispyros, Spyridon J. & Nicoleris, Theodoros & Walker, Stephen G., 2016. "Random density functions with common atoms and pairwise dependence," Computational Statistics & Data Analysis, Elsevier, vol. 101(C), pages 236-249.
    19. George Karabatsos & Stephen Walker, 2009. "A Bayesian Nonparametric Approach to Test Equating," Psychometrika, Springer;The Psychometric Society, vol. 74(2), pages 211-232, June.
    20. Yuan Fang & Dimitris Karlis & Sanjeena Subedi, 2022. "Infinite Mixtures of Multivariate Normal-Inverse Gaussian Distributions for Clustering of Skewed Data," Journal of Classification, Springer;The Classification Society, vol. 39(3), pages 510-552, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:45:y:2020:i:6:p:639-666. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.