IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v87y2022i4d10.1007_s11336-022-09841-1.html
   My bibliography  Save this article

Incomplete Tests of Conditional Association for the Assessment of Model Assumptions

Author

Listed:
  • Rudy Ligtvoet

    (University of Cologne, Germany)

Abstract

Many of the models that have been proposed for response data share the assumptions that define the monotone homogeneity (MH) model. Observable properties that are implied by the MH model allow for these assumptions to be tested. For binary response data, the most restrictive of these properties is called conditional association (CA). All the other properties considered can be considered incomplete tests of CA that alleviate the practical limitations encountered when assessing the MH model assumptions using CA. It is found that the assessment of the MH model assumptions with an incomplete test of CA, rather than CA, is generally associated with a substantial loss of information. We also look at the sensitivity of the observable properties to model violation and discuss the implications of the results. It is argued that more research is required about the extent to which the assumptions and the model specifications influence the inferences made from response data.

Suggested Citation

  • Rudy Ligtvoet, 2022. "Incomplete Tests of Conditional Association for the Assessment of Model Assumptions," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1214-1237, December.
    • Handle: RePEc:spr:psycho:v:87:y:2022:i:4:d:10.1007_s11336-022-09841-1
    DOI: 10.1007/s11336-022-09841-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-022-09841-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-022-09841-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. van der Ark, L. Andries, 2007. "Mokken Scale Analysis in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i11).
    2. Jesper Tijmstra & David Hessen & Peter Heijden & Klaas Sijtsma, 2013. "Testing Manifest Monotonicity Using Order-Constrained Statistical Inference," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 83-97, January.
    3. Rudy Ligtvoet, 2012. "An Isotonic Partial Credit Model for Ordering Subjects on the Basis of Their Sum Scores," Psychometrika, Springer;The Psychometric Society, vol. 77(3), pages 479-494, July.
    4. George Kimeldorf & Allan Sampson, 1989. "A framework for positive dependence," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 41(1), pages 31-45, March.
    5. William Stout, 1987. "A nonparametric approach for assessing latent trait unidimensionality," Psychometrika, Springer;The Psychometric Society, vol. 52(4), pages 589-617, December.
    6. L. Ark, 2005. "Stochastic Ordering Of the Latent Trait by the Sum Score Under Various Polytomous IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 70(2), pages 283-304, June.
    7. Paul Holland, 1981. "When are item response models consistent with observed data?," Psychometrika, Springer;The Psychometric Society, vol. 46(1), pages 79-92, March.
    8. De Gooijer, Jan G. & Yuan, Ao, 2011. "Some exact tests for manifest properties of latent trait models," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 34-44, January.
    9. Matthijs Warrens, 2008. "On Association Coefficients for 2×2 Tables and Properties That Do Not Depend on the Marginal Distributions," Psychometrika, Springer;The Psychometric Society, vol. 73(4), pages 777-789, December.
    10. Ivo Ponocny, 2001. "Nonparametric goodness-of-fit tests for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 437-459, September.
    11. J. Straat & L. Ark & Klaas Sijtsma, 2013. "Comparing Optimization Algorithms for Item Selection in Mokken Scale Analysis," Journal of Classification, Springer;The Classification Society, vol. 30(1), pages 75-99, April.
    12. Klugkist, Irene & Hoijtink, Herbert, 2007. "The Bayes factor for inequality and about equality constrained models," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6367-6379, August.
    13. Michael Brusco & Hans-Friedrich Köhn & Douglas Steinley, 2015. "An Exact Method for Partitioning Dichotomous Items Within the Framework of the Monotone Homogeneity Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 949-967, December.
    14. Block, Henry W. & Fang, Zhaoben, 1990. "Setwise independence for some dependence structures," Journal of Multivariate Analysis, Elsevier, vol. 32(1), pages 103-119, January.
    15. Paul Rosenbaum, 1984. "Testing the conditional independence and monotonicity assumptions of item response theory," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 425-435, September.
    16. Katsikatsou, Myrsini & Moustaki, Irini & Yang-Wallentin, Fan & Jöreskog, Karl G., 2012. "Pairwise likelihood estimation for factor analysis models with ordinal data," LSE Research Online Documents on Economics 43182, London School of Economics and Political Science, LSE Library.
    17. Katsikatsou, Myrsini & Moustaki, Irini & Yang-Wallentin, Fan & Jöreskog, Karl G., 2012. "Pairwise likelihood estimation for factor analysis models with ordinal data," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 4243-4258.
    18. William Stout, 2002. "Psychometrics: From practice to theory and back," Psychometrika, Springer;The Psychometric Society, vol. 67(4), pages 485-518, December.
    19. Karlin, Samuel & Rinott, Yosef, 1980. "Classes of orderings of measures and related correlation inequalities II. Multivariate reverse rule distributions," Journal of Multivariate Analysis, Elsevier, vol. 10(4), pages 499-516, December.
    20. Bas Hemker & Klaas Sijtsma & Ivo Molenaar & Brian Junker, 1996. "Polytomous IRT models and monotone likelihood ratio of the total score," Psychometrika, Springer;The Psychometric Society, vol. 61(4), pages 679-693, December.
    21. Brian Junker, 1991. "Essential independence and likelihood-based ability estimation for polytomous items," Psychometrika, Springer;The Psychometric Society, vol. 56(2), pages 255-278, June.
    22. Herbert Hojtink & Ivo Molenaar, 1997. "A multidimensional item response model: Constrained latent class analysis using the gibbs sampler and posterior predictive checks," Psychometrika, Springer;The Psychometric Society, vol. 62(2), pages 171-189, June.
    23. Jules Ellis, 2014. "An Inequality for Correlations in Unidimensional Monotone Latent Variable Models for Binary Variables," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 303-316, April.
    24. Karlin, Samuel & Rinott, Yosef, 1980. "Classes of orderings of measures and related correlation inequalities. I. Multivariate totally positive distributions," Journal of Multivariate Analysis, Elsevier, vol. 10(4), pages 467-498, December.
    25. Ivo W. Molenaar, 2004. "About handy, handmade and handsome models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 58(1), pages 1-20, February.
    26. Cees Glas, 1988. "The derivation of some tests for the rasch model from the multinomial distribution," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 525-546, December.
    27. Huynh Huynh, 1994. "A new proof for monotone likelihood ratio for the sum of independent bernoulli random variables," Psychometrika, Springer;The Psychometric Society, vol. 59(1), pages 77-79, March.
    28. Erling Andersen, 1973. "A goodness of fit test for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 38(1), pages 123-140, March.
    29. Francesco Bartolucci & Antonio Forcina, 2005. "Likelihood inference on the underlying structure of IRT models," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 31-43, March.
    30. Jesper Tijmstra & Herbert Hoijtink & Klaas Sijtsma, 2015. "Evaluating Manifest Monotonicity Using Bayes Factors," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 880-896, December.
    31. Jules Ellis & Brian Junker, 1997. "Tail-measurability in monotone latent variable models," Psychometrika, Springer;The Psychometric Society, vol. 62(4), pages 495-523, December.
    32. D. Grayson, 1988. "Two-group classification in latent trait theory: Scores with monotone likelihood ratio," Psychometrika, Springer;The Psychometric Society, vol. 53(3), pages 383-392, September.
    33. Bas Hemker & Klaas Sijtsma & Ivo Molenaar & Brian Junker, 1997. "Stochastic ordering using the latent trait and the sum score in polytomous IRT models," Psychometrika, Springer;The Psychometric Society, vol. 62(3), pages 331-347, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jules L. Ellis & Klaas Sijtsma, 2023. "A Test to Distinguish Monotone Homogeneity from Monotone Multifactor Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 387-412, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jules L. Ellis & Klaas Sijtsma, 2023. "A Test to Distinguish Monotone Homogeneity from Monotone Multifactor Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 387-412, June.
    2. Wim Linden, 1998. "Stochastic order in dichotomous item response models for fixed, adaptive, and multidimensional tests," Psychometrika, Springer;The Psychometric Society, vol. 63(3), pages 211-226, September.
    3. Rudy Ligtvoet, 2012. "An Isotonic Partial Credit Model for Ordering Subjects on the Basis of Their Sum Scores," Psychometrika, Springer;The Psychometric Society, vol. 77(3), pages 479-494, July.
    4. Jesper Tijmstra & Maria Bolsinova, 2019. "Bayes Factors for Evaluating Latent Monotonicity in Polytomous Item Response Theory Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 846-869, September.
    5. Jules Ellis, 2014. "An Inequality for Correlations in Unidimensional Monotone Latent Variable Models for Binary Variables," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 303-316, April.
    6. Cees Glas, 1999. "Modification indices for the 2-PL and the nominal response model," Psychometrika, Springer;The Psychometric Society, vol. 64(3), pages 273-294, September.
    7. Jesper Tijmstra & Herbert Hoijtink & Klaas Sijtsma, 2015. "Evaluating Manifest Monotonicity Using Bayes Factors," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 880-896, December.
    8. van der Ark, L. Andries, 2012. "New Developments in Mokken Scale Analysis in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i05).
    9. Ligtvoet, R., 2015. "A test for using the sum score to obtain a stochastic ordering of subjects," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 136-139.
    10. J. Straat & L. Ark & Klaas Sijtsma, 2013. "Comparing Optimization Algorithms for Item Selection in Mokken Scale Analysis," Journal of Classification, Springer;The Classification Society, vol. 30(1), pages 75-99, April.
    11. L. Ark & Wicher Bergsma, 2010. "A Note on Stochastic Ordering of the Latent Trait Using the Sum of Polytomous Item Scores," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 272-279, June.
    12. repec:jss:jstsof:20:i11 is not listed on IDEAS
    13. Bas Hemker & L. Andries van der Ark & Klaas Sijtsma, 2001. "On measurement properties of continuation ratio models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 487-506, December.
    14. Ivo Molenaar, 1998. "Data, model, conclusion, doing it again," Psychometrika, Springer;The Psychometric Society, vol. 63(4), pages 315-340, December.
    15. Rudy Ligtvoet, 2015. "Remarks and a Correction of Ligtvoet’s Treatment of the Isotonic Partial Credit Model," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 514-515, June.
    16. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    17. Jules Ellis & Arnold Wollenberg, 1993. "Local homogeneity in latent trait models. A characterization of the homogeneous monotone irt model," Psychometrika, Springer;The Psychometric Society, vol. 58(3), pages 417-429, September.
    18. Paul Holland, 1990. "On the sampling theory roundations of item response theory models," Psychometrika, Springer;The Psychometric Society, vol. 55(4), pages 577-601, December.
    19. Klaas Sijtsma & Rob Meijer, 2001. "The person response function as a tool in person-fit research," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 191-207, June.
    20. Timo Bechger & Gunter Maris, 2015. "A Statistical Test for Differential Item Pair Functioning," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 317-340, June.
    21. Pascal Jordan & Martin Spiess, 2012. "Generalizations of Paradoxical Results in Multidimensional Item Response Theory," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 127-152, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:87:y:2022:i:4:d:10.1007_s11336-022-09841-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.