IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v88y2023i2d10.1007_s11336-023-09905-w.html
   My bibliography  Save this article

A Test to Distinguish Monotone Homogeneity from Monotone Multifactor Models

Author

Listed:
  • Jules L. Ellis

    (Behavioural Science Institute, Radboud University Nijmegen)

  • Klaas Sijtsma

    (Tilburg University)

Abstract

The goodness-of-fit of the unidimensional monotone latent variable model can be assessed using the empirical conditions of nonnegative correlations (Mokken in A theory and procedure of scale-analysis, Mouton, The Hague, 1971), manifest monotonicity (Junker in Ann Stat 21:1359–1378, 1993), multivariate total positivity of order 2 (Bartolucci and Forcina in Ann Stat 28:1206–1218, 2000), and nonnegative partial correlations (Ellis in Psychometrika 79:303–316, 2014). We show that multidimensional monotone factor models with independent factors also imply these empirical conditions; therefore, the conditions are insensitive to multidimensionality. Conditional association (Rosenbaum in Psychometrika 49(3):425–435, 1984) can detect multidimensionality, but tests of it (De Gooijer and Yuan in Comput Stat Data Anal 55:34–44, 2011) are usually not feasible for realistic numbers of items. The only existing feasible test procedures that can reveal multidimensionality are Rosenbaum’s (Psychometrika 49(3):425–435, 1984) Case 2 and Case 5, which test the covariance of two items or two subtests conditionally on the unweighted sum of the other items. We improve this procedure by conditioning on a weighted sum of the other items. The weights are estimated in a training sample from a linear regression analysis. Simulations show that the Type I error rate is under control and that, for large samples, the power is higher if one dimension is more important than the other or if there is a third dimension. In small samples and with two equally important dimensions, using the unweighted sum yields greater power.

Suggested Citation

  • Jules L. Ellis & Klaas Sijtsma, 2023. "A Test to Distinguish Monotone Homogeneity from Monotone Multifactor Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 387-412, June.
  • Handle: RePEc:spr:psycho:v:88:y:2023:i:2:d:10.1007_s11336-023-09905-w
    DOI: 10.1007/s11336-023-09905-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-023-09905-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11336-023-09905-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. M. Onna, 2002. "Bayesian estimation and model selection in ordered latent class models for polytomous items," Psychometrika, Springer;The Psychometric Society, vol. 67(4), pages 519-538, December.
    2. van der Ark, L. Andries, 2007. "Mokken Scale Analysis in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i11).
    3. Jesper Tijmstra & David Hessen & Peter Heijden & Klaas Sijtsma, 2013. "Testing Manifest Monotonicity Using Order-Constrained Statistical Inference," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 83-97, January.
    4. William Stout, 1987. "A nonparametric approach for assessing latent trait unidimensionality," Psychometrika, Springer;The Psychometric Society, vol. 52(4), pages 589-617, December.
    5. Paul Holland, 1981. "When are item response models consistent with observed data?," Psychometrika, Springer;The Psychometric Society, vol. 46(1), pages 79-92, March.
    6. Jinming Zhang & William Stout, 1999. "The theoretical detect index of dimensionality and its application to approximate simple structure," Psychometrika, Springer;The Psychometric Society, vol. 64(2), pages 213-249, June.
    7. De Gooijer, Jan G. & Yuan, Ao, 2011. "Some exact tests for manifest properties of latent trait models," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 34-44, January.
    8. Jesper Tijmstra & Maria Bolsinova, 2019. "Bayes Factors for Evaluating Latent Monotonicity in Polytomous Item Response Theory Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 846-869, September.
    9. J. Straat & L. Ark & Klaas Sijtsma, 2013. "Comparing Optimization Algorithms for Item Selection in Mokken Scale Analysis," Journal of Classification, Springer;The Classification Society, vol. 30(1), pages 75-99, April.
    10. Michael Brusco & Hans-Friedrich Köhn & Douglas Steinley, 2015. "An Exact Method for Partitioning Dichotomous Items Within the Framework of the Monotone Homogeneity Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 949-967, December.
    11. Albert Maydeu-Olivares & Harry Joe, 2006. "Limited Information Goodness-of-fit Testing in Multidimensional Contingency Tables," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 713-732, December.
    12. Francesco Bartolucci, 2007. "A class of multidimensional IRT models for testing unidimensionality and clustering items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 141-157, June.
    13. Paul Rosenbaum, 1984. "Testing the conditional independence and monotonicity assumptions of item response theory," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 425-435, September.
    14. Rinott, Yosef & Scarsini, Marco, 2006. "Total positivity order and the normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 97(5), pages 1251-1261, May.
    15. Arnold Wollenberg, 1982. "Two new test statistics for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 123-140, June.
    16. Milgrom, Paul R & Weber, Robert J, 1982. "A Theory of Auctions and Competitive Bidding," Econometrica, Econometric Society, vol. 50(5), pages 1089-1122, September.
    17. Rudy Ligtvoet, 2022. "Incomplete Tests of Conditional Association for the Assessment of Model Assumptions," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1214-1237, December.
    18. Karl Christensen & Jakob Bjorner & Svend Kreiner & Jørgen Petersen, 2002. "Testing unidimensionality in polytomous Rasch models," Psychometrika, Springer;The Psychometric Society, vol. 67(4), pages 563-574, December.
    19. Karlin, Samuel & Rinott, Yosef, 1980. "Classes of orderings of measures and related correlation inequalities II. Multivariate reverse rule distributions," Journal of Multivariate Analysis, Elsevier, vol. 10(4), pages 499-516, December.
    20. Jinming Zhang, 2007. "Conditional Covariance Theory and Detect for Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(1), pages 69-91, March.
    21. Jules Ellis, 2014. "An Inequality for Correlations in Unidimensional Monotone Latent Variable Models for Binary Variables," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 303-316, April.
    22. Yoshio Takane & Jan Leeuw, 1987. "On the relationship between item response theory and factor analysis of discretized variables," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 393-408, September.
    23. Karlin, Samuel & Rinott, Yosef, 1980. "Classes of orderings of measures and related correlation inequalities. I. Multivariate totally positive distributions," Journal of Multivariate Analysis, Elsevier, vol. 10(4), pages 467-498, December.
    24. Jinming Zhang & William Stout, 1999. "Conditional covariance structure of generalized compensatory multidimensional items," Psychometrika, Springer;The Psychometric Society, vol. 64(2), pages 129-152, June.
    25. Francesco Bartolucci & Alessio Farcomeni & Luisa Scaccia, 2017. "A Nonparametric Multidimensional Latent Class IRT Model in a Bayesian Framework," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 952-978, December.
    26. van der Ark, L. Andries, 2012. "New Developments in Mokken Scale Analysis in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i05).
    27. Cees Glas, 1988. "The derivation of some tests for the rasch model from the multinomial distribution," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 525-546, December.
    28. Francesco Bartolucci & Antonio Forcina, 2005. "Likelihood inference on the underlying structure of IRT models," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 31-43, March.
    29. Efron, Bradley, 2010. "Correlated z-Values and the Accuracy of Large-Scale Statistical Estimates," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1042-1055.
    30. Jules Ellis & Brian Junker, 1997. "Tail-measurability in monotone latent variable models," Psychometrika, Springer;The Psychometric Society, vol. 62(4), pages 495-523, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rudy Ligtvoet, 2022. "Incomplete Tests of Conditional Association for the Assessment of Model Assumptions," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1214-1237, December.
    2. Jules Ellis, 2014. "An Inequality for Correlations in Unidimensional Monotone Latent Variable Models for Binary Variables," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 303-316, April.
    3. Michael Brusco & Hans-Friedrich Köhn & Douglas Steinley, 2015. "An Exact Method for Partitioning Dichotomous Items Within the Framework of the Monotone Homogeneity Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 949-967, December.
    4. César Merino-Soto & Arturo Juárez-García & Guillermo Salinas Escudero & Filiberto Toledano-Toledano, 2022. "Parametric and Nonparametric Analysis of the Internal Structure of the Psychosocial Work Processes Questionnaire (PROPSIT) as Applied to Workers," IJERPH, MDPI, vol. 19(13), pages 1-23, June.
    5. Francesco Bartolucci & Alessio Farcomeni & Luisa Scaccia, 2017. "A Nonparametric Multidimensional Latent Class IRT Model in a Bayesian Framework," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 952-978, December.
    6. Michela Gnaldi, 2017. "A multidimensional IRT approach for dimensionality assessment of standardised students’ tests in mathematics," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(3), pages 1167-1182, May.
    7. Svend Kreiner & Karl Christensen, 2011. "Item Screening in Graphical Loglinear Rasch Models," Psychometrika, Springer;The Psychometric Society, vol. 76(2), pages 228-256, April.
    8. Chi, Chang Koo & Murto, Pauli & Valimaki, Juuso, 2017. "All-Pay Auctions with Affiliated Values," MPRA Paper 80799, University Library of Munich, Germany.
    9. Alberto Maydeu-Olivares & Rosa Montaño, 2013. "How Should We Assess the Fit of Rasch-Type Models? Approximating the Power of Goodness-of-Fit Statistics in Categorical Data Analysis," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 116-133, January.
    10. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    11. Jules Ellis & Arnold Wollenberg, 1993. "Local homogeneity in latent trait models. A characterization of the homogeneous monotone irt model," Psychometrika, Springer;The Psychometric Society, vol. 58(3), pages 417-429, September.
    12. Francesco Bartolucci & Ivonne Solis-Trapala, 2010. "Multidimensional Latent Markov Models in a Developmental Study of Inhibitory Control and Attentional Flexibility in Early Childhood," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 725-743, December.
    13. Yong Luo & Khaleel Al-Harbi, 2016. "The Utility of the Bifactor Method for Unidimensionality Assessment When Other Methods Disagree," SAGE Open, , vol. 6(4), pages 21582440166, October.
    14. Badía, F.G. & Sangüesa, C. & Cha, J.H., 2014. "Stochastic comparison of multivariate conditionally dependent mixtures," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 82-94.
    15. Prokopovych, Pavlo & Yannelis, Nicholas C., 2019. "On monotone approximate and exact equilibria of an asymmetric first-price auction with affiliated private information," Journal of Economic Theory, Elsevier, vol. 184(C).
    16. Bhattacharya, Bhaskar, 2012. "Covariance selection and multivariate dependence," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 212-228.
    17. Paul Holland, 1990. "On the sampling theory roundations of item response theory models," Psychometrika, Springer;The Psychometric Society, vol. 55(4), pages 577-601, December.
    18. Jesper Tijmstra & Maria Bolsinova, 2019. "Bayes Factors for Evaluating Latent Monotonicity in Polytomous Item Response Theory Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 846-869, September.
    19. Michael Chwe, 2006. "Statistical Game Theory," Theory workshop papers 815595000000000004, UCLA Department of Economics.
    20. Pascal Jordan & Martin Spiess, 2012. "Generalizations of Paradoxical Results in Multidimensional Item Response Theory," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 127-152, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:88:y:2023:i:2:d:10.1007_s11336-023-09905-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.