IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v50y2016i6d10.1007_s11135-015-0282-1.html
   My bibliography  Save this article

Robust evaluation of fit indices to fake-good perturbation of ordinal data

Author

Listed:
  • Luigi Lombardi

    (University of Trento)

  • Massimiliano Pastore

    (University of Padova)

Abstract

This study extended the findings of a former simulation study (Multivar Behav Res 47:519–546, 2012) to evaluate the sensitivity of a large set of SEM-based fit indices to fake-good ordinal data. In the new simulation study we manipulated a comprehensive set of factors (including 3 robust estimation procedures and 3 different faking good models) that could influence the performance of 8 widely used fit indices. The simulation study conditions were chosen to highlight the differences among the fit indices, as well as to cover a wide variety of conditions. Our results demonstrated empirically that the normed fit index (NFI) turned out to be the most reliable fit index with a high sensitivity to fake perturbations. This result was evident in all the simulation design conditions except for those characterized by slight faking levels of perturbations. Interestingly, unlike NFI, the comparative fit index seemed to be highly insensitive to fake data when robust estimation conditions were considered. On the basis of the results of the simulation study we proposed a simple qualitative criterion to evaluate the impact of faking on statistical results.

Suggested Citation

  • Luigi Lombardi & Massimiliano Pastore, 2016. "Robust evaluation of fit indices to fake-good perturbation of ordinal data," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(6), pages 2651-2675, November.
    • Handle: RePEc:spr:qualqt:v:50:y:2016:i:6:d:10.1007_s11135-015-0282-1
    DOI: 10.1007/s11135-015-0282-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-015-0282-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-015-0282-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Massimiliano Pastore & Luigi Lombardi, 2014. "The impact of faking on Cronbach’s alpha for dichotomous and ordered rating scores," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(3), pages 1191-1211, May.
    2. Helton, J.C. & Johnson, J.D. & Sallaberry, C.J. & Storlie, C.B., 2006. "Survey of sampling-based methods for uncertainty and sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1175-1209.
    3. Nicola S. Gray & Malcolm J. MacCulloch & Jennifer Smith & Mark Morris & Robert J. Snowden, 2003. "Violence viewed by psychopathic murderers," Nature, Nature, vol. 423(6939), pages 497-498, May.
    4. Lee, Sik-Yum & Poon, Wai-Yin & Bentler, P. M., 1990. "Full maximum likelihood analysis of structural equation models with polytomous variables," Statistics & Probability Letters, Elsevier, vol. 9(1), pages 91-97, January.
    5. van der Geest, Sjaak & Sarkodie, Samuel, 1998. "The fake patient: A research experiment in a Ghanaian hospital," Social Science & Medicine, Elsevier, vol. 47(9), pages 1373-1381, November.
    6. Ledyard Tucker & Charles Lewis, 1973. "A reliability coefficient for maximum likelihood factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 38(1), pages 1-10, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Massimiliano Pastore & Luigi Lombardi, 2014. "The impact of faking on Cronbach’s alpha for dichotomous and ordered rating scores," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(3), pages 1191-1211, May.
    2. Luigi Lombardi & Massimiliano Pastore & Massimo Nucci & Andrea Bobbio, 2015. "SGR Modeling of Correlational Effects in Fake Good Self-report Measures," Methodology and Computing in Applied Probability, Springer, vol. 17(4), pages 1037-1055, December.
    3. Nuanphromsakul, Kajohnjak & Szczepańska-Woszczyna, Katarzyna & Kot, Sebastian & Chaveesuk, Singha & Chaiyasoonthorn, Wornchanok, 2022. "Sustainability of Rubber Farmers Cooperatives: Empirical Evaluation of Determining Factors," AGRIS on-line Papers in Economics and Informatics, Czech University of Life Sciences Prague, Faculty of Economics and Management, vol. 14(4), December.
    4. Zhou, Yuekuan & Zheng, Siqian, 2020. "Uncertainty study on thermal and energy performances of a deterministic parameters based optimal aerogel glazing system using machine-learning method," Energy, Elsevier, vol. 193(C).
    5. Mark Shevlin & David Boyda & James Houston & Jamie Murphy, 2015. "Measurement of the psychosis continuum: Modelling the frequency and distress of subclinical psychotic experiences," Psychosis, Taylor & Francis Journals, vol. 7(2), pages 108-118, April.
    6. Helton, Jon C. & Johnson, Jay D. & Sallaberry, Cédric J., 2011. "Quantification of margins and uncertainties: Example analyses from reactor safety and radioactive waste disposal involving the separation of aleatory and epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1014-1033.
    7. E. Huebner & Rich Gilman & James Laughlin, 1999. "A Multimethod Investigation of the Multidimensionality of Children's Well-Being Reports: Discriminant Validity of Life Satisfaction and Self-Esteem," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 46(1), pages 1-22, January.
    8. Plischke, Elmar & Borgonovo, Emanuele, 2019. "Copula theory and probabilistic sensitivity analysis: Is there a connection?," European Journal of Operational Research, Elsevier, vol. 277(3), pages 1046-1059.
    9. Ali Safarnejad & Jose-Antonio Izazola-Licea, 2017. "Direct and indirect effects of enablers on HIV testing, initiation and retention in antiretroviral treatment and AIDS related mortality," PLOS ONE, Public Library of Science, vol. 12(2), pages 1-15, February.
    10. Lili Tian & Li Zhang & E. Scott Huebner & Xiaoting Zheng & Wang Liu, 2016. "The Longitudinal Relationship Between School Belonging and Subjective Well-Being in School Among Elementary School Students," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 11(4), pages 1269-1285, December.
    11. Ronald S. Burt, 1973. "Confirmatory Factor-Analytic Structures and the Theory Construction Process," Sociological Methods & Research, , vol. 2(2), pages 131-190, November.
    12. Sulaiman Olusegun Atiku & Ziska Fields & Ethel Abe, 2017. "Cultural Values and Human Resource Outcomes in the Nigerian Banking Industry," SPOUDAI Journal of Economics and Business, SPOUDAI Journal of Economics and Business, University of Piraeus, vol. 67(2), pages 26-46, April-Jun.
    13. Evangeline I. Chirayil & Claire L. Thompson & Sue Burney, 2014. "Predicting Human Papilloma Virus Vaccination and Pap Smear Screening Intentions Among Young Singaporean Women Using the Theory of Planned Behavior," SAGE Open, , vol. 4(4), pages 21582440145, October.
    14. Saurbayeva, Assemgul & Memon, Shazim Ali & Kim, Jong, 2023. "Integrated multi-stage sensitivity analysis and multi-objective optimization approach for PCM integrated residential buildings in different climate zones," Energy, Elsevier, vol. 278(PB).
    15. Chong, Melody P.M. & Muethel, Miriam & Richards, Malika & Fu, Ping Ping & Peng, Tai-Kuang & Shang, Yu Fan & Caldas, Miguel P., 2013. "Influence behaviors and employees’ reactions: An empirical test among six societies based on a transactional–relational contract model," Journal of World Business, Elsevier, vol. 48(3), pages 373-384.
    16. Jon W. Hoelter, 1983. "The Analysis of Covariance Structures," Sociological Methods & Research, , vol. 11(3), pages 325-344, February.
    17. Donghyeon Yoo & Jinhwan Park & Jaemin Moon & Changwan Kim, 2021. "Reliability-Based Design Optimization for Reducing the Performance Failure and Maximizing the Specific Energy of Lithium-Ion Batteries Considering Manufacturing Uncertainty of Porous Electrodes," Energies, MDPI, vol. 14(19), pages 1-15, September.
    18. Bach Quang Ho & Yuki Inoue, 2020. "Driving Network Externalities in Education for Sustainable Development," Sustainability, MDPI, vol. 12(20), pages 1-16, October.
    19. Zhenhui (Jack) Jiang & Cheng Suang Heng & Ben C. F. Choi, 2013. "Research Note —Privacy Concerns and Privacy-Protective Behavior in Synchronous Online Social Interactions," Information Systems Research, INFORMS, vol. 24(3), pages 579-595, September.
    20. Tian, Wei & Song, Jitian & Li, Zhanyong & de Wilde, Pieter, 2014. "Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis," Applied Energy, Elsevier, vol. 135(C), pages 320-328.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:50:y:2016:i:6:d:10.1007_s11135-015-0282-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.