IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v89y2024i3d10.1007_s11336-024-09975-4.html
   My bibliography  Save this article

Signal-to-Noise Ratio in Estimating and Testing the Mediation Effect: Structural Equation Modeling versus Path Analysis with Weighted Composites

Author

Listed:
  • Ke-Hai Yuan

    (Renmin University of China
    University of Notre Dame)

  • Zhiyong Zhang

    (University of Notre Dame)

  • Lijuan Wang

    (University of Notre Dame)

Abstract

Mediation analysis plays an important role in understanding causal processes in social and behavioral sciences. While path analysis with composite scores was criticized to yield biased parameter estimates when variables contain measurement errors, recent literature has pointed out that the population values of parameters of latent-variable models are determined by the subjectively assigned scales of the latent variables. Thus, conclusions in existing studies comparing structural equation modeling (SEM) and path analysis with weighted composites (PAWC) on the accuracy and precision of the estimates of the indirect effect in mediation analysis have little validity. Instead of comparing the size on estimates of the indirect effect between SEM and PAWC, this article compares parameter estimates by signal-to-noise ratio (SNR), which does not depend on the metrics of the latent variables once the anchors of the latent variables are determined. Results show that PAWC yields greater SNR than SEM in estimating and testing the indirect effect even when measurement errors exist. In particular, path analysis via factor scores almost always yields greater SNRs than SEM. Mediation analysis with equally weighted composites (EWCs) also more likely yields greater SNRs than SEM. Consequently, PAWC is statistically more efficient and more powerful than SEM in conducting mediation analysis in empirical research. The article also further studies conditions that cause SEM to have smaller SNRs, and results indicate that the advantage of PAWC becomes more obvious when there is a strong relationship between the predictor and the mediator, whereas the size of the prediction error in the mediator adversely affects the performance of the PAWC methodology. Results of a real-data example also support the conclusions.

Suggested Citation

  • Ke-Hai Yuan & Zhiyong Zhang & Lijuan Wang, 2024. "Signal-to-Noise Ratio in Estimating and Testing the Mediation Effect: Structural Equation Modeling versus Path Analysis with Weighted Composites," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 974-1006, September.
  • Handle: RePEc:spr:psycho:v:89:y:2024:i:3:d:10.1007_s11336-024-09975-4
    DOI: 10.1007/s11336-024-09975-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-024-09975-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11336-024-09975-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ke-Hai Yuan & Linda Marshall & Peter Bentler, 2002. "A unified approach to exploratory factor analysis with missing data, nonnormal data, and in the presence of outliers," Psychometrika, Springer;The Psychometric Society, vol. 67(1), pages 95-121, March.
    2. Ke-Hai Yuan & Robert Jennrich, 2000. "Estimating Equations with Nuisance Parameters: Theory and Applications," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 52(2), pages 343-350, June.
    3. Anders Skrondal & Petter Laake, 2001. "Regression among factor scores," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 563-575, December.
    4. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    5. P. Bentler, 1968. "Alpha-maximized factor analysis (alphamax): Its relation to alpha and canonical factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 33(3), pages 335-345, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. W. Holmes Finch, 2024. "Comparison of Methods for Addressing Outliers in Exploratory Factor Analysis and Impact on Accuracy of Determining the Number of Factors," Stats, MDPI, vol. 7(3), pages 1-21, August.
    2. Heijdra Suasnabar, Jan M. & Finch, Aureliano Paolo & Mulhern, Brendan & van den Akker-van Marle, M. Elske, 2024. "Exploring the measurement of health related quality of life and broader instruments: A dimensionality analysis," Social Science & Medicine, Elsevier, vol. 346(C).
    3. Marie-Ann Sengewald & Steffi Pohl, 2019. "Compensation and Amplification of Attenuation Bias in Causal Effect Estimates," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 589-610, June.
    4. Chun Wang & Gongjun Xu & Xue Zhang, 2019. "Correction for Item Response Theory Latent Trait Measurement Error in Linear Mixed Effects Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 673-700, September.
    5. Satoshi Usami, 2023. "Within-Person Variability Score-Based Causal Inference: A Two-Step Estimation for Joint Effects of Time-Varying Treatments," Psychometrika, Springer;The Psychometric Society, vol. 88(4), pages 1466-1494, December.
    6. Walter Peter Vispoel & Hyeryung Lee & Tingting Chen, 2024. "Multivariate Structural Equation Modeling Techniques for Estimating Reliability, Measurement Error, and Subscale Viability When Using Both Composite and Subscale Scores in Practice," Mathematics, MDPI, vol. 12(8), pages 1-25, April.
    7. Elissa Burghgraeve & Jan De Neve & Yves Rosseel, 2021. "Estimating Structural Equation Models Using James–Stein Type Shrinkage Estimators," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 96-130, March.
    8. Sonia Nawrocka & Hans De Witte & Margherita Pasini & Margherita Brondino, 2023. "A Person-Centered Approach to Job Insecurity: Is There a Reciprocal Relationship between the Quantitative and Qualitative Dimensions of Job Insecurity?," IJERPH, MDPI, vol. 20(7), pages 1-27, March.
    9. Md. Mominur Rahman & Bilkis Akhter, 2021. "The impact of investment in human capital on bank performance: evidence from Bangladesh," Future Business Journal, Springer, vol. 7(1), pages 1-13, December.
    10. Masashi Soga & Kevin J. Gaston & Yuichi Yamaura & Kiyo Kurisu & Keisuke Hanaki, 2016. "Both Direct and Vicarious Experiences of Nature Affect Children’s Willingness to Conserve Biodiversity," IJERPH, MDPI, vol. 13(6), pages 1-12, May.
    11. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    12. Gregory Hancock, 2001. "Effect size, power, and sample size determination for structured means modeling and mimic approaches to between-groups hypothesis testing of means on a single latent construct," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 373-388, September.
    13. Nathaniel Oliver Iotti & Damiano Menin & Tomas Jungert, 2022. "Early Adolescents’ Motivations to Defend Victims of Cyberbullying," IJERPH, MDPI, vol. 19(14), pages 1-9, July.
    14. AJ Golio, 2024. "Whose Neighborhood Now? Gentrification and Community Life in Low-Income Urban Neighborhoods," Working Papers 24-29, Center for Economic Studies, U.S. Census Bureau.
    15. Ying Cheng & Ke-Hai Yuan, 2010. "The Impact of Fallible Item Parameter Estimates on Latent Trait Recovery," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 280-291, June.
    16. Peter Tavel & Bibiana Jozefiakova & Peter Telicak & Jana Furstova & Michal Puza & Natalia Kascakova, 2022. "Psychometric Analysis of the Shortened Version of the Spiritual Well-Being Scale on the Slovak Population (SWBS-Sk)," IJERPH, MDPI, vol. 19(1), pages 1-12, January.
    17. Rajdeep Grewal & Murali Chandrashekaran & F. Robert Dwyer, 2008. "Navigating Local Environments with Global Strategies: A Contingency Model of Multinational Subsidiary Performance," Marketing Science, INFORMS, vol. 27(5), pages 886-902, 09-10.
    18. Allen, Jaime & Eboli, Laura & Forciniti, Carmen & Mazzulla, Gabriella & Ortúzar, Juan de Dios, 2019. "The role of critical incidents and involvement in transit satisfaction and loyalty," Transport Policy, Elsevier, vol. 75(C), pages 57-69.
    19. Katharina Groskurth & Constanze Beierlein & Désirée Nießen & Anna Baumert & Beatrice Rammstedt & Clemens M Lechner, 2023. "An English-Language adaptation and validation of the Justice Sensitivity Short Scales–8 (JSS-8)," PLOS ONE, Public Library of Science, vol. 18(11), pages 1-22, November.
    20. Christoph Dworschak, 2024. "Bias mitigation in empirical peace and conflict studies: A short primer on posttreatment variables," Journal of Peace Research, Peace Research Institute Oslo, vol. 61(3), pages 462-476, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:89:y:2024:i:3:d:10.1007_s11336-024-09975-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.