IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v178y2025i1d10.1007_s11205-025-03584-z.html
   My bibliography  Save this article

Detecting Causal Relations Among Indicators with the CTA Test: Simulations and Applications

Author

Listed:
  • Mattia Cefis

    (University of Brescia)

  • Mario Angelelli

    (University of Salento and CAMPI)

  • Maurizio Carpita

    (University of Brescia)

  • Enrico Ciavolino

    (University of Salento and CAMPI)

Abstract

In the context of using structural equation modelling to develop economic and social indicators, a debate regarding the choice of measurement modes for theoretical constructs is becoming a very important issue, with conceptual and practical implications. The nature of each construct, which can be defined as reflective or formative, is mainly based on theoretical considerations, but confirmatory tetrad analysis (CTA) can support decisions about the model specification. One flexible approach to carrying out CTA involves multiple hypothesis testing, which also provides relevant information on empirical data to guide the construction of composite indicators. This prompts a deeper investigation of the effects of correction methods on decisions derived from tests, with special attention to error control and statistical power. In this study, we explore the properties of six procedures, in particular the well-known Bonferroni and Benjamini–Hochberg corrections, using various simulation scenarios and real applications. We find that, with respect to the Benjamini–Hochberg, the Bonferroni correction is too conservative and has lower power, especially with small sample sizes and many manifest variables.

Suggested Citation

  • Mattia Cefis & Mario Angelelli & Maurizio Carpita & Enrico Ciavolino, 2025. "Detecting Causal Relations Among Indicators with the CTA Test: Simulations and Applications," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 178(1), pages 393-417, May.
    • Handle: RePEc:spr:soinre:v:178:y:2025:i:1:d:10.1007_s11205-025-03584-z
    DOI: 10.1007/s11205-025-03584-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-025-03584-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-025-03584-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Hair, Joe F. & Howard, Matt C. & Nitzl, Christian, 2020. "Assessing measurement model quality in PLS-SEM using confirmatory composite analysis," Journal of Business Research, Elsevier, vol. 109(C), pages 101-110.
    2. Julio César Puche-Regaliza & Santiago Porras-Alfonso & Alfredo Jiménez & Santiago Aparicio-Castillo & Pablo Arranz-Val, 2021. "Exploring determinants of public satisfaction with urban solid waste collection services quality," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(7), pages 9927-9948, July.
    3. Diamantopoulos, Adamantios & Riefler, Petra & Roth, Katharina P., 2008. "Advancing formative measurement models," Journal of Business Research, Elsevier, vol. 61(12), pages 1203-1218, December.
    4. Coltman, Tim & Devinney, Timothy M. & Midgley, David F. & Venaik, Sunil, 2008. "Formative versus reflective measurement models: Two applications of formative measurement," Journal of Business Research, Elsevier, vol. 61(12), pages 1250-1262, December.
    5. Enrico Ciavolino & Massimo Aria & Jun-Hwa Cheah & José Luis Roldán, 2022. "A tale of PLS Structural Equation Modelling: Episode I— A Bibliometrix Citation Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 164(3), pages 1323-1348, December.
    6. Gudergan, Siegfried P. & Ringle, Christian M. & Wende, Sven & Will, Alexander, 2008. "Confirmatory tetrad analysis in PLS path modeling," Journal of Business Research, Elsevier, vol. 61(12), pages 1238-1249, December.
    7. Jun-Hwa Cheah & Hiram Ting & T. Ramayah & Mumtaz Ali Memon & Tat-Huei Cham & Enrico Ciavolino, 2019. "A comparison of five reflective–formative estimation approaches: reconsideration and recommendations for tourism research," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(3), pages 1421-1458, May.
    8. Enrico Ciavolino & Maurizio Carpita & Mariangela Nitti, 2015. "High-order PLS path model with qualitative external information," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(4), pages 1609-1620, July.
    9. Sarstedt, Marko & Hair, Joseph F. & Ringle, Christian M. & Thiele, Kai O. & Gudergan, Siegfried P., 2016. "Estimation issues with PLS and CBSEM: Where the bias lies!," Journal of Business Research, Elsevier, vol. 69(10), pages 3998-4010.
    10. Joe, Harry, 2006. "Generating random correlation matrices based on partial correlations," Journal of Multivariate Analysis, Elsevier, vol. 97(10), pages 2177-2189, November.
    11. Danks, Nicholas P. & Sharma, Pratyush N. & Sarstedt, Marko, 2020. "Model selection uncertainty and multimodel inference in partial least squares structural equation modeling (PLS-SEM)," Journal of Business Research, Elsevier, vol. 113(C), pages 13-24.
    12. Svenja Damberg & Manfred Schwaiger & Christian M. Ringle, 2022. "What’s important for relationship management? The mediating roles of relational trust and satisfaction for loyalty of cooperative banks’ customers," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(1), pages 3-18, March.
    13. Carlo Cavicchia & Maurizio Vichi, 2021. "Statistical Model-Based Composite Indicators for Tracking Coherent Policy Conclusions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(2), pages 449-479, August.
    14. Chang, Woojung & Franke, George R. & Lee, Nick, 2016. "Comparing reflective and formative measures: New insights from relevant simulations," Journal of Business Research, Elsevier, vol. 69(8), pages 3177-3185.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mattia Cefis & Maurizio Carpita, 2025. "On the CTA-PLS test for hierarchical models: an application to the football player’s performance," Computational Statistics, Springer, vol. 40(4), pages 2135-2155, April.
    2. Enrico Ciavolino & Massimo Aria & Jun-Hwa Cheah & José Luis Roldán, 2022. "A tale of PLS Structural Equation Modelling: Episode I— A Bibliometrix Citation Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 164(3), pages 1323-1348, December.
    3. Jun-Hwa Cheah & Hiram Ting & T. Ramayah & Mumtaz Ali Memon & Tat-Huei Cham & Enrico Ciavolino, 2019. "A comparison of five reflective–formative estimation approaches: reconsideration and recommendations for tourism research," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(3), pages 1421-1458, May.
    4. Paola Pasca & Evelyn Simone & Enrico Ciavolino & Alessia Rochira & Terri Mannarini, 2023. "A higher-order model of community resilience potential: development and assessment through confirmatory composite analysis based on partial least squares," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(2), pages 1033-1054, April.
    5. Corrado Crocetta & Laura Antonucci & Rosanna Cataldo & Roberto Galasso & Maria Gabriella Grassia & Carlo Natale Lauro & Marina Marino, 2021. "Higher-Order PLS-PM Approach for Different Types of Constructs," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 154(2), pages 725-754, April.
    6. Kumar, Sachin & Kumar, Vinod & Chaudhuri, Ranjan & Chatterjee, Sheshadri & Vrontis, Demetris, 2025. "AI capability and environmental sustainability performance: Moderating role of green knowledge management," Technology in Society, Elsevier, vol. 81(C).
    7. Zhuomin Shi & Zaoying Kuang & Ning Yang, 2017. "Why it is hard to explain Chinese face?—FACE measurement models and its influence on ecological product preference," Frontiers of Business Research in China, Springer, vol. 11(1), pages 1-22, December.
    8. Baxter, Roger, 2009. "Reflective and formative metrics of relationship value: A commentary essay," Journal of Business Research, Elsevier, vol. 62(12), pages 1370-1377, December.
    9. Maurizio Carpita & Paola Pasca & Serena Arima & Enrico Ciavolino, 2023. "Clustering of variables methods and measurement models for soccer players’ performances," Annals of Operations Research, Springer, vol. 325(1), pages 37-56, June.
    10. Diogo Lima & Ricardo F. Ramos & Pedro Miguel Oliveira, 2024. "Customer satisfaction in the pet food subscription-based online services," Electronic Commerce Research, Springer, vol. 24(2), pages 745-769, June.
    11. Nauman Majeed & Samia Jamshed, 2023. "Heightening citizenship behaviours of academicians through transformational leadership: Evidence based interventions," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(4), pages 575-606, December.
    12. Ji, Elena & Mahmudur Rahman, Syed & Wilden, Ralf & Lin, Nidthida & Harrison, Norma, 2024. "Leveraging customer knowledge obtained through social media: The roles of R&D intensity and absorptive capacity," Journal of Business Research, Elsevier, vol. 182(C).
    13. Sarstedt, Marko & Wilczynski, Petra & Melewar, T.C., 2013. "Measuring reputation in global markets—A comparison of reputation measures’ convergent and criterion validities," Journal of World Business, Elsevier, vol. 48(3), pages 329-339.
    14. Azad Moghddam, Hamed & Carlson, Jamie & Wyllie, Jessica & Mahmudur Rahman, Syed, 2024. "Scroll, Stop, Shop: Decoding impulsive buying in social commerce," Journal of Business Research, Elsevier, vol. 182(C).
    15. Sarstedt, Marko & Hair, Joseph F. & Ringle, Christian M. & Thiele, Kai O. & Gudergan, Siegfried P., 2016. "Estimation issues with PLS and CBSEM: Where the bias lies!," Journal of Business Research, Elsevier, vol. 69(10), pages 3998-4010.
    16. Manzi-Puertas, Mario A. & Agirre-Aramburu, Izaskun & López-Pérez, Sain, 2024. "Navigating the student entrepreneurial journey: Dynamics and interplay of resourceful and innovative behavior," Journal of Business Research, Elsevier, vol. 174(C).
    17. Basco, Rodrigo & Hair, Joseph F. & Ringle, Christian M. & Sarstedt, Marko, 2022. "Advancing family business research through modeling nonlinear relationships: Comparing PLS-SEM and multiple regression," Journal of Family Business Strategy, Elsevier, vol. 13(3).
    18. Rocsana Bucea-Manea-Țoniş & Oliva M. D. Martins & Radu Bucea-Manea-Țoniş & Cătălin Gheorghiță & Valentin Kuleto & Milena P. Ilić & Violeta-Elena Simion, 2021. "Blockchain Technology Enhances Sustainable Higher Education," Sustainability, MDPI, vol. 13(22), pages 1-21, November.
    19. Rahman, Syed Mahmudur & Chowdhury, Noman H. & Bowden, Jana Lay-Hwa & Carlson, Jamie, 2025. "Metaverse platform attributes and customer experience measurement," Journal of Retailing and Consumer Services, Elsevier, vol. 83(C).
    20. Cantone, Giulio Giacomo & Tomaselli, Venera, 2024. "On the Coherence of Composite Indexes: Multiversal Model and Specification Analysis for an Index of Well-Being," MetaArXiv d5y26, Center for Open Science.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:178:y:2025:i:1:d:10.1007_s11205-025-03584-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.