IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v140y2018i3d10.1007_s11205-017-1799-6.html
   My bibliography  Save this article

Examining Measurement Isomorphism of Multilevel Constructs: The Case of Political Trust

Author

Listed:
  • Anna Ruelens

    (University of Leuven)

  • Bart Meuleman

    (University of Leuven)

  • Ides Nicaise

    (University of Leuven)

Abstract

There is a growing recognition of the importance of testing for measurement equivalence when comparing latent constructs—such as political trust—across countries and over time. Indeed, equivalence of measurements across countries and time points is a precondition for making meaningful and valid comparisons of means, scores, and relationships between constructs. Until recently, most efforts in this area of comparative research have focused on establishing measurement equivalence across groups, such as countries or cultural regions. In contrast, scarce attention has been paid to examining the measurement equivalence of constructs across levels of data. Rather, most empirical studies that use cross-national survey data assume that the factorial structure of a given construct is isomorphic, in other words, similar in measurement and meaning at the individual and country level. This assumption is not always justified, as the dimensions found at the individual level of data do not always generalize to the country level. In such cases, the results and substantive conclusions based on the assumption of measurement isomorphism may be misleading. In this article, we emphasize the importance of examining measurement isomorphism when working with cross-national survey data and describe a testing procedure using multilevel confirmatory factor analysis. We illustrate the procedure by examining cross-level equivalence of the political trust scale included in the European Social Survey (2008–2009). The results of the analysis indicate that the structure of political trust factor can be considered configurally isomorphic across individual and country levels. In addition, the measurement scale across the two levels is found to be partially isomorphic. These findings could be regarded as an encouraging result for the applied researchers who use the aggregated individual scores of political trust. At the same time, we demonstrate that measurement isomorphism cannot be simply assumed and hence should be examined prior to analysis to ensure valid and meaningful results.

Suggested Citation

  • Anna Ruelens & Bart Meuleman & Ides Nicaise, 2018. "Examining Measurement Isomorphism of Multilevel Constructs: The Case of Political Trust," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 140(3), pages 907-927, December.
  • Handle: RePEc:spr:soinre:v:140:y:2018:i:3:d:10.1007_s11205-017-1799-6
    DOI: 10.1007/s11205-017-1799-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-017-1799-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11205-017-1799-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Daniel Stegmueller, 2013. "How Many Countries for Multilevel Modeling? A Comparison of Frequentist and Bayesian Approaches," American Journal of Political Science, John Wiley & Sons, vol. 57(3), pages 748-761, July.
    2. Sedef Turper & Kees Aarts, 2017. "Political Trust and Sophistication: Taking Measurement Seriously," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 130(1), pages 415-434, January.
    3. Harvey Goldstein & Roderick McDonald, 1988. "A general model for the analysis of multilevel data," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 455-467, December.
    4. Michael W. Browne & Robert Cudeck, 1992. "Alternative Ways of Assessing Model Fit," Sociological Methods & Research, , vol. 21(2), pages 230-258, November.
    5. Kenneth A. Bollen, 1989. "A New Incremental Fit Index for General Structural Equation Models," Sociological Methods & Research, , vol. 17(3), pages 303-316, February.
    6. Steenkamp, Jan-Benedict E M & Baumgartner, Hans, 1998. "Assessing Measurement Invariance in Cross-National Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(1), pages 78-90, June.
    7. William Meredith, 1993. "Measurement invariance, factor analysis and factorial invariance," Psychometrika, Springer;The Psychometric Society, vol. 58(4), pages 525-543, December.
    8. Sibylle Puntscher & Christoph Hauser & Janette Walde & Gottfried Tappeiner, 2016. "Measuring Social Capital with Aggregated Indicators: A Case of Ecological Fallacy?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 125(2), pages 431-449, January.
    9. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "Generalized multilevel structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 167-190, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. T. W. G. Meer & E. Ouattara, 2019. "Putting ‘political’ back in political trust: an IRT test of the unidimensionality and cross-national equivalence of political trust measures," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(6), pages 2983-3002, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven Andrew Culpepper & Herman Aguinis & Justin L. Kern & Roger Millsap, 2019. "High-Stakes Testing Case Study: A Latent Variable Approach for Assessing Measurement and Prediction Invariance," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 285-309, March.
    2. Jun Hong Park & Sang Ho Kook & Hyeonu Im & Soomin Eum & Chulung Lee, 2018. "Fabless Semiconductor Firms’ Financial Performance Determinant Factors: Product Platform Efficiency and Technological Capability," Sustainability, MDPI, vol. 10(10), pages 1-22, September.
    3. Janina Isabel Steinert & Lucie Dale Cluver & G. J. Melendez-Torres & Sebastian Vollmer, 2018. "One Size Fits All? The Validity of a Composite Poverty Index Across Urban and Rural Households in South Africa," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(1), pages 51-72, February.
    4. Luis Guirola & Gonzalo Rivero, 2022. "Polarization contaminates the link with partisan and independent institutions: evidence from 138 cabinet shifts," Working Papers 2237, Banco de España.
    5. Ankica Kosic & Tamara Džamonja Ignjatović & Nebojša Petrović, 2021. "A Cross-Cultural Study of Distress during COVID-19 Pandemic: Some Protective and Risk Factors," IJERPH, MDPI, vol. 18(14), pages 1-15, July.
    6. Hofmans, J. & Pepermans, R. & Loix, E., 2009. "Measurement invariance matters: A case made for the ORTOFIN," Journal of Economic Psychology, Elsevier, vol. 30(4), pages 667-674, August.
    7. T. W. G. Meer & E. Ouattara, 2019. "Putting ‘political’ back in political trust: an IRT test of the unidimensionality and cross-national equivalence of political trust measures," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(6), pages 2983-3002, November.
    8. Eldad Davidov & Stefan Thörner & Peter Schmidt & Stefanie Gosen & Carina Wolf, 2011. "Level and change of group-focused enmity in Germany: unconditional and conditional latent growth curve models with four panel waves," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(4), pages 481-500, December.
    9. P. Couper, Mick & Cernat, Alexandru & Beth Ofstedal, Mary, 2015. "Estimation of mode effects in the Health and Retirement Study using measurement models," ISER Working Paper Series 2015-19, Institute for Social and Economic Research.
    10. Eunju Jung & Yongjin Lee, 2020. "College Students’ Entrepreneurial Mindset: Educational Experiences Override Gender and Major," Sustainability, MDPI, vol. 12(19), pages 1-28, October.
    11. Carlos Miguel Lemos & Ross Joseph Gore & Ivan Puga-Gonzalez & F LeRon Shults, 2019. "Dimensionality and factorial invariance of religiosity among Christians and the religiously unaffiliated: A cross-cultural analysis based on the International Social Survey Programme," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-36, May.
    12. Eva Padrosa & Mireia Bolíbar & Mireia Julià & Joan Benach, 2021. "Comparing Precarious Employment Across Countries: Measurement Invariance of the Employment Precariousness Scale for Europe (EPRES-E)," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 154(3), pages 893-915, April.
    13. Willem E. Saris & André Pirralha & Diana Zavala-Rojas, 2018. "Testing the Comparability of Different Types of Social Indicators Across Groups," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(3), pages 927-939, February.
    14. Francesca Chiesi & Andrea Bonacchi & Chloe Lau & Anna Enrica Tosti & Fabio Marra & Donald H Saklofske, 2020. "Measuring self-control across gender, age, language, and clinical status: A validation study of the Italian version of the Brief Self- Control Scale (BSCS)," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-19, August.
    15. Yoo, Boonghee & Donthu, Naveen, 2001. "Developing and validating a multidimensional consumer-based brand equity scale," Journal of Business Research, Elsevier, vol. 52(1), pages 1-14, April.
    16. Chao C. Chen & Joseph P. Gaspar & Ray Friedman & William Newburry & Michael C. Nippa & Katherine Xin & Ronaldo Parente, 2017. "Paradoxical Relationships Between Cultural Norms of Particularism and Attitudes Toward Relational Favoritism: A Cultural Reflectivity Perspective," Journal of Business Ethics, Springer, vol. 145(1), pages 63-79, September.
    17. Gianmaria Bottoni, 2018. "A Multilevel Measurement Model of Social Cohesion," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 835-857, April.
    18. Dmitriy Poznyak & Bart Meuleman & Koen Abts & George Bishop, 2014. "Trust in American Government: Longitudinal Measurement Equivalence in the ANES, 1964–2008," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 118(2), pages 741-758, September.
    19. Claudia Marino & C. M. Hirst & C. Murray & A. Vieno & Marcantonio M. Spada, 2018. "Positive Mental Health as a Predictor of Problematic Internet and Facebook Use in Adolescents and Young Adults," Journal of Happiness Studies, Springer, vol. 19(7), pages 2009-2022, October.
    20. Mariola Laguna & Karolina Walachowska & Marjan J. Gorgievski-Duijvesteijn & Juan A. Moriano, 2019. "Authentic Leadership and Employees’ Innovative Behaviour: A Multilevel Investigation in Three Countries," IJERPH, MDPI, vol. 16(21), pages 1-17, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:140:y:2018:i:3:d:10.1007_s11205-017-1799-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.