IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v173y2021ics0040162521005758.html
   My bibliography  Save this article

A tailored-fit model evaluation strategy for better decisions about structural equation models

Author

Listed:
  • Mai, Robert
  • Niemand, Thomas
  • Kraus, Sascha

Abstract

Proper measurement of technology knowledge and social change enables managers to advance strategies in technology management. Structural equation modeling is the ideal method in Technological Forecasting and Social Change (TFSC) and other leading journals to assess the measurement quality of the relevant decision variables and understand how they are related. However, a myriad of indicators are now available to judge how suitable these measurements are (i.e., how well they fit). Despite a consensus that fit indicators are highly context-dependent and no “one-fits-all approach” emerges, a more contingent perspective is surprisingly missing. To fill this gap, we advocate for a “tailored-fit model evaluation strategy” that is specific to the situation at hand to exploit the particular strengths of fit indicators. Motivated by a synthesis of structural equation modeling in TFSC, our simulation study finds that three critical distinctions regarding (a) model novelty, (b) focus on measurement or structural models, and (c) sample size are vital. The proposed strategy demonstrates that, in many contexts, only a few indicators are recommended to avoid artificially inflated Type I/II errors. We provide a decision tree to reach more accurate decisions in model evaluation in order to better theorize and forecast technological and social challenges.

Suggested Citation

  • Mai, Robert & Niemand, Thomas & Kraus, Sascha, 2021. "A tailored-fit model evaluation strategy for better decisions about structural equation models," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    • Handle: RePEc:eee:tefoso:v:173:y:2021:i:c:s0040162521005758
    DOI: 10.1016/j.techfore.2021.121142
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162521005758
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techfore.2021.121142?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Corral de Zubielqui, Graciela & Fryges, Helmut & Jones, Janice, 2019. "Social media, open innovation & HRM: Implications for performance," Technological Forecasting and Social Change, Elsevier, vol. 144(C), pages 334-347.
    2. Fotiadis, Anestis K. & Stylos, Nikolaos, 2017. "The effects of online social networking on retail consumer dynamics in the attractions industry: The case of ‘E-da’ theme park, Taiwan," Technological Forecasting and Social Change, Elsevier, vol. 124(C), pages 283-294.
    3. Blohmke, Julian & Kemp, René & Türkeli, Serdar, 2016. "Disentangling the causal structure behind environmental regulation," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 174-190.
    4. Ben Youssef, Adel & Boubaker, Sabri & Dedaj, But & Carabregu-Vokshi, Mjellma, 2021. "Digitalization of the economy and entrepreneurship intention," Technological Forecasting and Social Change, Elsevier, vol. 164(C).
    5. Nadeem, Waqar & Juntunen, Mari & Shirazi, Farid & Hajli, Nick, 2020. "Consumers’ value co-creation in sharing economy: The role of social support, consumers’ ethical perceptions and relationship quality," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    6. Ajzen, Icek, 1991. "The theory of planned behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 50(2), pages 179-211, December.
    7. Sharma, Subhash & Mukherjee, Soumen & Kumar, Ajith & Dillon, William R., 2005. "A simulation study to investigate the use of cutoff values for assessing model fit in covariance structure models," Journal of Business Research, Elsevier, vol. 58(7), pages 935-943, July.
    8. Albert Satorra & Peter Bentler, 2001. "A scaled difference chi-square test statistic for moment structure analysis," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 507-514, December.
    9. Gali, Nazha & Niemand, Thomas & Shaw, Eleanor & Hughes, Mathew & Kraus, Sascha & Brem, Alexander, 2020. "Social entrepreneurship orientation and company success: The mediating role of social performance," Technological Forecasting and Social Change, Elsevier, vol. 160(C).
    10. Ke-Hai Yuan & Yubin Tian & Hirokazu Yanagihara, 2015. "Empirical Correction to the Likelihood Ratio Statistic for Structural Equation Modeling with Many Variables," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 379-405, June.
    11. Barnes, Stuart J. & Mattsson, Jan, 2017. "Understanding collaborative consumption: Test of a theoretical model," Technological Forecasting and Social Change, Elsevier, vol. 118(C), pages 281-292.
    12. Thomas Niemand & Robert Mai, 2018. "Flexible cutoff values for fit indices in the evaluation of structural equation models," Journal of the Academy of Marketing Science, Springer, vol. 46(6), pages 1148-1172, November.
    13. Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
    14. Kraus, Sascha & Rehman, Shafique Ur & García, F. Javier Sendra, 2020. "Corporate social responsibility and environmental performance: The mediating role of environmental strategy and green innovation," Technological Forecasting and Social Change, Elsevier, vol. 160(C).
    15. Anne Boomsma, 1985. "Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation," Psychometrika, Springer;The Psychometric Society, vol. 50(2), pages 229-242, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hang T. T. Nguyen & Hanh Song Thi Pham & Susan Freeman, 2023. "Dynamic capabilities in tourism businesses: antecedents and outcomes," Review of Managerial Science, Springer, vol. 17(5), pages 1645-1680, July.
    2. Biraglia, Alessandro & Bowen, Karen T. & Gerrath, Maximilian H.E.E. & Musarra, Giuseppe, 2022. "How need for closure and deal proneness shape consumers’ freemium versus premium price choices," Journal of Business Research, Elsevier, vol. 143(C), pages 157-170.
    3. Blaž Frešer, 2022. "Multidimensional Model of High-Growth Companies: Do COVID-19 and the Ukraine–Russia Crisis Lead to Differences?," Sustainability, MDPI, vol. 14(22), pages 1-25, November.
    4. Rok Črešnar & Marina Dabić & Nebojša Stojčić & Zlatko Nedelko, 2023. "It takes two to tango: technological and non-technological factors of Industry 4.0 implementation in manufacturing firms," Review of Managerial Science, Springer, vol. 17(3), pages 827-853, April.
    5. Rodolfo Gordillo & María Victoria Del Barrio Gándara & Miguel A. Carrasco, 2022. "Confirmatory Factor Analysis of Comorbidity between Depression and Aggression in a Child-Adolescent Community Sample: Nosological, Prognosis and Etiological Implications," IJERPH, MDPI, vol. 19(8), pages 1-9, April.
    6. Unai Arzubiaga & Alfredo De Massis & Amaia Maseda & Txomin Iturralde, 2023. "The influence of family firm image on access to financial resources in family SMEs: a signaling theory perspective," Review of Managerial Science, Springer, vol. 17(1), pages 233-258, January.
    7. Michelle She Min Ngo & Michael J. Mustafa & Muhammad Mohsin Butt, 2023. "When and why employees take charge in the Workplace: the roles of learning goal orientation, role-breadth self-efficacy and co-worker support," Review of Managerial Science, Springer, vol. 17(5), pages 1681-1702, July.
    8. Vazquez, Erik Ernesto & Patel, Chirag & Alvidrez, Salvador & Siliceo, Lorena, 2023. "Images, reviews, and purchase intention on social commerce: The role of mental imagery vividness, cognitive and affective social presence," Journal of Retailing and Consumer Services, Elsevier, vol. 74(C).
    9. Dabić, Marina & Maley, Jane F. & Črešnar, Rok & Nedelko, Zlatko, 2023. "Unappreciated channel of manufacturing productivity under industry 4.0: Leadership values and capabilities," Journal of Business Research, Elsevier, vol. 162(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Niemand & Robert Mai, 2018. "Flexible cutoff values for fit indices in the evaluation of structural equation models," Journal of the Academy of Marketing Science, Springer, vol. 46(6), pages 1148-1172, November.
    2. Małecka, Agnieszka & Mitręga, Maciej & Mróz-Gorgoń, Barbara & Pfajfar, Gregor, 2022. "Adoption of collaborative consumption as sustainable social innovation: Sociability and novelty seeking perspective," Journal of Business Research, Elsevier, vol. 144(C), pages 163-179.
    3. Pan, Jing Yu & Liu, Dahai, 2022. "Mask-wearing intentions on airplanes during COVID-19 – Application of theory of planned behavior model," Transport Policy, Elsevier, vol. 119(C), pages 32-44.
    4. Chun-Hsi Vivian Chen & Yu-Cheng Chen, 2021. "Assessment of Enhancing Employee Engagement in Energy-Saving Behavior at Workplace: An Empirical Study," Sustainability, MDPI, vol. 13(5), pages 1-18, February.
    5. Joan Torrent-Sellens & Cristian Salazar-Concha & Pilar Ficapal-Cusí & Francesc Saigí-Rubió, 2021. "Using Digital Platforms to Promote Blood Donation: Motivational and Preliminary Evidence from Latin America and Spain," IJERPH, MDPI, vol. 18(8), pages 1-17, April.
    6. Mainardes, Emerson Wagner & Coutinho, Ananda Raquel Silva & Alves, Helena Maria Batista, 2023. "The influence of the ethics of E-retailers on online customer experience and customer satisfaction," Journal of Retailing and Consumer Services, Elsevier, vol. 70(C).
    7. Činjarević Merima & Kožo Amra & Berberović Denis, 2019. "Sharing is Caring, and Millennials Do Care: Collaborative Consumption through the Eyes of Internet Generation," South East European Journal of Economics and Business, Sciendo, vol. 14(1), pages 49-60, June.
    8. Moshe Zeidner & Gerald Matthews & Dorit Olenik Shemesh, 2016. "Cognitive-Social Sources of Wellbeing: Differentiating the Roles of Coping Style, Social Support and Emotional Intelligence," Journal of Happiness Studies, Springer, vol. 17(6), pages 2481-2501, December.
    9. Nguyen, Minh-Hoang, 2023. "Investigating urban residents' involvement in biodiversity conservation in protected areas: Empirical evidence from Vietnam," Thesis Commons z2hjv, Center for Open Science.
    10. Park, Seong-Hee & Mahony, Daniel F. & Kim, Yukyoum & Kim, Young Do, 2015. "Curiosity generating advertisements and their impact on sport consumer behavior," Sport Management Review, Elsevier, vol. 18(3), pages 359-369.
    11. Eisenbeiss, Maik & Blechschmidt, Boris & Backhaus, Klaus & Freund, Philipp Alexander, 2012. "“The (Real) World Is Not Enough:” Motivational Drivers and User Behavior in Virtual Worlds," Journal of Interactive Marketing, Elsevier, vol. 26(1), pages 4-20.
    12. Mykolas Simas Poškus & Audra Balundė & Lina Jovarauskaitė & Goda Kaniušonytė & Rita Žukauskienė, 2021. "The Effect of Potentially Groundwater-Contaminating Ecological Disaster on Adolescents’ Bottled Water Consumption and Perceived Risk to Use Tap Water," Sustainability, MDPI, vol. 13(11), pages 1-17, May.
    13. Susanne Stoll-Kleemann & Philipp Franikowski & Susanne Nicolai, 2023. "Development and Validation of a Scale to Assess Moral Disengagement in High-Carbon Behavior," Sustainability, MDPI, vol. 15(3), pages 1-23, January.
    14. Anil Khurana & V. V. Ravi Kumar & Manish Sidhpuria, 2020. "A Study on the Adoption of Electric Vehicles in India: The Mediating Role of Attitude," Vision, , vol. 24(1), pages 23-34, March.
    15. Jan-Benedict E. M. Steenkamp & Alberto Maydeu-Olivares, 2023. "Unrestricted factor analysis: A powerful alternative to confirmatory factor analysis," Journal of the Academy of Marketing Science, Springer, vol. 51(1), pages 86-113, January.
    16. Moody, Joanna & Zhao, Jinhua, 2019. "Car pride and its bidirectional relations with car ownership: Case studies in New York City and Houston," Transportation Research Part A: Policy and Practice, Elsevier, vol. 124(C), pages 334-353.
    17. Anne Bäro & Felix Toepler & Timo Meynhardt & Vivek K. Velamuri, 2022. "Participating in the sharing economy: The role of individual characteristics," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(8), pages 3715-3735, December.
    18. Dabbous, Amal & Tarhini, Abbas, 2019. "Assessing the impact of knowledge and perceived economic benefits on sustainable consumption through the sharing economy: A sociotechnical approach," Technological Forecasting and Social Change, Elsevier, vol. 149(C).
    19. Liang, Jyun-Kai & Eccarius, Timo & Lu, Chung-Cheng, 2019. "Investigating factors that affect the intention to use shared parking: A case study of Taipei City," Transportation Research Part A: Policy and Practice, Elsevier, vol. 130(C), pages 799-812.
    20. Zhaohui Yang & Krishna P. Paudel & Xiaowei Wen & Sangluo Sun & Yong Wang, 2020. "Food Safety Risk Information-Seeking Intention of WeChat Users in China," IJERPH, MDPI, vol. 17(7), pages 1-15, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:173:y:2021:i:c:s0040162521005758. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.