IDEAS home Printed from https://ideas.repec.org/a/ers/journl/vxxviiy2024ispecialap694-711.html
   My bibliography  Save this article

Identification of Trust Determinants in LLM Technology Using the DEMATEL Method

Author

Listed:
  • Marta Pawlowska-Nowak

Abstract

Purpose: The study identifies determinants of trust in Large Language Model (LLM) technology among office employees using the DEMATEL method. It addresses a gap in understanding factors like credibility, user experience, and data security, which are crucial for AI adoption in workplaces. Design/Methodology/Approach: The study employs a mixed-method approach, combining a literature review and empirical analysis using the DEMATEL method. The DEMATEL method was applied to develop causal-effect diagrams, identify prominence and relation indicators, and calculate the importance of individual factors. The methodology was chosen for its suitability in analyzing complex, interrelated variables. Findings: The research identified the most significant determinants of trust in LLM technology. Key findings highlight that perceived credibility and accuracy of responses, prior experience with AI, and awareness of productivity impacts are the most influential factors. Additionally, user education, intuitive user interfaces, and robust data security were identified as crucial for building trust. These factors underscore the importance of transparency, usability, and reliability in fostering employee confidence in LLM technology. Practical Implications: Organizations can enhance LLM adoption by ensuring credible outputs, providing training, and addressing data security. The results support trust-building strategies for sectors dependent on AI decision-making. Originality/Value: This study offers a novel application of the DEMATEL method to trust in LLMs, providing insights into workplace AI adoption and expanding understanding of trust-building mechanisms.

Suggested Citation

  • Marta Pawlowska-Nowak, 2024. "Identification of Trust Determinants in LLM Technology Using the DEMATEL Method," European Research Studies Journal, European Research Studies Journal, vol. 0(Special A), pages 694-711.
  • Handle: RePEc:ers:journl:v:xxvii:y:2024:i:speciala:p:694-711
    as

    Download full text from publisher

    File URL: https://ersj.eu/journal/3744/download
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tyna Eloundou & Sam Manning & Pamela Mishkin & Daniel Rock, 2023. "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models," Papers 2303.10130, arXiv.org, revised Aug 2023.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    2. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 28 Apr 2025.
    3. Naomi Hausman & Oren Rigbi & Sarit Weisburd, 2025. "Generative AI’s Impact on Student Achievement and Implications for Worker Productivity," CESifo Working Paper Series 11843, CESifo.
    4. Evangelos Katsamakas & Oleg V. Pavlov & Ryan Saklad, 2024. "Artificial intelligence and the transformation of higher education institutions," Papers 2402.08143, arXiv.org.
    5. Draca, Mirko & Nathan, Max & Nguyen-Tien, Viet & Oliveira-Cunha, Juliana & Rosso, Anna & Valero, Anna, 2024. "The New Wave? The Role of Human Capital and STEM Skills in Technology Adoption in the UK," The Warwick Economics Research Paper Series (TWERPS) 1521, University of Warwick, Department of Economics.
    6. Berlinski, Elise & Morales, Jérémy & Sponem, Samuel, 2024. "Artificial imaginaries: Generative AIs as an advanced form of capitalism," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 99(C).
    7. Caleb Peppiatt, 2024. "The Future of Work: Inequality, Artificial Intelligence, and What Can Be Done About It. A Literature Review," Papers 2408.13300, arXiv.org.
    8. D'Al, Francesco & Santarelli, Enrico & Vivarelli, Marco, 2024. "The KSTE+I approach and the advent of AI technologies: evidence from the European regions," GLO Discussion Paper Series 1473, Global Labor Organization (GLO).
    9. Amali Matharaarachchi & Wishmitha Mendis & Kanishka Randunu & Daswin De Silva & Gihan Gamage & Harsha Moraliyage & Nishan Mills & Andrew Jennings, 2024. "Optimizing Generative AI Chatbots for Net-Zero Emissions Energy Internet-of-Things Infrastructure," Energies, MDPI, vol. 17(8), pages 1-19, April.
    10. Anna Davies & Betsy Donald & Mia Gray, 2023. "The power of platforms—precarity and place," Cambridge Journal of Regions, Economy and Society, Cambridge Political Economy Society, vol. 16(2), pages 245-256.
    11. Ege Erdil & Andrei Potlogea & Tamay Besiroglu & Edu Roldan & Anson Ho & Jaime Sevilla & Matthew Barnett & Matej Vrzla & Robert Sandler, 2025. "GATE: An Integrated Assessment Model for AI Automation," Papers 2503.04941, arXiv.org, revised Mar 2025.
    12. Huseynov, Samir, 2025. "ChatGPT and the labor market: Unraveling the effect of AI discussions on students’ earning expectations," Journal of Economic Psychology, Elsevier, vol. 108(C).
    13. Christian Peukert & Florian Abeillon & Jérémie Haese & Franziska Kaiser & Alexander Staub, 2024. "Strategic Behavior and AI Training Data," CESifo Working Paper Series 11099, CESifo.
    14. Evelyn Vezza & Zunino,Gonzalo & Laguinge,Luis & Harry Edmund Moroz & Ignacio Raul Apella & Marla Hillary Spivack, 2025. "Understanding Labor Market Demand in Real Time in Argentina and Uruguay," Policy Research Working Paper Series 11086, The World Bank.
    15. Luca Fontanelli & Mattia Guerini & Raffaele Miniaci & Angelo Secchi, 2025. "Predictive AI and productivity growth dynamics: evidence from French firms," Working Papers 2025.11, Fondazione Eni Enrico Mattei.
    16. Francesco D'Alessandro & Enrico Santarelli & Marco Vivarelli, 2024. "The KSTE+I approach and the AI technologies," DISCE - Working Papers del Dipartimento di Politica Economica dipe0039, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    17. Thomas Cantens, 2023. "How will the State think with the assistance of ChatGPT? The case of customs as an example of generative artificial intelligence in public administrations," CERDI Working papers hal-04233370, HAL.
    18. Avi Goldfarb, 2024. "Pause artificial intelligence research? Understanding AI policy challenges," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 57(2), pages 363-377, May.
    19. Anil R. Doshi & Oliver P. Hauser, 2023. "Generative artificial intelligence enhances creativity but reduces the diversity of novel content," Papers 2312.00506, arXiv.org, revised Mar 2024.
    20. James Bono & Alec Xu, 2024. "Randomized Controlled Trials for Security Copilot for IT Administrators," Papers 2411.01067, arXiv.org, revised Nov 2024.

    More about this item

    Keywords

    Trust in Technology; Large Language Models; DEMATEL.;
    All these keywords.

    JEL classification:

    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • M15 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - IT Management

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ers:journl:v:xxvii:y:2024:i:speciala:p:694-711. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marios Agiomavritis (email available below). General contact details of provider: https://ersj.eu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.