IDEAS home Printed from https://ideas.repec.org/a/spr/binfse/v67y2025i1d10.1007_s12599-024-00914-2.html
   My bibliography  Save this article

Elevating Developers’ Accountability Awareness in AI Systems Development

Author

Listed:
  • Jan-Hendrik Schmidt

    (Technical University of Darmstadt)

  • Sebastian Clemens Bartsch

    (Technical University of Darmstadt)

  • Martin Adam

    (University of Goettingen)

  • Alexander Benlian

    (Technical University of Darmstadt)

Abstract

The increasing proliferation of artificial intelligence (AI) systems presents new challenges for the future of information systems (IS) development, especially in terms of holding stakeholders accountable for the development and impacts of AI systems. However, current governance tools and methods in IS development, such as AI principles or audits, are often criticized for their ineffectiveness in influencing AI developers’ attitudes and perceptions. Drawing on construal level theory and Toulmin’s model of argumentation, this paper employed a sequential mixed method approach to integrate insights from a randomized online experiment (Study 1) and qualitative interviews (Study 2). This combined approach helped us investigate how different types of accountability arguments affect AI developers’ accountability perceptions. In the online experiment, process accountability arguments were found to be more effective than outcome accountability arguments in enhancing AI developers’ perceived accountability. However, when supported by evidence, both types of accountability arguments prove to be similarly effective. The qualitative study corroborates and complements the quantitative study’s conclusions, revealing that process and outcome accountability emerge as distinct theoretical constructs in AI systems development. The interviews also highlight critical organizational and individual boundary conditions that shape how AI developers perceive their accountability. Together, the results contribute to IS research on algorithmic accountability and IS development by revealing the distinct nature of process and outcome accountability while demonstrating the effectiveness of tailored arguments as governance tools and methods in AI systems development.

Suggested Citation

  • Jan-Hendrik Schmidt & Sebastian Clemens Bartsch & Martin Adam & Alexander Benlian, 2025. "Elevating Developers’ Accountability Awareness in AI Systems Development," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 67(1), pages 109-135, February.
    • Handle: RePEc:spr:binfse:v:67:y:2025:i:1:d:10.1007_s12599-024-00914-2
    DOI: 10.1007/s12599-024-00914-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12599-024-00914-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12599-024-00914-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dongmin Kim & Izak Benbasat, 2006. "The Effects of Trust-Assuring Arguments on Consumer Trust in Internet Stores: Application of Toulmin's Model of Argumentation," Information Systems Research, INFORMS, vol. 17(3), pages 286-300, September.
    2. Benlian, Alexander & Klumpe, Johannes & Hinz, Oliver, 2020. "Mitigating the Intrusive Effects of Smart Home Assistants by using Anthropomorphic Design Features: A Multi-Method Investigation," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 112151, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    3. Adam, Martin, 2022. "Accountability-Based User Interface Design Artifacts and Their Implications for User Acceptance of AI-Enabled Services," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 132670, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    4. John Mingers, 2001. "Combining IS Research Methods: Towards a Pluralist Methodology," Information Systems Research, INFORMS, vol. 12(3), pages 240-259, September.
    5. Matus, Kira & Veale, Michael, 2022. "Certification Systems for Machine Learning: Lessons from Sustainability," SocArXiv pm3wy_v1, Center for Open Science.
    6. Benlian, Alexander, 2015. "Web Personalization Cues and their Differential Effects on User Assessments of Website Value," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 74450, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    7. Sturm, Timo & Gerlach, Jin & Pumplun, Luisa & Mesbah, Neda & Peters, Felix & Tauchert, Christoph & Nan, Ning & Buxmann, Peter, 2021. "Coordinating Human and Machine Learning for Effective Organizational Learning," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 125653, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    8. Zsófia Tóth & Robert Caruana & Thorsten Gruber & Claudia Loebbecke, 2022. "The Dawn of the AI Robots: Towards a New Framework of AI Robot Accountability," Journal of Business Ethics, Springer, vol. 178(4), pages 895-916, July.
    9. Kira J.M. Matus & Michael Veale, 2022. "Certification systems for machine learning: Lessons from sustainability," Regulation & Governance, John Wiley & Sons, vol. 16(1), pages 177-196, January.
    10. L'industria, 2023. "Call for papers," L'industria, Società editrice il Mulino, issue 1, pages 185-198.
    11. Likoebe M. Maruping & Sabine Matook, 2020. "The evolution of software development orchestration: current state and an agenda for future research," European Journal of Information Systems, Taylor & Francis Journals, vol. 29(5), pages 443-457, September.
    12. Paul Benjamin Lowry & Greg Moody & Anthony Vance & Matthew Jensen & Jeff Jenkins & Taylor Wells, 2012. "Using an elaboration likelihood approach to better understand the persuasiveness of website privacy assurance cues for online consumers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(4), pages 755-776, April.
    13. Sheen S. Levine & Oliver Schilke & Olenka Kacperczyk & Lynne G. Zucker, 2023. "Primer for Experimental Methods in Organization Theory," Organization Science, INFORMS, vol. 34(6), pages 1997-2025, November.
    14. Paul Benjamin Lowry & Greg Moody & Anthony Vance & Matthew Jensen & Jeff Jenkins & Taylor Wells, 2012. "Using an elaboration likelihood approach to better understand the persuasiveness of website privacy assurance cues for online consumers," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(4), pages 755-776, April.
    15. Adela Río Ortega & Iris Beerepoot & Han Aa & Joerg Evermann, 2023. "Call for Papers, Issue 3/2025," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(5), pages 613-614, October.
    16. Christoph Rosenkranz & Viktoria Stray & Manuel Wiesche, 2023. "Call for Papers, Issue 1/2025," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(4), pages 483-486, August.
    17. Kieran Conboy, 2009. "Agility from First Principles: Reconstructing the Concept of Agility in Information Systems Development," Information Systems Research, INFORMS, vol. 20(3), pages 329-354, September.
    18. Paolacci, Gabriele & Chandler, Jesse & Ipeirotis, Panagiotis G., 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Cambridge University Press, vol. 5(5), pages 411-419, August.
    19. Nils Urbach & Frederik Ahlemann & Tilo Böhmann & Paul Drews & Walter Brenner & Florian Schaudel & Reinhard Schütte, 2019. "The Impact of Digitalization on the IT Department," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(1), pages 123-131, February.
    20. Marcus Keutel & Bjoern Michalik & Janek Richter, 2014. "Towards mindful case study research in IS: a critical analysis of the past ten years," European Journal of Information Systems, Taylor & Francis Journals, vol. 23(3), pages 256-272, May.
    21. Collins, Christopher & Dennehy, Denis & Conboy, Kieran & Mikalef, Patrick, 2021. "Artificial intelligence in information systems research: A systematic literature review and research agenda," International Journal of Information Management, Elsevier, vol. 60(C).
    22. Benlian, Alexander, 2015. "Web Personalization Cues and their Differential Effects on User Assessments of Website Value," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 73386, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julian Löbbers & Sebastian Lins & Theresa Kromat & Alexander Benlian & Ali Sunyaev, 2022. "A multi-perspective lens on web assurance seals: contrasting vendors’ intended and consumers’ perceived effects," Electronic Commerce Research, Springer, vol. 22(4), pages 1573-1615, December.
    2. Martin Adam & Konstantin Roethke & Alexander Benlian, 2022. "Gamblified digital product offerings: an experimental study of loot box menu designs," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(2), pages 971-986, June.
    3. Adam, Martin & Röthke, Konstantin & Benlian, Alexander, 2022. "Gamblified digital product offerings: an experimental study of loot box menu designs," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 127115, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    4. Christoph Rosenkranz & Viktoria Stray & Manuel Wiesche, 2023. "Call for Papers, Issue 1/2025," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(4), pages 483-486, August.
    5. Adam, Martin & Roethke, Konstantin & Benlian, Alexander, 2024. "Gamblified digital product offerings: an experimental study of loot box menu designs," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 144177, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    6. José Alberto Martínez-González & Carmen D. Álvarez-Albelo, 2021. "Influence of Site Personalization and First Impression on Young Consumers’ Loyalty to Tourism Websites," Sustainability, MDPI, vol. 13(3), pages 1-17, January.
    7. David Horneber & Sven Laumer, 2023. "Algorithmic Accountability," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(6), pages 723-730, December.
    8. Grigorios, Lamprinakos & Magrizos, Solon & Kostopoulos, Ioannis & Drossos, Dimitrios & Santos, David, 2022. "Overt and covert customer data collection in online personalized advertising: The role of user emotions," Journal of Business Research, Elsevier, vol. 141(C), pages 308-320.
    9. Tawfiq Alashoor & Mark Keil & H. Jeff Smith & Allen R. McConnell, 2023. "Too Tired and in Too Good of a Mood to Worry About Privacy: Explaining the Privacy Paradox Through the Lens of Effort Level in Information Processing," Information Systems Research, INFORMS, vol. 34(4), pages 1415-1436, December.
    10. Alisa Frik & Luigi Mittone, 2016. "Factors Influencing the Perceived Websites' Privacy Trustworthiness and Users' Purchase Intentions," CEEL Working Papers 1609, Cognitive and Experimental Economics Laboratory, Department of Economics, University of Trento, Italia.
    11. Jia, Lin & Xue, Geng & Fu, Yuwei & Xu, Longjia, 2018. "Factors affecting consumers’ acceptance of e-commerce consumer credit service," International Journal of Information Management, Elsevier, vol. 40(C), pages 103-110.
    12. Weidig, Jakob & Weippert, Marco & Kuehnl, Christina, 2024. "Personalized touchpoints and customer experience: A conceptual synthesis," Journal of Business Research, Elsevier, vol. 177(C).
    13. Ruwan Bandara & Mario Fernando & Shahriar Akter, 2020. "Privacy concerns in E-commerce: A taxonomy and a future research agenda," Electronic Markets, Springer;IIM University of St. Gallen, vol. 30(3), pages 629-647, September.
    14. A. J. Burns & Clay Posey & Tom L. Roberts, 2021. "Insiders’ Adaptations to Security-Based Demands in the Workplace: An Examination of Security Behavioral Complexity," Information Systems Frontiers, Springer, vol. 23(2), pages 343-360, April.
    15. Robert G. Alexander & Stephen L. Macknik & Susana Martinez-Conde, 2022. "What the Neuroscience and Psychology of Magic Reveal about Misinformation," Publications, MDPI, vol. 10(4), pages 1-19, September.
    16. Wenjun Cai & Jibao Gu & Jianlin Wu, 2021. "How Entrepreneurship Education and Social Capital Promote Nascent Entrepreneurial Behaviours: The Mediating Roles of Entrepreneurial Passion and Self-Efficacy," Sustainability, MDPI, vol. 13(20), pages 1-11, October.
    17. Johannes Klumpe & Oliver Francis Koch & Alexander Benlian, 2020. "How pull vs. push information delivery and social proof affect information disclosure in location based services," Electronic Markets, Springer;IIM University of St. Gallen, vol. 30(3), pages 569-586, September.
    18. Christoph Rosenkranz & Viktoria Stray & Manuel Wiesche, 2025. "Navigating the New Frontier of Information Systems Engineering," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 67(1), pages 1-5, February.
    19. Tamara Dinev & Allen R. McConnell & H. Jeff Smith, 2015. "Research Commentary—Informing Privacy Research Through Information Systems, Psychology, and Behavioral Economics: Thinking Outside the “APCO” Box," Information Systems Research, INFORMS, vol. 26(4), pages 639-655, December.
    20. Ritala, Paavo & Aaltonen, Päivi & Ruokonen, Mika & Nemeh, Andre, 2024. "Developing industrial AI capabilities: An organisational learning perspective," Technovation, Elsevier, vol. 138(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:binfse:v:67:y:2025:i:1:d:10.1007_s12599-024-00914-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.