IDEAS home Printed from https://ideas.repec.org/a/spr/infosf/v24y2022i3d10.1007_s10796-022-10284-3.html
   My bibliography  Save this article

Designing Transparency for Effective Human-AI Collaboration

Author

Listed:
  • Michael Vössing

    (Karlsruhe Institute of Technology)

  • Niklas Kühl

    (Karlsruhe Institute of Technology)

  • Matteo Lind

    (Karlsruhe Institute of Technology)

  • Gerhard Satzger

    (Karlsruhe Institute of Technology)

Abstract

The field of artificial intelligence (AI) is advancing quickly, and systems can increasingly perform a multitude of tasks that previously required human intelligence. Information systems can facilitate collaboration between humans and AI systems such that their individual capabilities complement each other. However, there is a lack of consolidated design guidelines for information systems facilitating the collaboration between humans and AI systems. This work examines how agent transparency affects trust and task outcomes in the context of human-AI collaboration. Drawing on the 3-Gap framework, we study agent transparency as a means to reduce the information asymmetry between humans and the AI. Following the Design Science Research paradigm, we formulate testable propositions, derive design requirements, and synthesize design principles. We instantiate two design principles as design features of an information system utilized in the hospitality industry. Further, we conduct two case studies to evaluate the effects of agent transparency: We find that trust increases when the AI system provides information on its reasoning, while trust decreases when the AI system provides information on sources of uncertainty. Additionally, we observe that agent transparency improves task outcomes as it enhances the accuracy of judgemental forecast adjustments.

Suggested Citation

  • Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    • Handle: RePEc:spr:infosf:v:24:y:2022:i:3:d:10.1007_s10796-022-10284-3
    DOI: 10.1007/s10796-022-10284-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10796-022-10284-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10796-022-10284-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Armstrong, J. Scott, 2007. "Significance tests harm progress in forecasting," International Journal of Forecasting, Elsevier, vol. 23(2), pages 321-327.
    2. Jarrahi, Mohammad Hossein, 2018. "Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making," Business Horizons, Elsevier, vol. 61(4), pages 577-586.
    3. Alexander Maedche & Stefan Morana & Silvia Schacht & Dirk Werth & Julian Krumeich, 2016. "Advanced User Assistance Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 58(5), pages 367-370, October.
    4. Sean J. Taylor & Benjamin Letham, 2018. "Forecasting at Scale," The American Statistician, Taylor & Francis Journals, vol. 72(1), pages 37-45, January.
    5. Allen S. Lee & Richard L. Baskerville, 2003. "Generalizing Generalizability in Information Systems Research," Information Systems Research, INFORMS, vol. 14(3), pages 221-243, September.
    6. Unknown, 2016. "Proceedings Of Abstracts," 152nd Seminar, August 30 - September 1, 2016, Novi Sad, Serbia 244068, European Association of Agricultural Economists.
    7. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    8. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    9. Jan Brocke & Alexander Maedche, 2019. "The DSR grid: six core dimensions for effectively planning and communicating design science research projects," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(3), pages 379-385, September.
    10. Henning Kagermann, 2015. "Change Through Digitization—Value Creation in the Age of Industry 4.0," Springer Books, in: Horst Albach & Heribert Meffert & Andreas Pinkwart & Ralf Reichwald (ed.), Management of Permanent Change, edition 127, chapter 2, pages 23-45, Springer.
    11. Rob J. Hyndman, 2006. "Another Look at Forecast Accuracy Metrics for Intermittent Demand," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 4, pages 43-46, June.
    12. Collins, Christopher & Dennehy, Denis & Conboy, Kieran & Mikalef, Patrick, 2021. "Artificial intelligence in information systems research: A systematic literature review and research agenda," International Journal of Information Management, Elsevier, vol. 60(C).
    13. Robert Fildes & Paul Goodwin, 2007. "Good and Bad Judgment in Forecasting: Lessons from Four Companies," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 8, pages 5-10, Fall.
    14. Ujwal Kayande & Arnaud De Bruyn & Gary L. Lilien & Arvind Rangaswamy & Gerrit H. van Bruggen, 2009. "How Incorporating Feedback Mechanisms in a DSS Affects DSS Evaluations," Information Systems Research, INFORMS, vol. 20(4), pages 527-546, December.
    15. Peter Buxmann & Thomas Hess & Jason Bennett Thatcher, 2021. "AI-Based Information Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(1), pages 1-4, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Babak Abedin & Christian Meske & Iris Junglas & Fethi Rabhi & Hamid R. Motahari-Nezhad, 2022. "Designing and Managing Human-AI Interactions," Information Systems Frontiers, Springer, vol. 24(3), pages 691-697, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mahmud, Hasan & Islam, A.K.M. Najmul & Ahmed, Syed Ishtiaque & Smolander, Kari, 2022. "What influences algorithmic decision-making? A systematic literature review on algorithm aversion," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Jeon, Yunho & Seong, Sihyeon, 2022. "Robust recurrent network model for intermittent time-series forecasting," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1415-1425.
    4. Litsiou, Konstantia & Polychronakis, Yiannis & Karami, Azhdar & Nikolopoulos, Konstantinos, 2022. "Relative performance of judgmental methods for forecasting the success of megaprojects," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1185-1196.
    5. Crone, Sven F. & Hibon, Michèle & Nikolopoulos, Konstantinos, 2011. "Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction," International Journal of Forecasting, Elsevier, vol. 27(3), pages 635-660.
    6. Winita Sulandari & Yudho Yudhanto & Sri Subanti & Crisma Devika Setiawan & Riskhia Hapsari & Paulo Canas Rodrigues, 2023. "Comparing the Simple to Complex Automatic Methods with the Ensemble Approach in Forecasting Electrical Time Series Data," Energies, MDPI, vol. 16(22), pages 1-16, November.
    7. Yang, Cheng-Hu & Wang, Hai-Tang & Ma, Xin & Talluri, Srinivas, 2023. "A data-driven newsvendor problem: A high-dimensional and mixed-frequency method," International Journal of Production Economics, Elsevier, vol. 266(C).
    8. Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
    9. Christoph Keding, 2021. "Understanding the interplay of artificial intelligence and strategic management: four decades of research in review," Management Review Quarterly, Springer, vol. 71(1), pages 91-134, February.
    10. Franses, Philip Hans & Legerstee, Rianne, 2013. "Do statistical forecasting models for SKU-level data benefit from including past expert knowledge?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 80-87.
    11. Sprangers, Olivier & Schelter, Sebastian & de Rijke, Maarten, 2023. "Parameter-efficient deep probabilistic forecasting," International Journal of Forecasting, Elsevier, vol. 39(1), pages 332-345.
    12. Yuan Li & William J. Kettinger, 2022. "Testing the Relationship Between Information and Knowledge in Computer-Aided Decision-Making," Information Systems Frontiers, Springer, vol. 24(6), pages 1827-1843, December.
    13. Adedayo Ajayi & Patrick Chi-Kwong Luk & Liyun Lao & Mohammad Farhan Khan, 2023. "Energy Forecasting Model for Ground Movement Operation in Green Airport," Energies, MDPI, vol. 16(13), pages 1-19, June.
    14. Meoli, Michele & Vismara, Silvio, 2022. "Machine-learning forecasting of successful ICOs," Journal of Economics and Business, Elsevier, vol. 121(C).
    15. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    16. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    17. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    18. Hill, Arthur V. & Zhang, Weiyong & Burch, Gerald F., 2015. "Forecasting the forecastability quotient for inventory management," International Journal of Forecasting, Elsevier, vol. 31(3), pages 651-663.
    19. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    20. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:infosf:v:24:y:2022:i:3:d:10.1007_s10796-022-10284-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.