IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-33417-3.html
   My bibliography  Save this article

Public attitudes value interpretability but prioritize accuracy in Artificial Intelligence

Author

Listed:
  • Anne-Marie Nussberger

    (Max Planck Institute for Human Development)

  • Lan Luo

    (Columbia Business School)

  • L. Elisa Celis

    (Yale University)

  • M. J. Crockett

    (Princeton University)

Abstract

As Artificial Intelligence (AI) proliferates across important social institutions, many of the most powerful AI systems available are difficult to interpret for end-users and engineers alike. Here, we sought to characterize public attitudes towards AI interpretability. Across seven studies (N = 2475), we demonstrate robust and positive attitudes towards interpretable AI among non-experts that generalize across a variety of real-world applications and follow predictable patterns. Participants value interpretability positively across different levels of AI autonomy and accuracy, and rate interpretability as more important for AI decisions involving high stakes and scarce resources. Crucially, when AI interpretability trades off against AI accuracy, participants prioritize accuracy over interpretability under the same conditions driving positive attitudes towards interpretability in the first place: amidst high stakes and scarce resources. These attitudes could drive a proliferation of AI systems making high-impact ethical decisions that are difficult to explain and understand.

Suggested Citation

  • Anne-Marie Nussberger & Lan Luo & L. Elisa Celis & M. J. Crockett, 2022. "Public attitudes value interpretability but prioritize accuracy in Artificial Intelligence," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33417-3
    DOI: 10.1038/s41467-022-33417-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-33417-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-33417-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    2. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Cass R. Sunstein, 2019. "Discrimination In The Age Of Algorithms," NBER Working Papers 25548, National Bureau of Economic Research, Inc.
    3. Hsee, Christopher K., 1996. "The Evaluability Hypothesis: An Explanation for Preference Reversals between Joint and Separate Evaluations of Alternatives," Organizational Behavior and Human Decision Processes, Elsevier, vol. 67(3), pages 247-257, September.
    4. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    5. Edmond Awad & Sohan Dsouza & Richard Kim & Jonathan Schulz & Joseph Henrich & Azim Shariff & Jean-François Bonnefon & Iyad Rahwan, 2018. "The Moral Machine experiment," Nature, Nature, vol. 563(7729), pages 59-64, November.
    6. Romain Cadario & Chiara Longoni & Carey K. Morewedge, 2021. "Understanding, explaining, and utilizing medical artificial intelligence," Nature Human Behaviour, Nature, vol. 5(12), pages 1636-1642, December.
    7. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sun, Weixin & Zhang, Xuantao & Li, Minghao & Wang, Yong, 2023. "Interpretable high-stakes decision support system for credit default forecasting," Technological Forecasting and Social Change, Elsevier, vol. 196(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexandra Rausch & Alexander Brauneis, 2015. "It’s about how the task is set: the inclusion–exclusion effect and accountability in preprocessing management information," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 23(2), pages 313-344, June.
    2. Charles Changchuan Jiang & Liana Fraenkel, 2017. "The Influence of Varying Cost Formats on Preferences," Medical Decision Making, , vol. 37(1), pages 17-26, January.
    3. Bryce McLaughlin & Jann Spiess, 2022. "Algorithmic Assistance with Recommendation-Dependent Preferences," Papers 2208.07626, arXiv.org, revised Jan 2024.
    4. Joseph Teal & Petko Kusev & Renata Heilman & Rose Martin & Alessia Passanisi & Ugo Pace, 2021. "Problem Gambling ‘Fuelled on the Fly’," IJERPH, MDPI, vol. 18(16), pages 1-14, August.
    5. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    6. Thomas Kourouxous & Thomas Bauer, 2019. "Violations of dominance in decision-making," Business Research, Springer;German Academic Association for Business Research, vol. 12(1), pages 209-239, April.
    7. A. Peter McGraw & Eldar Shafir & Alexander Todorov, 2010. "Valuing Money and Things: Why a $20 Item Can Be Worth More and Less Than $20," Management Science, INFORMS, vol. 56(5), pages 816-830, May.
    8. Ronayne, David & Sgroi, Daniel & Tuckwell, Anthony, 2021. "Evaluating the sunk cost effect," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 318-327.
    9. Huber, Joel & Viscusi, W. Kip & Bell, Jason, 2008. "Reference dependence in iterative choices," Organizational Behavior and Human Decision Processes, Elsevier, vol. 106(2), pages 143-152, July.
    10. Garbarino, Ellen & Slonim, Robert & Villeval, Marie Claire, 2019. "Loss aversion and lying behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 379-393.
    11. repec:cup:judgdm:v:3:y:2008:i::p:425-434 is not listed on IDEAS
    12. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    13. Wong, Kin Fai Ellick & Kwong, Jessica Y.Y., 2005. "Comparing two tiny giants or two huge dwarfs? Preference reversals owing to number size framing," Organizational Behavior and Human Decision Processes, Elsevier, vol. 98(1), pages 54-65, September.
    14. Ola Andersson & Jim Ingebretsen Carlson & Erik Wengström, 2021. "Differences Attract: An Experimental Study of Focusing in Economic Choice," The Economic Journal, Royal Economic Society, vol. 131(639), pages 2671-2692.
    15. Wells, Rachael E. & Iyengar, Sheena S., 2005. "Positive illusions of preference consistency: When remaining eluded by one's preferences yields greater subjective well-being and decision outcomes," Organizational Behavior and Human Decision Processes, Elsevier, vol. 98(1), pages 66-87, September.
    16. Kalakbandi, Vinay Kumar, 2018. "Managing the misbehaving retailer under demand uncertainty and imperfect information," European Journal of Operational Research, Elsevier, vol. 269(3), pages 939-954.
    17. Weinzierl, Matthew, 2014. "The promise of positive optimal taxation: normative diversity and a role for equal sacrifice," Journal of Public Economics, Elsevier, vol. 118(C), pages 128-142.
    18. Jonathan de Quidt, 2018. "Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 522-559.
    19. Andreas Fügener & Jörn Grahl & Alok Gupta & Wolfgang Ketter, 2022. "Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation," Information Systems Research, INFORMS, vol. 33(2), pages 678-696, June.
    20. Zohar Rusou & Moty Amar & Shahar Ayal, 2020. "The psychology of task management: The smaller tasks trap," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(4), pages 586-599, July.
    21. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33417-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.