IDEAS home Printed from https://ideas.repec.org/a/kap/jbuset/v178y2022i4d10.1007_s10551-022-05053-w.html
   My bibliography  Save this article

Moral Judgments in the Age of Artificial Intelligence

Author

Listed:
  • Yulia W. Sullivan

    (Baylor University)

  • Samuel Fosso Wamba

    (TBS Education)

Abstract

The current research aims to answer the following question: “who will be held responsible for harm involving an artificial intelligence (AI) system?” Drawing upon the literature on moral judgments, we assert that when people perceive an AI system’s action as causing harm to others, they will assign blame to different entity groups involved in an AI’s life cycle, including the company, the developer team, and even the AI system itself, especially when such harm is perceived to be intentional. Drawing upon the theory of mind perception, we hypothesized that two dimensions of mind: perceived agency—attributing intention, reasoning, pursuing goals, and communicating to AI, and perceived experience—attributing emotional states, such as feeling pain and pleasure, personality, and consciousness to AI—mediated the relationship between perceived intentional harm and blame judgments toward AI. We also predicted that people are likely to attribute higher mind characteristics to AI when harm is perceived to be directed to humans than when it is perceived to be directed to non-humans. We tested our research model in three experiments. In all experiments, we found that perceived intentional harm led to blame judgments toward AI. In two experiments, we found perceived experience, not agency, mediated the relationship between perceived intentional harm and blame judgments. We also found that companies and developers were held responsible for moral violations involving AI, with developers received the most blame among the entities involved. Our third experiment reconciles the findings by showing that perceived intentional harm directed to a non-human entity did not lead to increased attributions of mind to AI. These findings have implications for theory and practice concerning unethical outcomes and behavior associated with AI use.

Suggested Citation

  • Yulia W. Sullivan & Samuel Fosso Wamba, 2022. "Moral Judgments in the Age of Artificial Intelligence," Journal of Business Ethics, Springer, vol. 178(4), pages 917-943, July.
  • Handle: RePEc:kap:jbuset:v:178:y:2022:i:4:d:10.1007_s10551-022-05053-w
    DOI: 10.1007/s10551-022-05053-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10551-022-05053-w
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10551-022-05053-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stefano Brusoni & Antonino Vaccaro, 2017. "Ethics, Technology and Organizational Innovation," Journal of Business Ethics, Springer, vol. 143(2), pages 223-226, June.
    2. Makarius, Erin E. & Mukherjee, Debmalya & Fox, Joseph D. & Fox, Alexa K., 2020. "Rising with the machines: A sociotechnical framework for bringing artificial intelligence into the organization," Journal of Business Research, Elsevier, vol. 120(C), pages 262-273.
    3. Rai, Tage S. & Diermeier, Daniel, 2015. "Corporations are Cyborgs: Organizations elicit anger but not sympathy when they can think but cannot feel," Organizational Behavior and Human Decision Processes, Elsevier, vol. 126(C), pages 18-26.
    4. Ian Ashman & Diana Winstanley, 2007. "For or Against Corporate Identity? Personification and the Problem of Moral Agency," Journal of Business Ethics, Springer, vol. 76(1), pages 83-95, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hermann, Erik & Puntoni, Stefano, 2024. "Artificial intelligence and consumer behavior: From predictive to generative AI," Journal of Business Research, Elsevier, vol. 180(C).
    2. Arsenyan, Jbid & Mirowska, Agata & Piepenbrink, Anke, 2023. "Close encounters with the virtual kind: Defining a human-virtual agent coexistence framework," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    3. Mahmud, Hasan & Islam, A.K.M. Najmul & Mitra, Ranjan Kumar, 2023. "What drives managers towards algorithm aversion and how to overcome it? Mitigating the impact of innovation resistance through technology readiness," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    4. Li, Tian-Ge & Zhang, Chu-Bing & Chang, Ying & Zheng, Wei, 2024. "The impact of AI identity disclosure on consumer unethical behavior: A social judgment perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    5. Michael Haenlein & Ming-Hui Huang & Andreas Kaplan, 2022. "Guest Editorial: Business Ethics in the Era of Artificial Intelligence," Journal of Business Ethics, Springer, vol. 178(4), pages 867-869, July.
    6. Muhammad Umair Shah & Umair Rehman & Bidhan Parmar & Inara Ismail, 2024. "Effects of Moral Violation on Algorithmic Transparency: An Empirical Investigation," Journal of Business Ethics, Springer, vol. 193(1), pages 19-34, August.
    7. Zhao, Taiyang & Ran, Yaxuan & Wu, Banggang & Lynette Wang, Valerie & Zhou, Liying & Lu Wang, Cheng, 2024. "Virtual versus human: Unraveling consumer reactions to service failures through influencer types," Journal of Business Research, Elsevier, vol. 178(C).
    8. Lukas Lanz & Roman Briker & Fabiola H. Gerpott, 2024. "Employees Adhere More to Unethical Instructions from Human Than AI Supervisors: Complementing Experimental Evidence with Machine Learning," Journal of Business Ethics, Springer, vol. 189(3), pages 625-646, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jauernig, Johanna & Uhl, Matthias & Valentinov, Vladislav, 2021. "The ethics of corporate hypocrisy: An experimental approach," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 131.
    2. Michele Battisti & Christian Dustmann & Uta Schönberg, 2023. "Technological and Organizational Change and the Careers of Workers," Journal of the European Economic Association, European Economic Association, vol. 21(4), pages 1551-1594.
    3. Schniter, E. & Shields, T.W. & Sznycer, D., 2020. "Trust in humans and robots: Economically similar but emotionally different," Journal of Economic Psychology, Elsevier, vol. 78(C).
    4. Kirimhan, Destan, 2023. "Importance of anti-money laundering regulations among prosumers for a cybersecure decentralized finance," Journal of Business Research, Elsevier, vol. 157(C).
    5. TANASE, George Cosmin, 2024. "Understand AI Driven Marketing Capabilities: Empowering Customer Experience and Deliver Value with Intelligent Tools and Technologies," Romanian Distribution Committee Magazine, Romanian Distribution Committee, vol. 15(3), pages 26-32, September.
    6. Carly Knight, 2022. "When Corporations Are People: Agent Talk and the Development of Organizational Actorhood, 1890–1934," Sociological Methods & Research, , vol. 51(4), pages 1634-1680, November.
    7. Wendelin M. Küpers, 2011. "Integral responsibilities for a responsive and sustainable practice in organization and management," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 18(3), pages 137-150, May.
    8. ShaoPeng Che & Yuanhang Zhou & Shunan Zhang & Dongyan Nan & Jang Hyun Kim, 2023. "Impact of ByteDance crisis communication strategies on different social media users," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-16, December.
    9. Petar Gidaković & Mateja Kos Koklič & Mila Zečević & Vesna Žabkar, 2022. "The influence of brand sustainability on purchase intentions: the mediating role of brand impressions and brand attitudes," Journal of Brand Management, Palgrave Macmillan, vol. 29(6), pages 556-568, November.
    10. Laurence Romani & Betina Szkudlarek, 2014. "The Struggles of the Interculturalists: Professional Ethical Identity and Early Stages of Codes of Ethics Development," Journal of Business Ethics, Springer, vol. 119(2), pages 173-191, January.
    11. Luca Mongelli & Pietro Versari & Francesco Rullani & Antonino Vaccaro, 2018. "Made in Carcere: Integral Human Development in Extreme Conditions," Journal of Business Ethics, Springer, vol. 152(4), pages 977-995, November.
    12. Iqbal, Kiram, 2023. "Acceptance conditions of algorithmic decision support in management," Junior Management Science (JUMS), Junior Management Science e. V., vol. 8(4), pages 887-925.
    13. Katie Shilton & Daniel Greene, 2019. "Linking Platforms, Practices, and Developer Ethics: Levers for Privacy Discourse in Mobile Application Development," Journal of Business Ethics, Springer, vol. 155(1), pages 131-146, March.
    14. Bosse, Douglas & Thompson, Steven & Ekman, Peter, 2023. "In consilium apparatus: Artificial intelligence, stakeholder reciprocity, and firm performance," Journal of Business Research, Elsevier, vol. 155(PA).
    15. Malik, Ashish & Nguyen, Mai & Budhwar, Pawan & Chowdhury, Soumyadeb & Gugnani, Ritika, 2024. "Leveraging high-performance HRM practices and knowledge sharing for managing technological and social change in emerging market healthcare providers," Technological Forecasting and Social Change, Elsevier, vol. 205(C).
    16. Arthur S. Jago & Kristin Laurin, 2019. "Inferring Commitment from Rates of Organizational Transition," Management Science, INFORMS, vol. 67(6), pages 2842-2857, June.
    17. Wang, Lili & Kim, Sara & Zhou, Xinyue, 2023. "Money in a “Safe” place: Money anthropomorphism increases saving behavior," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 88-108.
    18. Vlačić, Božidar & Corbo, Leonardo & Costa e Silva, Susana & Dabić, Marina, 2021. "The evolving role of artificial intelligence in marketing: A review and research agenda," Journal of Business Research, Elsevier, vol. 128(C), pages 187-203.
    19. Chowdhury, Soumyadeb & Budhwar, Pawan & Dey, Prasanta Kumar & Joel-Edgar, Sian & Abadie, Amelie, 2022. "AI-employee collaboration and business performance: Integrating knowledge-based view, socio-technical systems and organisational socialisation framework," Journal of Business Research, Elsevier, vol. 144(C), pages 31-49.
    20. de Kervenoael, Ronan & Schwob, Alexandre & Hasan, Rajibul & Psylla, Evangelia, 2024. "SIoT robots and consumer experiences in retail: Unpacking repeat purchase intention drivers leveraging computers are social actors (CASA) paradigm," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jbuset:v:178:y:2022:i:4:d:10.1007_s10551-022-05053-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.