IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v308y2022i1d10.1007_s10479-020-03702-9.html
   My bibliography  Save this article

Appraisals of harms and injustice trigger an eerie feeling that decreases trust in artificial intelligence systems

Author

Listed:
  • Yulia Sullivan

    (Baylor University)

  • Marc Bourmont

    (NEOMA Business School)

  • Mary Dunaway

    (Morgan State University)

Abstract

As artificial intelligence (AI) becomes more pervasive, the concern over how users can trust artificial agents is more important than ever before. In this research, we seek to understand the trust formation between humans and artificial agents from the morality and uncanny theory perspective. We conducted three studies to carefully examine the effect of two moral foundations: perceptions of harm and perceptions of injustice, as well as reported wrongdoing on uncanniness and examine the effect of uncanniness on trust in artificial agents. In Study 1, we found perceived injustice was the primary determinant of uncanniness and uncanniness had a negative effect on trust. Studies 2 and 3 extended these findings using two different scenarios of wrongful acts involving an artificial agent. In addition to explaining the contribution of moral appraisals to the feeling of uncanny, the latter studies also uncover substantial contributions of both perceived harm and perceived injustice. The results provide a foundation for establishing trust in artificial agents and designing an AI system by instilling moral values in it.

Suggested Citation

  • Yulia Sullivan & Marc Bourmont & Mary Dunaway, 2022. "Appraisals of harms and injustice trigger an eerie feeling that decreases trust in artificial intelligence systems," Annals of Operations Research, Springer, vol. 308(1), pages 525-548, January.
    • Handle: RePEc:spr:annopr:v:308:y:2022:i:1:d:10.1007_s10479-020-03702-9
    DOI: 10.1007/s10479-020-03702-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-020-03702-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-020-03702-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bernard Han & Jack Cook, 1998. "An efficient heuristic for robot acquisition and cell formation," Annals of Operations Research, Springer, vol. 77(0), pages 229-252, January.
    2. J. Beck & Barbara Smith, 2009. "Introduction to the special volume on constraint programming, artificial intelligence, and operations research," Annals of Operations Research, Springer, vol. 171(1), pages 1-2, October.
    3. Edmond Awad & Sohan Dsouza & Richard Kim & Jonathan Schulz & Joseph Henrich & Azim Shariff & Jean-François Bonnefon & Iyad Rahwan, 2018. "The Moral Machine experiment," Nature, Nature, vol. 563(7729), pages 59-64, November.
    4. Sanja Petrovic, 2019. "“You have to get wet to learn how to swim” applied to bridging the gap between research into personnel scheduling and its implementation in practice," Annals of Operations Research, Springer, vol. 275(1), pages 161-179, April.
    5. Paul A. Pavlou & David Gefen, 2005. "Psychological Contract Violation in Online Marketplaces: Antecedents, Consequences, and Moderating Role," Information Systems Research, INFORMS, vol. 16(4), pages 372-399, December.
    6. Vladimir Kats & Eugene Levner, 1997. "Minimizing the number of robots to meet a given cyclic schedule," Annals of Operations Research, Springer, vol. 69(0), pages 209-226, January.
    7. Peter Brucker & Sigrid Knust, 2002. "Lower Bounds for Scheduling a Single Robot in a Job-Shop Environment," Annals of Operations Research, Springer, vol. 115(1), pages 147-172, September.
    8. El-Ghazali Talbi, 2016. "Combining metaheuristics with mathematical programming, constraint programming and machine learning," Annals of Operations Research, Springer, vol. 240(1), pages 171-215, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Omrani, Nessrine & Rivieccio, Giorgia & Fiore, Ugo & Schiavone, Francesco & Agreda, Sergio Garcia, 2022. "To trust or not to trust? An assessment of trust in AI-based systems: Concerns, ethics and contexts," Technological Forecasting and Social Change, Elsevier, vol. 181(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Rea & Craig Froehle & Suzanne Masterson & Brian Stettler & Gregory Fermann & Arthur Pancioli, 2021. "Unequal but Fair: Incorporating Distributive Justice in Operational Allocation Models," Production and Operations Management, Production and Operations Management Society, vol. 30(7), pages 2304-2320, July.
    2. Chen, Shih-Chih & Hung, Chung-Wen, 2016. "Elucidating the factors influencing the acceptance of green products: An extension of theory of planned behavior," Technological Forecasting and Social Change, Elsevier, vol. 112(C), pages 155-163.
    3. José García & José Lemus-Romani & Francisco Altimiras & Broderick Crawford & Ricardo Soto & Marcelo Becerra-Rozas & Paola Moraga & Alex Paz Becerra & Alvaro Peña Fritz & Jose-Miguel Rubio & Gino Astor, 2021. "A Binary Machine Learning Cuckoo Search Algorithm Improved by a Local Search Operator for the Set-Union Knapsack Problem," Mathematics, MDPI, vol. 9(20), pages 1-19, October.
    4. Qian, Lixian & Yin, Juelin & Huang, Youlin & Liang, Ya, 2023. "The role of values and ethics in influencing consumers’ intention to use autonomous vehicle hailing services," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    5. Meents, S. & Verhagen, T. & Vlaar, P.W.L., 2011. "How sellers can stimulate purchasing in electronic marketplaces: Using information as a risk reduction signal," Serie Research Memoranda 0014, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    6. Judy E. Scott & Dawn G. Gregg & Jae Hoon Choi, 2015. "Lemon complaints: When online auctions go sour," Information Systems Frontiers, Springer, vol. 17(1), pages 177-191, February.
    7. Kassens-Noor, Eva & Cai, Meng & Kotval-Karamchandani, Zeenat & Decaminada, Travis, 2021. "Autonomous vehicles and mobility for people with special needs," Transportation Research Part A: Policy and Practice, Elsevier, vol. 150(C), pages 385-397.
    8. Joanna Sleigh & Shannon Hubbs & Alessandro Blasimme & Effy Vayena, 2024. "Can digital tools foster ethical deliberation?," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-10, December.
    9. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    10. Staněk, Rostislav & Krčál, Ondřej & Čellárová, Katarína, 2022. "Pull yourself up by your bootstraps: Identifying procedural preferences against helping others in the presence of moral hazard," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    11. MARTENS, David, 2020. "FAT Flow: A data science ethics framework," Working Papers 2020004, University of Antwerp, Faculty of Business and Economics.
    12. Hensel, Lukas & Witte, Marc & Caria, A. Stefano & Fetzer, Thiemo & Fiorin, Stefano & Götz, Friedrich M. & Gomez, Margarita & Haushofer, Johannes & Ivchenko, Andriy & Kraft-Todd, Gordon & Reutskaja, El, 2022. "Global Behaviors, Perceptions, and the Emergence of Social Norms at the Onset of the COVID-19 Pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 473-496.
    13. Franco Peschiera & Robert Dell & Johannes Royset & Alain Haït & Nicolas Dupin & Olga Battaïa, 2021. "A novel solution approach with ML-based pseudo-cuts for the Flight and Maintenance Planning problem," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 43(3), pages 635-664, September.
    14. Chohan, Raeesah & Paschen, Jeannette, 2023. "NFT marketing: How marketers can use nonfungible tokens in their campaigns," Business Horizons, Elsevier, vol. 66(1), pages 43-50.
    15. José García & Victor Yepes & José V. Martí, 2020. "A Hybrid k-Means Cuckoo Search Algorithm Applied to the Counterfort Retaining Walls Problem," Mathematics, MDPI, vol. 8(4), pages 1-22, April.
    16. Abid, Aman & Harrigan, Paul, 2020. "An exploration of social media-enabled voter relationships through uses and gratifications theory, psychological contract and service-dominant orientation," Australasian marketing journal, Elsevier, vol. 28(2), pages 71-82.
    17. Benedicktus, Ray L., 2011. "The effects of 3rd party consensus information on service expectations and online trust," Journal of Business Research, Elsevier, vol. 64(8), pages 846-853, August.
    18. Arias-Oliva, Mario & Pelegrín-Borondo, Jorge & Lara-Palma, Ana María & Juaneda-Ayensa, Emma, 2020. "Emerging cyborg products: An ethical market approach for market segmentation," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    19. Václavík, Roman & Novák, Antonín & Šůcha, Přemysl & Hanzálek, Zdeněk, 2018. "Accelerating the Branch-and-Price Algorithm Using Machine Learning," European Journal of Operational Research, Elsevier, vol. 271(3), pages 1055-1069.
    20. Hailing Liu & Ping Hu & Kewei Shi & Yudan Zhang, 2023. "Does Psychological Contract Violation Change the Original Intention of Eco-Tourists to Participate in Scenic Value Co-Creation?," Sustainability, MDPI, vol. 15(6), pages 1-21, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:308:y:2022:i:1:d:10.1007_s10479-020-03702-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.