IDEAS home Printed from https://ideas.repec.org/a/spr/binfse/v64y2022i3d10.1007_s12599-021-00716-w.html
   My bibliography  Save this article

The Cost of Fairness in AI: Evidence from E-Commerce

Author

Listed:
  • Moritz Zahn

    (Goethe University Frankfurt
    ETH Zurich)

  • Stefan Feuerriegel

    (ETH Zurich)

  • Niklas Kuehl

    (Karlsruhe Institute of Technology)

Abstract

Contemporary information systems make widespread use of artificial intelligence (AI). While AI offers various benefits, it can also be subject to systematic errors, whereby people from certain groups (defined by gender, age, or other sensitive attributes) experience disparate outcomes. In many AI applications, disparate outcomes confront businesses and organizations with legal and reputational risks. To address these, technologies for so-called “AI fairness” have been developed, by which AI is adapted such that mathematical constraints for fairness are fulfilled. However, the financial costs of AI fairness are unclear. Therefore, the authors develop AI fairness for a real-world use case from e-commerce, where coupons are allocated according to clickstream sessions. In their setting, the authors find that AI fairness successfully manages to adhere to fairness requirements, while reducing the overall prediction performance only slightly. However, they find that AI fairness also results in an increase in financial cost. Thus, in this way the paper’s findings contribute to designing information systems on the basis of AI fairness.

Suggested Citation

  • Moritz Zahn & Stefan Feuerriegel & Niklas Kuehl, 2022. "The Cost of Fairness in AI: Evidence from E-Commerce," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(3), pages 335-348, June.
    • Handle: RePEc:spr:binfse:v:64:y:2022:i:3:d:10.1007_s12599-021-00716-w
    DOI: 10.1007/s12599-021-00716-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12599-021-00716-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12599-021-00716-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nikhil Garg & Londa Schiebinger & Dan Jurafsky & James Zou, 2018. "Word embeddings quantify 100 years of gender and ethnic stereotypes," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(16), pages 3635-3644, April.
    2. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    3. Kraus, Mathias & Feuerriegel, Stefan & Oztekin, Asil, 2020. "Deep learning in business analytics and operations research: Models, applications and managerial implications," European Journal of Operational Research, Elsevier, vol. 281(3), pages 628-641.
    4. Amy Wenxuan Ding & Shibo Li & Patrali Chatterjee, 2015. "Learning User Real-Time Intent for Optimal Dynamic Web Page Transformation," Information Systems Research, INFORMS, vol. 26(2), pages 339-359, June.
    5. McDowell, William C. & Wilson, Rachel C. & Kile, Charles Owen, 2016. "An examination of retail website design and conversion rate," Journal of Business Research, Elsevier, vol. 69(11), pages 4837-4842.
    6. K. W. De Bock & D. Van Den Poel & S. Manigart, 2009. "Predicting web site audience demographics for web advertising targeting using multi-web site clickstream data," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 09/618, Ghent University, Faculty of Economics and Business Administration.
    7. Imke Reimers & Claire (Chunying) Xie, 2019. "Do Coupons Expand or Cannibalize Revenue? Evidence from an e-Market," Management Science, INFORMS, vol. 65(1), pages 286-300, January.
    8. Alexander Maedche & Christine Legner & Alexander Benlian & Benedikt Berger & Henner Gimpel & Thomas Hess & Oliver Hinz & Stefan Morana & Matthias Söllner, 2019. "AI-Based Digital Assistants," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(4), pages 535-544, August.
    9. Alan L. Montgomery & Shibo Li & Kannan Srinivasan & John C. Liechty, 2004. "Modeling Online Browsing and Path Analysis Using Clickstream Data," Marketing Science, INFORMS, vol. 23(4), pages 579-595, November.
    10. Annika Baumann & Johannes Haupt & Fabian Gebert & Stefan Lessmann, 2019. "The Price of Privacy," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(4), pages 413-431, August.
    11. Veale, Michael & Binns, Reuben, 2017. "Fairer machine learning in the real world: Mitigating discrimination without collecting sensitive data," SocArXiv ustxg, Center for Open Science.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefan Feuerriegel & Mateusz Dolata & Gerhard Schwabe, 2020. "Fair AI," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 62(4), pages 379-384, August.
    2. Ana Alina Tudoran, 2022. "A machine learning approach to identifying decision-making styles for managing customer relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 351-374, March.
    3. Alina Köchling & Marius Claus Wehner, 2020. "Discriminated by an algorithm: a systematic review of discrimination and fairness by algorithmic decision-making in the context of HR recruitment and HR development," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 795-848, November.
    4. Christof Naumzik & Stefan Feuerriegel & Markus Weinmann, 2022. "I Will Survive: Predicting Business Failures from Customer Ratings," Marketing Science, INFORMS, vol. 41(1), pages 188-207, January.
    5. Shaohui Wu & Yong Tan & Yubo Chen & Yitian (Sky) Liang, 2022. "How Is Mobile User Behavior Different? A Hidden Markov Model of Cross-Mobile Application Usage Dynamics," Information Systems Research, INFORMS, vol. 33(3), pages 1002-1022, September.
    6. Chenshuo Sun & Panagiotis Adamopoulos & Anindya Ghose & Xueming Luo, 2022. "Predicting Stages in Omnichannel Path to Purchase: A Deep Learning Model," Information Systems Research, INFORMS, vol. 33(2), pages 429-445, June.
    7. Sheng, Jie & Amankwah-Amoah, Joseph & Wang, Xiaojun, 2019. "Technology in the 21st century: New challenges and opportunities," Technological Forecasting and Social Change, Elsevier, vol. 143(C), pages 321-335.
    8. Babur De los Santos & Sergei Koulayev, 2017. "Optimizing Click-Through in Online Rankings with Endogenous Search Refinement," Marketing Science, INFORMS, vol. 36(4), pages 542-564, July.
    9. Kun Sun & Rong Wang, 2022. "The Evolutionary Pattern of Language in English Fiction Over the Last Two Centuries: Insights From Linguistic Concreteness and Imageability," SAGE Open, , vol. 12(1), pages 21582440211, January.
    10. Martinovici, A., 2019. "Revealing attention - how eye movements predict brand choice and moment of choice," Other publications TiSEM 7dca38a5-9f78-4aee-bd81-c, Tilburg University, School of Economics and Management.
    11. Yanwen Wang & Chunhua Wu & Ting Zhu, 2019. "Mobile Hailing Technology and Taxi Driving Behaviors," Marketing Science, INFORMS, vol. 38(5), pages 734-755, September.
    12. Gahm, Christian & Uzunoglu, Aykut & Wahl, Stefan & Ganschinietz, Chantal & Tuma, Axel, 2022. "Applying machine learning for the anticipation of complex nesting solutions in hierarchical production planning," European Journal of Operational Research, Elsevier, vol. 296(3), pages 819-836.
    13. Shrutika Mishra & A. R. Tripathi, 2021. "AI business model: an integrative business approach," Journal of Innovation and Entrepreneurship, Springer, vol. 10(1), pages 1-21, December.
    14. Ash, Elliott & Durante, Ruben & Grebenshchikova, Mariia & Schwarz, Carlo, 2022. "Visual Representation and Stereotypes in News Media," CEPR Discussion Papers 16624, C.E.P.R. Discussion Papers.
    15. Sara Moussawi & Marios Koufaris & Raquel Benbunan-Fich, 2021. "How perceptions of intelligence and anthropomorphism affect adoption of personal intelligent agents," Electronic Markets, Springer;IIM University of St. Gallen, vol. 31(2), pages 343-364, June.
    16. Duan, Yongrui & Liu, Tonghui & Mao, Zhixin, 2022. "How online reviews and coupons affect sales and pricing: An empirical study based on e-commerce platform," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    17. Patrick Büchel & Michael Kratochwil & Maximilian Nagl & Daniel Rösch, 2022. "Deep calibration of financial models: turning theory into practice," Review of Derivatives Research, Springer, vol. 25(2), pages 109-136, July.
    18. Kaffash, Sepideh & Nguyen, An Truong & Zhu, Joe, 2021. "Big data algorithms and applications in intelligent transportation system: A review and bibliometric analysis," International Journal of Production Economics, Elsevier, vol. 231(C).
    19. Martin Baumgaertner & Johannes Zahner, 2021. "Whatever it takes to understand a central banker - Embedding their words using neural networks," MAGKS Papers on Economics 202130, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    20. Gunnarsson, Björn Rafn & vanden Broucke, Seppe & Baesens, Bart & Óskarsdóttir, María & Lemahieu, Wilfried, 2021. "Deep learning for credit scoring: Do or don’t?," European Journal of Operational Research, Elsevier, vol. 295(1), pages 292-305.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:binfse:v:64:y:2022:i:3:d:10.1007_s12599-021-00716-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.