IDEAS home Printed from https://ideas.repec.org/a/bla/popmgt/v31y2022i10p3749-3770.html
   My bibliography  Save this article

Algorithmic fairness in business analytics: Directions for research and practice

Author

Listed:
  • Maria De‐Arteaga
  • Stefan Feuerriegel
  • Maytal Saar‐Tsechansky

Abstract

The extensive adoption of business analytics (BA) has brought financial gains and increased efficiencies. However, these advances have simultaneously drawn attention to rising legal and ethical challenges when BA inform decisions with fairness implications. As a response to these concerns, the emerging study of algorithmic fairness deals with algorithmic outputs that may result in disparate outcomes or other forms of injustices for subgroups of the population, especially those who have been historically marginalized. Fairness is relevant on the basis of legal compliance, social responsibility, and utility; if not adequately and systematically addressed, unfair BA systems may lead to societal harms and may also threaten an organization's own survival, its competitiveness, and overall performance. This paper offers a forward‐looking, BA‐focused review of algorithmic fairness. We first review the state‐of‐the‐art research on sources and measures of bias, as well as bias mitigation algorithms. We then provide a detailed discussion of the utility–fairness relationship, emphasizing that the frequent assumption of a trade‐off between these two constructs is often mistaken or short‐sighted. Finally, we chart a path forward by identifying opportunities for business scholars to address impactful, open challenges that are key to the effective and responsible deployment of BA.

Suggested Citation

  • Maria De‐Arteaga & Stefan Feuerriegel & Maytal Saar‐Tsechansky, 2022. "Algorithmic fairness in business analytics: Directions for research and practice," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3749-3770, October.
  • Handle: RePEc:bla:popmgt:v:31:y:2022:i:10:p:3749-3770
    DOI: 10.1111/poms.13839
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/poms.13839
    Download Restriction: no

    File URL: https://libkey.io/10.1111/poms.13839?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jin Qi, 2017. "Mitigating Delays and Unfairness in Appointment Systems," Management Science, INFORMS, vol. 63(2), pages 566-583, February.
    2. Gérard P. Cachon & Karan Girotra & Serguei Netessine, 2020. "Interesting, Important, and Impactful Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 214-222, January.
    3. Maxime C. Cohen, 2018. "Big Data and Service Operations," Production and Operations Management, Production and Operations Management Society, vol. 27(9), pages 1709-1723, September.
    4. Karel H. van Donselaar & Vishal Gaur & Tom van Woensel & Rob A. C. M. Broekmeulen & Jan C. Fransoo, 2010. "Ordering Behavior in Retail Stores and Implications for Automated Replenishment," Management Science, INFORMS, vol. 56(5), pages 766-784, May.
    5. Ruomeng Cui & Santiago Gallino & Antonio Moreno & Dennis J. Zhang, 2018. "The Operational Value of Social Media Information," Production and Operations Management, Production and Operations Management Society, vol. 27(10), pages 1749-1769, October.
    6. Shunyuan Zhang & Nitin Mehta & Param Vir Singh & Kannan Srinivasan, 2021. "Frontiers: Can an Artificial Intelligence Algorithm Mitigate Racial Economic Inequality? An Analysis in the Context of Airbnb," Marketing Science, INFORMS, vol. 40(5), pages 813-820, September.
    7. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    8. Gad Allon & Volodymyr Babich, 2020. "Crowdsourcing and Crowdfunding in the Manufacturing and Services Sectors," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 102-112, January.
    9. Ruomeng Cui & Jun Li & Dennis J. Zhang, 2020. "Reducing Discrimination with Reviews in the Sharing Economy: Evidence from Field Experiments on Airbnb," Management Science, INFORMS, vol. 66(3), pages 1071-1094, March.
    10. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    11. Rouba Ibrahim & Beste Kucukyazici & Vedat Verter & Michel Gendreau & Mark Blostein, 2016. "Designing Personalized Treatment: An Application to Anticoagulation Therapy," Production and Operations Management, Production and Operations Management Society, vol. 25(5), pages 902-918, May.
    12. Duncan Simester & Artem Timoshenko & Spyros I. Zoumpoulis, 2020. "Targeting Prospective Customers: Robustness of Machine-Learning Methods to Typical Data Challenges," Management Science, INFORMS, vol. 66(6), pages 2495-2522, June.
    13. Mehmet Ulvi Saygi Ayvaci & Mehmet Eren Ahsen & Srinivasan Raghunathan & Zahra Gharibi, 2017. "Timing the Use of Breast Cancer Risk Information in Biopsy Decision-Making," Production and Operations Management, Production and Operations Management Society, vol. 26(7), pages 1333-1358, July.
    14. Kartik K. Ganju & Hilal Atasoy & Jeffery McCullough & Brad Greenwood, 2020. "The Role of Decision Support Systems in Attenuating Racial Biases in Healthcare Delivery," Management Science, INFORMS, vol. 66(11), pages 5171-5181, November.
    15. Hamsa Bastani, 2021. "Predicting with Proxies: Transfer Learning in High Dimension," Management Science, INFORMS, vol. 67(5), pages 2964-2984, May.
    16. Dimitris Bertsimas & Vivek F. Farias & Nikolaos Trichakis, 2011. "The Price of Fairness," Operations Research, INFORMS, vol. 59(1), pages 17-31, February.
    17. Qi Feng & J. George Shanthikumar, 2018. "How Research in Production and Operations Management May Evolve in the Era of Big Data," Production and Operations Management, Production and Operations Management Society, vol. 27(9), pages 1670-1684, September.
    18. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    19. Tsan‐Ming Choi & Stein W. Wallace & Yulan Wang, 2018. "Big Data Analytics in Operations Management," Production and Operations Management, Production and Operations Management Society, vol. 27(10), pages 1868-1883, October.
    20. Dimitris Bertsimas & Vivek F. Farias & Nikolaos Trichakis, 2013. "Fairness, Efficiency, and Flexibility in Organ Allocation for Kidney Transplantation," Operations Research, INFORMS, vol. 61(1), pages 73-87, February.
    21. David Rea & Craig Froehle & Suzanne Masterson & Brian Stettler & Gregory Fermann & Arthur Pancioli, 2021. "Unequal but Fair: Incorporating Distributive Justice in Operational Allocation Models," Production and Operations Management, Production and Operations Management Society, vol. 30(7), pages 2304-2320, July.
    22. Saravanan Kesavan & Tarun Kushwaha, 2020. "Field Experiment on the Profit Implications of Merchants’ Discretionary Power to Override Data-Driven Decision-Making Tools," Management Science, INFORMS, vol. 66(11), pages 5182-5190, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Violet Xinying Chen & J. N. Hooker, 2023. "A guide to formulating fairness in an optimization model," Annals of Operations Research, Springer, vol. 326(1), pages 581-619, July.
    2. Koen W. de Bock & Kristof Coussement & Arno De Caigny & Roman Slowiński & Bart Baesens & Robert N Boute & Tsan-Ming Choi & Dursun Delen & Mathias Kraus & Stefan Lessmann & Sebastián Maldonado & David , 2023. "Explainable AI for Operational Research: A Defining Framework, Methods, Applications, and a Research Agenda," Post-Print hal-04219546, HAL.
    3. Sushil Gupta & Carlos M. Parra & Subodha Kumar, 2022. "Emerging research problems in different business domains: An analytics perspective," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3647-3650, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yinchu Zhu & Ilya O. Ryzhov, 2022. "Optimal data-driven hiring with equity for underrepresented groups," Papers 2206.09300, arXiv.org.
    2. Meng Li & Tao Li, 2022. "AI Automation and Retailer Regret in Supply Chains," Production and Operations Management, Production and Operations Management Society, vol. 31(1), pages 83-97, January.
    3. Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.
    4. Gur, Yonatan & Iancu, Dan & Warnes, Xavier, 2020. "Value Loss in Allocation Systems with Provider Guarantees," Research Papers 3813, Stanford University, Graduate School of Business.
    5. Oliver Schaer & Nikolaos Kourentzes & Robert Fildes, 2022. "Predictive competitive intelligence with prerelease online search traffic," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3823-3839, October.
    6. Long He & Sheng Liu & Zuo‐Jun Max Shen, 2022. "Smart urban transport and logistics: A business analytics perspective," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3771-3787, October.
    7. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    8. Feng, Yuanjun & Song, Dong-Ping & Li, Dong & Xie, Ying, 2022. "Service fairness and value of customer information for the stochastic container relocation problem under flexible service policy," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 167(C).
    9. Dargnies, Marie-Pierre & Hakimov, Rustamdjan & Kübler, Dorothea, 2022. "Aversion to hiring algorithms: Transparency, gender profiling, and self-confidence," Discussion Papers, Research Unit: Market Behavior SP II 2022-202, WZB Berlin Social Science Center.
    10. Chen, Qingxin & Fu, Chenyi & Zhu, Ning & Ma, Shoufeng & He, Qiao-Chu, 2023. "A target-based optimization model for bike-sharing systems: From the perspective of service efficiency and equity," Transportation Research Part B: Methodological, Elsevier, vol. 167(C), pages 235-260.
    11. Saravanan Kesavan & Tarun Kushwaha, 2020. "Field Experiment on the Profit Implications of Merchants’ Discretionary Power to Override Data-Driven Decision-Making Tools," Management Science, INFORMS, vol. 66(11), pages 5182-5190, November.
    12. Fumagalli, Elena & Rezaei, Sarah & Salomons, Anna, 2022. "OK computer: Worker perceptions of algorithmic recruitment," Research Policy, Elsevier, vol. 51(2).
    13. Yonatan Gur & Dan Iancu & Xavier Warnes, 2021. "Value Loss in Allocation Systems with Provider Guarantees," Management Science, INFORMS, vol. 67(6), pages 3757-3784, June.
    14. Gür Ali, Özden & Gürlek, Ragıp, 2020. "Automatic Interpretable Retail forecasting with promotional scenarios," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1389-1406.
    15. Dieudonné Tchuente & Serge Nyawa, 2022. "Real estate price estimation in French cities using geocoding and machine learning," Annals of Operations Research, Springer, vol. 308(1), pages 571-608, January.
    16. Robert P. Rooderkerk & Nicole DeHoratius & Andrés Musalem, 2022. "The past, present, and future of retail analytics: Insights from a survey of academic research and interviews with practitioners," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3727-3748, October.
    17. Zenan Zhou & Xiang Wan, 2022. "Does the Sharing Economy Technology Disrupt Incumbents? Exploring the Influences of Mobile Digital Freight Matching Platforms on Road Freight Logistics Firms," Production and Operations Management, Production and Operations Management Society, vol. 31(1), pages 117-137, January.
    18. Acciarini, Chiara & Cappa, Francesco & Boccardelli, Paolo & Oriani, Raffaele, 2023. "How can organizations leverage big data to innovate their business models? A systematic literature review," Technovation, Elsevier, vol. 123(C).
    19. Liu, Weihua & George Shanthikumar, J. & Tae-Woo Lee, Paul & Li, Xiang & Zhou, Li, 2021. "Special issue editorial: Smart supply chains and intelligent logistics services," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 147(C).
    20. Karsu, Özlem & Morton, Alec, 2015. "Inequity averse optimization in operational research," European Journal of Operational Research, Elsevier, vol. 245(2), pages 343-359.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:popmgt:v:31:y:2022:i:10:p:3749-3770. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1937-5956 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.