IDEAS home Printed from https://ideas.repec.org/a/kap/jbuset/v178y2022i4d10.1007_s10551-022-05055-8.html
   My bibliography  Save this article

From Reality to World. A Critical Perspective on AI Fairness

Author

Listed:
  • Jean-Marie John-Mathews

    (Université Paris-Saclay, Univ Evry, IMT-BS, LITEM)

  • Dominique Cardon

    (Sciences Po)

  • Christine Balagué

    (Université Paris-Saclay, Univ Evry, IMT-BS, LITEM)

Abstract

Fairness of Artificial Intelligence (AI) decisions has become a big challenge for governments, companies, and societies. We offer a theoretical contribution to consider AI ethics outside of high-level and top-down approaches, based on the distinction between “reality” and “world” from Luc Boltanski. To do so, we provide a new perspective on the debate on AI fairness and show that criticism of ML unfairness is “realist”, in other words, grounded in an already instituted reality based on demographic categories produced by institutions. Second, we show that the limits of “realist” fairness corrections lead to the elaboration of “radical responses” to fairness, that is, responses that radically change the format of data. Third, we show that fairness correction is shifting to a “domination regime” that absorbs criticism, and we provide some theoretical and practical avenues for further development in AI ethics. Using an ad hoc critical space stabilized by reality tests alongside the algorithm, we build a shared responsibility model which is compatible with the radical response to fairness issues. Finally, this paper shows the fundamental contribution of pragmatic sociology theories, insofar as they afford a social and political perspective on AI ethics by giving an active role to material actors such as database formats on ethical debates. In a context where data are increasingly numerous, granular, and behavioral, it is essential to renew our conception of AI ethics on algorithms in order to establish new models of responsibility for companies that take into account changes in the computing paradigm.

Suggested Citation

  • Jean-Marie John-Mathews & Dominique Cardon & Christine Balagué, 2022. "From Reality to World. A Critical Perspective on AI Fairness," Journal of Business Ethics, Springer, vol. 178(4), pages 945-959, July.
    • Handle: RePEc:kap:jbuset:v:178:y:2022:i:4:d:10.1007_s10551-022-05055-8
    DOI: 10.1007/s10551-022-05055-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10551-022-05055-8
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10551-022-05055-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kirsten Martin, 2019. "Ethical Implications and Accountability of Algorithms," Journal of Business Ethics, Springer, vol. 160(4), pages 835-850, December.
    2. Aurélie Leclercq-Vandelannoitte & Emmanuel Bertin, 2018. "From sovereign IT governance to liberal IT governmentality? A Foucauldian analogy," European Journal of Information Systems, Taylor & Francis Journals, vol. 27(3), pages 326-346, May.
    3. D. J. Hand & W. E. Henley, 1997. "Statistical Classification Methods in Consumer Credit Scoring: a Review," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 160(3), pages 523-541, September.
    4. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    5. Hamsa Bastani & Mohsen Bayati, 2020. "Online Decision Making with High-Dimensional Covariates," Operations Research, INFORMS, vol. 68(1), pages 276-294, January.
    6. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    7. John-Mathews, Jean-Marie, 2022. "Some critical and ethical perspectives on the empirical turn of AI interpretability," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    8. Mireille Mercier-Roy & Chantale Mailhot, 2019. "What’s in an App? Investigating the Moral Struggles Behind a Sharing Economy Device," Journal of Business Ethics, Springer, vol. 159(4), pages 977-996, November.
    9. Jean-Marie John-Mathews, 2022. "Some critical and ethical perspectives on the empirical turn of AI interpretability," Post-Print hal-03395823, HAL.
    10. Kirsten Martin & R. Freeman, 2004. "The Separation of Technology and Ethics in Business Ethics," Journal of Business Ethics, Springer, vol. 53(4), pages 353-364, September.
    11. Kate Crawford & Ryan Calo, 2016. "There is a blind spot in AI research," Nature, Nature, vol. 538(7625), pages 311-313, October.
    12. Ulrich Leicht-Deobald & Thorsten Busch & Christoph Schank & Antoinette Weibel & Simon Schafheitle & Isabelle Wildhaber & Gabriel Kasper, 2019. "The Challenges of Algorithm-Based HR Decision-Making for Personal Integrity," Journal of Business Ethics, Springer, vol. 160(2), pages 377-392, December.
    13. Pascal Dey & Othmar Lehner, 2017. "Registering Ideology in the Creation of Social Entrepreneurs: Intermediary Organizations, ‘Ideal Subject’ and the Promise of Enjoyment," Journal of Business Ethics, Springer, vol. 142(4), pages 753-767, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Benjamin Semujanga & Xavier Parent-Rocheleau, 2024. "Time-Based Stress and Procedural Justice: Can Transparency Mitigate the Effects of Algorithmic Compensation in Gig Work?," IJERPH, MDPI, vol. 21(1), pages 1-16, January.
    2. Manis, K.T. & Madhavaram, Sreedhar, 2023. "AI-Enabled marketing capabilities and the hierarchy of capabilities: Conceptualization, proposition development, and research avenues," Journal of Business Research, Elsevier, vol. 157(C).
    3. Zirar, Araz & Ali, Syed Imran & Islam, Nazrul, 2023. "Worker and workplace Artificial Intelligence (AI) coexistence: Emerging themes and research agenda," Technovation, Elsevier, vol. 124(C).
    4. Chen, Xun-Qi & Ma, Chao-Qun & Ren, Yi-Shuai & Lei, Yu-Tian & Huynh, Ngoc Quang Anh & Narayan, Seema, 2023. "Explainable artificial intelligence in finance: A bibliometric review," Finance Research Letters, Elsevier, vol. 56(C).
    5. Behera, Rajat Kumar & Bala, Pradip Kumar & Rana, Nripendra P. & Irani, Zahir, 2023. "Responsible natural language processing: A principlist framework for social benefits," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    6. Maude Lavanchy & Patrick Reichert & Jayanth Narayanan & Krishna Savani, 2023. "Applicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures," Journal of Business Ethics, Springer, vol. 188(1), pages 125-150, November.
    7. Clément Dubreuil & Delphine Dion & Stéphane Borraz, 2023. "For the Love of the Game: Moral Ambivalence and Justification Work in Consuming Violence," Journal of Business Ethics, Springer, vol. 186(3), pages 675-694, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maude Lavanchy & Patrick Reichert & Jayanth Narayanan & Krishna Savani, 2023. "Applicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures," Journal of Business Ethics, Springer, vol. 188(1), pages 125-150, November.
    2. Maria Figueroa-Armijos & Brent B. Clark & Serge P. da Motta Veiga, 2023. "Ethical Perceptions of AI in Hiring and Organizational Trust: The Role of Performance Expectancy and Social Influence," Journal of Business Ethics, Springer, vol. 186(1), pages 179-197, August.
    3. Sarah Spiekermann & Hanna Krasnova & Oliver Hinz & Annika Baumann & Alexander Benlian & Henner Gimpel & Irina Heimbach & Antonia Köster & Alexander Maedche & Björn Niehaves & Marten Risius & Manuel Tr, 2022. "Values and Ethics in Information Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(2), pages 247-264, April.
    4. Florian Pethig & Julia Kroenung, 2023. "Biased Humans, (Un)Biased Algorithms?," Journal of Business Ethics, Springer, vol. 183(3), pages 637-652, March.
    5. Lily Morse & Mike Horia M. Teodorescu & Yazeed Awwad & Gerald C. Kane, 2022. "Do the Ends Justify the Means? Variation in the Distributive and Procedural Fairness of Machine Learning Algorithms," Journal of Business Ethics, Springer, vol. 181(4), pages 1083-1095, December.
    6. Stephanie Kelley, 2022. "Employee Perceptions of the Effective Adoption of AI Principles," Journal of Business Ethics, Springer, vol. 178(4), pages 871-893, July.
    7. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    8. Chen, Xun-Qi & Ma, Chao-Qun & Ren, Yi-Shuai & Lei, Yu-Tian & Huynh, Ngoc Quang Anh & Narayan, Seema, 2023. "Explainable artificial intelligence in finance: A bibliometric review," Finance Research Letters, Elsevier, vol. 56(C).
    9. Alina Köchling & Marius Claus Wehner, 2020. "Discriminated by an algorithm: a systematic review of discrimination and fairness by algorithmic decision-making in the context of HR recruitment and HR development," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 795-848, November.
    10. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    11. Dargnies, Marie-Pierre & Hakimov, Rustamdjan & Kübler, Dorothea, 2022. "Aversion to hiring algorithms: Transparency, gender profiling, and self-confidence," Discussion Papers, Research Unit: Market Behavior SP II 2022-202, WZB Berlin Social Science Center.
    12. Yinchu Zhu & Ilya O. Ryzhov, 2022. "Optimal data-driven hiring with equity for underrepresented groups," Papers 2206.09300, arXiv.org.
    13. Herrera, Gabriel Paes & Constantino, Michel & Su, Jen-Je & Naranpanawa, Athula, 2023. "The use of ICTs and income distribution in Brazil: A machine learning explanation using SHAP values," Telecommunications Policy, Elsevier, vol. 47(8).
    14. Serge P. da Motta Veiga & Maria Figueroa-Armijos & Brent B. Clark, 2023. "Seeming Ethical Makes You Attractive: Unraveling How Ethical Perceptions of AI in Hiring Impacts Organizational Innovativeness and Attractiveness," Journal of Business Ethics, Springer, vol. 186(1), pages 199-216, August.
    15. Behera, Rajat Kumar & Bala, Pradip Kumar & Rana, Nripendra P. & Irani, Zahir, 2023. "Responsible natural language processing: A principlist framework for social benefits," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    16. Danielle Li & Lindsey R. Raymond & Peter Bergman, 2020. "Hiring as Exploration," NBER Working Papers 27736, National Bureau of Economic Research, Inc.
    17. Bauer, Kevin & Gill, Andrej, 2021. "Mirror, mirror on the wall: Machine predictions and self-fulfilling prophecies," SAFE Working Paper Series 313, Leibniz Institute for Financial Research SAFE.
    18. Nathan Kallus & Xiaojie Mao & Angela Zhou, 2022. "Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combination," Management Science, INFORMS, vol. 68(3), pages 1959-1981, March.
    19. Runshan Fu & Ginger Zhe Jin & Meng Liu, 2022. "Does Human-algorithm Feedback Loop Lead to Error Propagation? Evidence from Zillow’s Zestimate," NBER Working Papers 29880, National Bureau of Economic Research, Inc.
    20. Jake B. Telkamp & Marc H. Anderson, 2022. "The Implications of Diverse Human Moral Foundations for Assessing the Ethicality of Artificial Intelligence," Journal of Business Ethics, Springer, vol. 178(4), pages 961-976, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jbuset:v:178:y:2022:i:4:d:10.1007_s10551-022-05055-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.