IDEAS home Printed from https://ideas.repec.org/a/aea/jecper/v35y2021i4p71-96.html
   My bibliography  Save this article

Fragile Algorithms and Fallible Decision-Makers: Lessons from the Justice System

Author

Listed:
  • Jens Ludwig
  • Sendhil Mullainathan

Abstract

Algorithms (in some form) are already widely used in the criminal justice system. We draw lessons from this experience for what is to come for the rest of society as machine learning diffuses. We find economists and other social scientists have a key role to play in shaping the impact of algorithms, in part through improving the tools used to build them.

Suggested Citation

  • Jens Ludwig & Sendhil Mullainathan, 2021. "Fragile Algorithms and Fallible Decision-Makers: Lessons from the Justice System," Journal of Economic Perspectives, American Economic Association, vol. 35(4), pages 71-96, Fall.
    • Handle: RePEc:aea:jecper:v:35:y:2021:i:4:p:71-96
    DOI: 10.1257/jep.35.4.71
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/jep.35.4.71
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/jep.35.4.71.ds
    Download Restriction: no
    File URL: https://libkey.io/10.1257/jep.35.4.71?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David Arnold & Will Dobbie & Peter Hull, 2022. "Measuring Racial Discrimination in Bail Decisions," American Economic Review, American Economic Association, vol. 112(9), pages 2992-3038, September.
    2. Shamena Anwar & Hanming Fang, 2015. "Testing for Racial Prejudice in the Parole Board Release Process: Theory and Evidence," The Journal of Legal Studies, University of Chicago Press, vol. 44(1), pages 1-37.
    3. Mark Hoekstra & CarlyWill Sloan, 2022. "Does Race Matter for Police Use of Force? Evidence from 911 Calls," American Economic Review, American Economic Association, vol. 112(3), pages 827-860, March.
    4. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    5. Kerwin Kofi Charles & Jonathan Guryan, 2011. "Studying Discrimination: Fundamental Challenges and Recent Progress," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 479-511, September.
    6. Stephen L. Ross & John Yinger, 2002. "The Color of Credit: Mortgage Discrimination, Research Methodology, and Fair-Lending Enforcement," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262182289, December.
    7. Daniel Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision-Making under the Gambler's Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," NBER Working Papers 22026, National Bureau of Economic Research, Inc.
    8. G. O. Mohler & M. B. Short & Sean Malinowski & Mark Johnson & G. E. Tita & Andrea L. Bertozzi & P. J. Brantingham, 2015. "Randomized Controlled Field Trials of Predictive Policing," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1399-1411, December.
    9. Richard A. Berk & Susan B. Sorenson & Geoffrey Barnes, 2016. "Forecasting Domestic Violence: A Machine Learning Approach to Help Inform Arraignment Decisions," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 13(1), pages 94-115, March.
    10. Richard Berk, 2019. "Accuracy and Fairness for Juvenile Justice Risk Assessments," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 16(1), pages 175-194, March.
    11. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    12. Stéphane Mechoulan & Nicolas Sahuguet, 2015. "Assessing Racial Disparities in Parole Release," The Journal of Legal Studies, University of Chicago Press, vol. 44(1), pages 39-74.
    13. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    14. Roland G. Fryer, 2020. "An Empirical Analysis of Racial Differences in Police Use of Force: A Response," Journal of Political Economy, University of Chicago Press, vol. 128(10), pages 4003-4008.
    15. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    16. Anthony Heyes & Soodeh Saberian, 2019. "Temperature and Decisions: Evidence from 207,000 Court Cases," American Economic Journal: Applied Economics, American Economic Association, vol. 11(2), pages 238-265, April.
    17. Robert Bartlett & Adair Morse & Richard Stanton & Nancy Wallace, 2019. "Consumer-Lending Discrimination in the FinTech Era," NBER Working Papers 25943, National Bureau of Economic Research, Inc.
    18. Ilyana Kuziemko, 2013. "How should inmates be released from prison? An assessment of parole versus fixed-sentence regimes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 371-424.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brendon McConnell & Kegon Teng Kok Tan & Mariyana Zapryanova, 2023. "How do Parole Boards Respond to Large, Societal Shocks? Evidence from the 9/11 Terrorist Attacks," Working Papers 2023-010, Human Capital and Economic Opportunity Working Group.
    2. Douglas Kiarelly Godoy de Araujo, 2023. "gingado: a machine learning library focused on economics and finance," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Data science in central banking: applications and tools, volume 59, Bank for International Settlements.
    3. S. Mills & S. Costa & C. R. Sunstein, 2023. "AI, Behavioural Science, and Consumer Welfare," Journal of Consumer Policy, Springer, vol. 46(3), pages 387-400, September.
    4. Runshan Fu & Ginger Zhe Jin & Meng Liu, 2022. "Does Human-algorithm Feedback Loop Lead to Error Propagation? Evidence from Zillow’s Zestimate," NBER Working Papers 29880, National Bureau of Economic Research, Inc.
    5. Brendan O'Flaherty & Rajiv Sethi & Morgan Williams, 2024. "The nature, detection, and avoidance of harmful discrimination in criminal justice," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 43(1), pages 289-320, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yulin Liu & Luyao Zhang, 2022. "Cryptocurrency Valuation: An Explainable AI Approach," Papers 2201.12893, arXiv.org, revised Jul 2023.
    2. Meier, Armando N. & Levav, Jonathan & Meier, Stephan, 2020. "Early Release and Recidivism," IZA Discussion Papers 13035, Institute of Labor Economics (IZA).
    3. Jonas Radbruch & Amelie Schiprowski, 2020. "Interview Sequences and the Formation of Subjective Assessments," ECONtribute Discussion Papers Series 045, University of Bonn and University of Cologne, Germany.
    4. Julia Godfrey & Kegon Teng Kok Tan & Mariyana Zapryanova, 2023. "The Effect of Parole Board Racial Composition on Prisoner Outcomes," Working Papers 2023-011, Human Capital and Economic Opportunity Working Group.
    5. Brendon McConnell & Kegon Teng Kok Tan & Mariyana Zapryanova, 2023. "How do Parole Boards Respond to Large, Societal Shocks? Evidence from the 9/11 Terrorist Attacks," Working Papers 2023-010, Human Capital and Economic Opportunity Working Group.
    6. Eric Fesselmeyer, 2021. "The impact of temperature on labor quality: Umpire accuracy in Major League Baseball," Southern Economic Journal, John Wiley & Sons, vol. 88(2), pages 545-567, October.
    7. Jessica LaVoice & Domonkos F. Vamossy, 2019. "Racial Disparities in Debt Collection," Papers 1910.02570, arXiv.org, revised Jun 2023.
    8. Andreas Fuster & Paul Goldsmith‐Pinkham & Tarun Ramadorai & Ansgar Walther, 2022. "Predictably Unequal? The Effects of Machine Learning on Credit Markets," Journal of Finance, American Finance Association, vol. 77(1), pages 5-47, February.
    9. Miao Liu, 2022. "Assessing Human Information Processing in Lending Decisions: A Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 60(2), pages 607-651, May.
    10. Reio Tanji, 2022. "Pitch Call Discrimination in Major League Baseball: The Effect on the Observed Performance and the Salaries," Discussion Papers in Economics and Business 22-02, Osaka University, Graduate School of Economics.
    11. Guido de Blasio & Alessio D'Ignazio & Marco Letta, 2020. "Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities," Working Papers 16/20, Sapienza University of Rome, DISS.
    12. Ewens, Michael, 2022. "Race and Gender in Entrepreneurial Finance," SocArXiv djf8z, Center for Open Science.
    13. Sophie-Charlotte Klose & Johannes Lederer, 2020. "A Pipeline for Variable Selection and False Discovery Rate Control With an Application in Labor Economics," Papers 2006.12296, arXiv.org, revised Jun 2020.
    14. Chowdhury, Shyamal & Ooi, Evarn & Slonim, Robert, 2017. "Racial discrimination and white first name adoption: a field experiment in the Australian labour market," Working Papers 2017-15, University of Sydney, School of Economics.
    15. Chen, Daniel L. & Philippe, Arnaud, 2023. "Clash of norms judicial leniency on defendant birthdays," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 324-344.
    16. Anthony Edo & Nicolas Jacquemet & Constantine Yannelis, 2019. "Language skills and homophilous hiring discrimination: Evidence from gender and racially differentiated applications," Review of Economics of the Household, Springer, vol. 17(1), pages 349-376, March.
    17. Kevin Lang & Ariella Kahn-Lang Spitzer, 2020. "Race Discrimination: An Economic Perspective," Journal of Economic Perspectives, American Economic Association, vol. 34(2), pages 68-89, Spring.
    18. Akash Malhotra, 2018. "A hybrid econometric-machine learning approach for relative importance analysis: Prioritizing food policy," Papers 1806.04517, arXiv.org, revised Aug 2020.
    19. J. Michelle Brock & Ralph De Haas, 2023. "Discriminatory Lending: Evidence from Bankers in the Lab," American Economic Journal: Applied Economics, American Economic Association, vol. 15(2), pages 31-68, April.
    20. Arthur Charpentier & Emmanuel Flachaire & Antoine Ly, 2017. "Econom\'etrie et Machine Learning," Papers 1708.06992, arXiv.org, revised Mar 2018.

    More about this item

    JEL classification:

    • J15 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Minorities, Races, Indigenous Peoples, and Immigrants; Non-labor Discrimination
    • K14 - Law and Economics - - Basic Areas of Law - - - Criminal Law
    • K37 - Law and Economics - - Other Substantive Areas of Law - - - Immigration Law
    • K42 - Law and Economics - - Legal Procedure, the Legal System, and Illegal Behavior - - - Illegal Behavior and the Enforcement of Law

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:jecper:v:35:y:2021:i:4:p:71-96. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.