IDEAS home Printed from https://ideas.repec.org/p/udc/wpaper/wp493.html
   My bibliography  Save this paper

A Simple Test for Prejudice in Decision Processes: The Prediction-Based Outcome Test

Author

Listed:
  • Nicolás Grau
  • Damián Vergara

Abstract

We propose a novel implementation of the outcome test for diagnosing prejudice in decision processes, the Prediction-Based Outcome Test (P-BOT). We motivate our approach with a model of prejudice in pretrial detention decisions. The main empirical challenge when implementing outcome tests is the identification of marginal individuals. Our method uses the predicted release status to identify marginally released defendants. Concretely, we provide sufficient conditions under which a ranking of the propensity score among released defendants identifies those who are more likely to be at the margin given their observables, and propose a set of diagnostics to empirically assess the plausibility of the identification assumptions. Some appealing features of the P-BOT are that (i) it does not require instruments nor random assignment of judges, (ii) it is robust to standard omitted variable bias, and (iii) it is very easy to implement. However, its performance depends on the availability of good predictors, something that can be assessed by the econometrician. We use the P-BOT to test for prejudice in pretrial detentions against the main ethnic group in Chile, the Mapuche, using nationwide administrative data. We find strong evidence of prejudice against Mapuche defendants and show that the discrimination patterns are likely to be non-binary. We assess the relative performance of the P-BOT and alternative approaches to test for prejudice, and discuss the test’s interpretation in more general versions of the model, sketching a new taxonomy of prejudice.

Suggested Citation

  • Nicolás Grau & Damián Vergara, "undated". "A Simple Test for Prejudice in Decision Processes: The Prediction-Based Outcome Test," Working Papers wp493, University of Chile, Department of Economics.
  • Handle: RePEc:udc:wpaper:wp493
    as

    Download full text from publisher

    File URL: http://www.econ.uchile.cl/uploads/publicacion/0c85f3c1997392309f5e578661b7b5c763ea79fa.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Arnold & Will Dobbie & Crystal S Yang, 2018. "Racial Bias in Bail Decisions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1885-1932.
    2. Kate Antonovics & Brian G. Knight, 2009. "A New Look at Racial Profiling: Evidence from the Boston Police Department," The Review of Economics and Statistics, MIT Press, vol. 91(1), pages 163-177, February.
    3. Brigham Frandsen & Lars Lefgren & Emily Leslie, 2023. "Judging Judge Fixed Effects," American Economic Review, American Economic Association, vol. 113(1), pages 253-277, January.
    4. David Arnold & Will Dobbie & Peter Hull, 2022. "Measuring Racial Discrimination in Bail Decisions," American Economic Review, American Economic Association, vol. 112(9), pages 2992-3038, September.
    5. Amitabh Chandra & Douglas O. Staiger, 2010. "Identifying Provider Prejudice in Healthcare," NBER Working Papers 16382, National Bureau of Economic Research, Inc.
    6. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    7. M. Marit Rehavi & Sonja B. Starr, 2014. "Racial Disparity in Federal Criminal Sentences," Journal of Political Economy, University of Chicago Press, vol. 122(6), pages 1320-1354.
    8. Gordon B. Dahl & Andreas Ravndal Kostøl & Magne Mogstad, 2014. "Family Welfare Cultures," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1711-1752.
    9. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    10. Shamena Anwar & Hanming Fang, 2006. "An Alternative Test of Racial Prejudice in Motor Vehicle Searches: Theory and Evidence," American Economic Review, American Economic Association, vol. 96(1), pages 127-151, March.
    11. John Knowles & Nicola Persico & Petra Todd, 2001. "Racial Bias in Motor Vehicle Searches: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 109(1), pages 203-232, February.
    12. Will Dobbie & Jacob Goldin & Crystal S. Yang, 2018. "The Effects of Pretrial Detention on Conviction, Future Crime, and Employment: Evidence from Randomly Assigned Judges," American Economic Review, American Economic Association, vol. 108(2), pages 201-240, February.
    13. Nicolás Grau & Gonzalo Marivil & Jorge Rivera, 2019. "The Effect of Pretrial Detention on Labor Market Outcomes," Working Papers wp488, University of Chile, Department of Economics.
    14. Heather Sarsons & Klarita Gërxhani & Ernesto Reuben & Arthur Schram, 2021. "Gender Differences in Recognition for Group Work," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 101-147.
    15. Francine D. Blau & Lawrence M. Kahn, 2017. "The Gender Wage Gap: Extent, Trends, and Explanations," Journal of Economic Literature, American Economic Association, vol. 55(3), pages 789-865, September.
    16. Heather Sarsons, 2015. "Recognition for Group Work," Working Paper 254946, Harvard University OpenScholar.
    17. Raj Chetty & Nathaniel Hendren & Maggie R Jones & Sonya R Porter, 2020. "Race and Economic Opportunity in the United States: an Intergenerational Perspective [“Intergenerational Mobility of Immigrants in the US Over Two Centuries,”]," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(2), pages 711-783.
    18. Patrick Kline & Christopher R. Walters, 2016. "Evaluating Public Programs with Close Substitutes: The Case of HeadStart," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1795-1848.
    19. Becker, Gary S, 1993. "Nobel Lecture: The Economic Way of Looking at Behavior," Journal of Political Economy, University of Chicago Press, vol. 101(3), pages 385-409, June.
    20. Will Dobbie & Andres Liberman & Daniel Paravisini & Vikram Pathania, 2021. "Measuring Bias in Consumer Lending [Loan Prospecting and the Loss of Soft Information]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(6), pages 2799-2832.
    21. Shelly Lundberg & Jenna Stearns, 2019. "Women in Economics: Stalled Progress," Journal of Economic Perspectives, American Economic Association, vol. 33(1), pages 3-22, Winter.
    22. repec:eee:labchp:v:3:y:1999:i:pc:p:3143-3259 is not listed on IDEAS
    23. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    24. Alma Cohen & Crystal S. Yang, 2019. "Judicial Politics and Sentencing Decisions," American Economic Journal: Economic Policy, American Economic Association, vol. 11(1), pages 160-191, February.
    25. David G. Blanchflower & Phillip B. Levine & David J. Zimmerman, 2003. "Discrimination in the Small-Business Credit Market," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 930-943, November.
    26. David S. Abrams & Marianne Bertrand & Sendhil Mullainathan, 2012. "Do Judges Vary in Their Treatment of Race?," The Journal of Legal Studies, University of Chicago Press, vol. 41(2), pages 347-383.
    27. Anna Aizer & Joseph J. Doyle, 2015. "Juvenile Incarceration, Human Capital, and Future Crime: Evidence from Randomly Assigned Judges," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(2), pages 759-803.
    28. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    29. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    30. Tomás Cortés & Nicolás Grau & Jorge Rivera, 2019. "Juvenile Incarceration and Adult Recidivism," Working Papers wp482, University of Chile, Department of Economics.
    31. Anthony Bald & Eric Chyn & Justine Hastings & Margarita Machelett, 2022. "The Causal Impact of Removing Children from Abusive and Neglectful Homes," Journal of Political Economy, University of Chicago Press, vol. 130(7), pages 1919-1962.
    32. Heather Antecol & Kelly Bedard & Jenna Stearns, 2018. "Equal but Inequitable: Who Benefits from Gender-Neutral Tenure Clock Stopping Policies?," American Economic Review, American Economic Association, vol. 108(9), pages 2420-2441, September.
    33. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    34. Patrick Kline & Christopher Walters, 2021. "Reasonable Doubt: Experimental Detection of Job‐Level Employment Discrimination," Econometrica, Econometric Society, vol. 89(2), pages 765-792, March.
    35. Kevin Lang & Jee-Yeon K. Lehmann, 2012. "Racial Discrimination in the Labor Market: Theory and Empirics," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 959-1006, December.
    36. Evan K Rose, 0. "Who Gets a Second Chance? Effectiveness and Equity in Supervision of Criminal Offenders," The Quarterly Journal of Economics, Oxford University Press, vol. 136(2), pages 1199-1253.
    37. Jonathan Guryan & Kerwin Kofi Charles, 2013. "Taste‐based or Statistical Discrimination: The Economics of Discrimination Returns to its Roots," Economic Journal, Royal Economic Society, vol. 123(11), pages 417-432, November.
    38. Altonji, Joseph G. & Blank, Rebecca M., 1999. "Race and gender in the labor market," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 48, pages 3143-3259, Elsevier.
    39. Charles F. Manski, 2005. "Optimal Search Profiling with Linear Deterrence," American Economic Review, American Economic Association, vol. 95(2), pages 122-126, May.
    40. Shamena Anwar & Patrick Bayer & Randi Hjalmarsson, 2012. "The Impact of Jury Race in Criminal Trials," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(2), pages 1017-1055.
    41. Charles F. Manski, 2006. "Search Profiling With Partial Knowledge of Deterrence," Economic Journal, Royal Economic Society, vol. 116(515), pages 385-401, November.
    42. Roland G. Fryer Jr., 2019. "An Empirical Analysis of Racial Differences in Police Use of Force," Journal of Political Economy, University of Chicago Press, vol. 127(3), pages 1210-1261.
    43. Alan Benson & Danielle Li & Kelly Shue, 2019. "Promotions and the Peter Principle," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 2085-2134.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Will Dobbie & Crystal S. Yang, 2021. "The US Pretrial System: Balancing Individual Rights and Public Interests," Journal of Economic Perspectives, American Economic Association, vol. 35(4), pages 49-70, Fall.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Arnold & Will Dobbie & Peter Hull, 2022. "Measuring Racial Discrimination in Bail Decisions," American Economic Review, American Economic Association, vol. 112(9), pages 2992-3038, September.
    2. Patricio Dom'inguez & Nicol'as Grau & Dami'an Vergara, 2022. "Discrimination Against Immigrants in the Criminal Justice System: Evidence from Pretrial Detentions," Papers 2202.10685, arXiv.org.
    3. Shi, Ying & Zhu, Maria, 2022. "Equal time for equal crime? Racial bias in school discipline," Economics of Education Review, Elsevier, vol. 88(C).
    4. Jessica LaVoice & Domonkos F. Vamossy, 2019. "Racial Disparities in Debt Collection," Papers 1910.02570, arXiv.org, revised Jun 2023.
    5. Ivan A. Canay & Magne Mogstad & Jack Mountjoy, 2020. "On the Use of Outcome Tests for Detecting Bias in Decision Making," NBER Working Papers 27802, National Bureau of Economic Research, Inc.
    6. Nayoung Rim & Roman Rivera & Andrea Kiss & Bocar Ba, 2020. "The Black-White Recognition Gap in Award Nominations," Working Papers 2020-065, Human Capital and Economic Opportunity Working Group.
    7. Xiao Lin & Mark J. Browne & Annette Hofmann, 2022. "Race discrimination in the adjudication of claims: Evidence from earthquake insurance," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 89(3), pages 553-580, September.
    8. Kevin Lang & Ariella Kahn-Lang Spitzer, 2020. "Race Discrimination: An Economic Perspective," Journal of Economic Perspectives, American Economic Association, vol. 34(2), pages 68-89, Spring.
    9. David Arnold & Will Dobbie & Crystal S Yang, 2018. "Racial Bias in Bail Decisions," The Quarterly Journal of Economics, Oxford University Press, vol. 133(4), pages 1885-1932.
    10. Benjamin Feigenberg & Conrad Miller, 2020. "Racial Disparities in Motor Vehicle Searches Cannot Be Justified by Efficiency," NBER Working Papers 27761, National Bureau of Economic Research, Inc.
    11. Mujcic, Redzo & Frijters, Paul, 2013. "Still Not Allowed on the Bus: It Matters If You're Black or White!," IZA Discussion Papers 7300, Institute of Labor Economics (IZA).
    12. Carolina Arteaga, 2021. "Parental Incarceration and Children's Educational Attainment," Working Papers tecipa-703, University of Toronto, Department of Economics.
    13. Joshua Grossman & Julian Nyarko & Sharad Goel, 2023. "Racial bias as a multi‐stage, multi‐actor problem: An analysis of pretrial detention," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 20(1), pages 86-133, March.
    14. Daniel Martin & Philip Marx, 2022. "A Robust Test of Prejudice for Discrimination Experiments," Management Science, INFORMS, vol. 68(6), pages 4527-4536, June.
    15. Shamena Anwar & Hanming Fang, 2015. "Testing for Racial Prejudice in the Parole Board Release Process: Theory and Evidence," The Journal of Legal Studies, University of Chicago Press, vol. 44(1), pages 1-37.
    16. Arcidiacono, Peter & Kinsler, Josh & Ransom, Tyler, 2022. "Asian American Discrimination in Harvard Admissions," European Economic Review, Elsevier, vol. 144(C).
    17. John Eric Humphries & Nicholas Mader & Daniel Tannenbaum & Winnie van Dijk, 2019. "Does Eviction Cause Poverty? Quasi-Experimental Evidence from Cook County, IL," CESifo Working Paper Series 7800, CESifo.
    18. Will Dobbie & Jacob Goldin & Crystal S. Yang, 2018. "The Effects of Pretrial Detention on Conviction, Future Crime, and Employment: Evidence from Randomly Assigned Judges," American Economic Review, American Economic Association, vol. 108(2), pages 201-240, February.
    19. Celislami, Elda & Kastoryano, Stephen & Mastrobuoni, Giovanni, 2023. "Strategic Bureaucratic Opacity: Evidence from Death Investigation Laws and Police Killings," IZA Discussion Papers 16609, Institute of Labor Economics (IZA).
    20. Lawrence, Edward R. & Raithatha, Mehul, 2023. "Gender bias, board diversity, and firm value: Evidence from a natural experiment," Journal of Corporate Finance, Elsevier, vol. 78(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:udc:wpaper:wp493. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mohit Karnani (email available below). General contact details of provider: https://edirc.repec.org/data/deuclcl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.