IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/11982.html
   My bibliography  Save this paper

Uses and Abuses of Empirical Evidence in the Death Penalty Debate

Author

Listed:
  • John J. Donohue III
  • Justin Wolfers

Abstract

Does the death penalty save lives? A surge of recent interest in this question has yielded a series of papers purporting to show robust and precise estimates of a substantial deterrent effect of capital punishment. We assess the various approaches that have been used in this literature, testing the robustness of these inferences. Specifically, we start by assessing the time series evidence, comparing the history of executions and homicides in the United States and Canada, and within the United States, between executing and non-executing states. We analyze the effects of the judicial experiments provided by the Furman and Gregg decisions and assess the relationship between execution and homicide rates in state panel data since 1934. We then revisit the existing instrumental variables approaches and assess two recent state-specific execution morartoria. In each case we find that previous inferences of large deterrent effects based upon specific examples, functional forms, control variables, comparison groups, or IV strategies are extremely fragile and even small changes in the specifications yield dramatically different results. The fundamental difficulty is that the death penalty -- at least as it has been implemented in the United States -- is applied so rarely that the number of homicides that it can plausibly have caused or deterred cannot be reliably disentangled from the large year-to-year changes in the homicide rate caused by other factors. As such, short samples and particular specifications may yield large but spurious correlations. We conclude that existing estimates appear to reflect a small and unrepresentative sample of the estimates that arise from alternative approaches. Sampling from the broader universe of plausible approaches suggests not just "reasonable doubt" about whether there is any deterrent effect of the death penalty, but profound uncertainty -- even about its sign.

Suggested Citation

  • John J. Donohue III & Justin Wolfers, 2006. "Uses and Abuses of Empirical Evidence in the Death Penalty Debate," NBER Working Papers 11982, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:11982
    Note: LE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w11982.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    2. Dale Cloninger & Roberto Marchesini, 2001. "Execution and deterrence: a quasi-controlled group experiment," Applied Economics, Taylor & Francis Journals, vol. 33(5), pages 569-576.
    3. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    4. Kennedy, Peter E, 1995. "Randomization Tests in Econometrics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(1), pages 85-94, January.
    5. Mocan, H Naci & Gittings, R Kaj, 2003. "Getting Off Death Row: Commuted Sentences and the Deterrent Effect of Capital Punishment," Journal of Law and Economics, University of Chicago Press, vol. 46(2), pages 453-478, October.
    6. Douglas Clement, 2002. "A punishing debate: does the death penalty deter homicide? New economic studies seek the answer to an age-old question," The Region, Federal Reserve Bank of Minneapolis, vol. 16(Jun), pages 12-15,40-43.
    7. Ashenfelter, Orley & Harmon, Colm & Oosterbeek, Hessel, 1999. "A review of estimates of the schooling/earnings relationship, with tests for publication bias," Labour Economics, Elsevier, vol. 6(4), pages 453-470, November.
    8. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    9. Shepherd, Joanna M, 2002. "Police, Prosecutors, Criminals, and Determinate Sentencing: The Truth about Truth-in-Sentencing Laws," Journal of Law and Economics, University of Chicago Press, vol. 45(2), pages 509-534, October.
    10. Passell, Peter & Taylor, John B, 1977. "The Deterrent Effect of Capital Punishment: Another View," American Economic Review, American Economic Association, vol. 67(3), pages 445-451, June.
    11. Paul R. Zimmerman, 2004. "State executions, deterrence, and the incidence of murder," Journal of Applied Economics, Universidad del CEMA, vol. 7, pages 163-193, May.
    12. Zimmerman, Paul R., 2004. "State executions, deterrence, and the incidence of murder," Journal of Applied Economics, Universidad del CEMA, vol. 7(1), pages 1-31, May.
    13. Ehrlich, Isaac, 1975. "The Deterrent Effect of Capital Punishment: A Question of Life and Death," American Economic Review, American Economic Association, vol. 65(3), pages 397-417, June.
    14. Lawrence Katz & Steven D. Levitt & Ellen Shustorovich, 2003. "Prison Conditions, Capital Punishment, and Deterrence," American Law and Economics Review, American Law and Economics Association, vol. 5(2), pages 318-343, August.
    15. Hashem Dezhbakhsh & Paul H. Rubin & Joanna M. Shepherd, 2003. "Does Capital Punishment Have a Deterrent Effect? New Evidence from Postmoratorium Panel Data," American Law and Economics Review, American Law and Economics Association, vol. 5(2), pages 344-376, August.
    16. Richard Berk, 2005. "New Claims about Executions and General Deterrence: Déjà Vu All Over Again?," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 2(2), pages 303-330, July.
    17. Joanna M. Shepherd, 2004. "Murders of Passion, Execution Delays, and the Deterrence of Capital Punishment," The Journal of Legal Studies, University of Chicago Press, vol. 33(2), pages 283-321, June.
    18. Douglas Eckberg, 1995. "Estimates of early twentieth-century U.S. homicide rates: An econometric forecasting approach," Demography, Springer;Population Association of America (PAA), vol. 32(1), pages 1-16, February.
    19. repec:fth:prinin:425 is not listed on IDEAS
    20. Rubin, Paul H. & Dezhbakhsh, Hashem, 2003. "The effect of concealed handgun laws on crime: beyond the dummy variables," International Review of Law and Economics, Elsevier, vol. 23(2), pages 199-216, June.
    21. Ian Ayres & John J. Donohue III, 2002. "Shooting Down the More Guns, Less Crime Hypothesis," NBER Working Papers 9336, National Bureau of Economic Research, Inc.
    22. Dale Cloninger & Roberto Marchesini, 2006. "Execution moratoriums, commutations and deterrence: the case of Illinois," Applied Economics, Taylor & Francis Journals, vol. 38(9), pages 967-973.
    23. Shepherd, Joanna M, 2002. "Fear of the First Strike: The Full Deterrent Effect of California's Two- and Three-Strikes Legislation," The Journal of Legal Studies, University of Chicago Press, vol. 31(1), pages 159-201, January.
    24. Moulton, Brent R, 1990. "An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Unit," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 334-338, May.
    25. Helland Eric & Tabarrok Alexander, 2004. "Using Placebo Laws to Test "More Guns, Less Crime"," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 4(1), pages 1-9, January.
    26. Hashem Dezhbakhsh & Joanna M. Shepherd, 2006. "The Deterrent Effect of Capital Punishment: Evidence from a "Judicial Experiment"," Economic Inquiry, Western Economic Association International, vol. 44(3), pages 512-535, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul R. Zimmerman, 2010. "The Economics of Capital Punishment and Deterrence," Chapters, in: Bruce L. Benson & Paul R. Zimmerman (ed.), Handbook on the Economics of Crime, chapter 16, Edward Elgar Publishing.
    2. Yang, Bijou & Lester, David, 2008. "The deterrent effect of executions: A meta-analysis thirty years after Ehrlich," Journal of Criminal Justice, Elsevier, vol. 36(5), pages 453-460, September.
    3. Gebhard Kirchgässner, 2011. "Econometric Estimates of Deterrence of the Death Penalty: Facts or Ideology?," Kyklos, Wiley Blackwell, vol. 64(3), pages 448-478, August.
    4. Angela K. Dills & Jeffrey A. Miron & Garrett Summers, 2010. "What Do Economists Know about Crime?," NBER Chapters, in: The Economics of Crime: Lessons For and From Latin America, pages 269-302, National Bureau of Economic Research, Inc.
    5. Eide, Erling & Rubin, Paul H. & Shepherd, Joanna M., 2006. "Economics of Crime," Foundations and Trends(R) in Microeconomics, now publishers, vol. 2(3), pages 205-279, December.
    6. Berit C. Gerritzen & Gebhard Kirchgässner, 2013. "Facts or Ideology: What Determines the Results of Econometric Estimates of the Deterrence Effect of Death Penalty?," CREMA Working Paper Series 2013-04, Center for Research in Economics, Management and the Arts (CREMA).
    7. Brett Parker, 2021. "Death Penalty Statutes and Murder Rates: Evidence From Synthetic Controls," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 18(3), pages 488-533, September.
    8. Patrick T Brandt & Tomislav V Kovandzic, 2015. "Messing Up Texas?: A Re-Analysis of the Effects of Executions on Homicides," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-19, September.
    9. Gerritzen, Berit & Kirchgässner, Gebhard, 2013. "Facts or Ideology: What Determines the Results of Econometric Estimates of the Deterrence Effect of Death Penalty? A Meta-Analysis," Economics Working Paper Series 1303, University of St. Gallen, School of Economics and Political Science.
    10. Paresh Kumar Narayan & Russell Smyth, 2006. "Dead man walking: an empirical reassessment of the deterrent effect of capital punishment using the bounds testing approach to cointegration," Applied Economics, Taylor & Francis Journals, vol. 38(17), pages 1975-1989.
    11. Joseph A. Clougherty & Jo Seldeslachts, 2013. "The Deterrence Effects of US Merger Policy Instruments," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 29(5), pages 1114-1144, October.
    12. Michael Frakes & Matthew Harding, "undated". "The Deterrent Effect of Expansions in Death Penalty Eligibility Criteria," Discussion Papers 08-033, Stanford Institute for Economic Policy Research.
    13. Ethan Cohen-Cole & Steven Durlauf & Jeffrey Fagan & Daniel Nagin, 2008. "Model Uncertainty and the Deterrent Effect of Capital Punishment," American Law and Economics Review, American Law and Economics Association, vol. 11(2), pages 335-369.
    14. Richard Berk, 2005. "New Claims about Executions and General Deterrence: Déjà Vu All Over Again?," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 2(2), pages 303-330, July.
    15. Joanna M. Shepherd, 2004. "Murders of Passion, Execution Delays, and the Deterrence of Capital Punishment," The Journal of Legal Studies, University of Chicago Press, vol. 33(2), pages 283-321, June.
    16. Vincent Aidan O'Sullivan, 2018. "Hanging Down Under: Capital Punishment and Deterrence in Australia," Working Papers 228680000, Lancaster University Management School, Economics Department.
    17. Naci Mocan & Kaj Gittings, 2010. "The Impact of Incentives on Human Behavior: Can We Make it Disappear? The Case of the Death Penalty," NBER Chapters, in: The Economics of Crime: Lessons For and From Latin America, pages 379-418, National Bureau of Economic Research, Inc.
    18. Robert B. Ekelund & John D. Jackson & Rand W. Ressler & Robert D. Tollison, 2006. "Marginal Deterrence and Multiple Murders," Southern Economic Journal, John Wiley & Sons, vol. 72(3), pages 521-541, January.
    19. Paul R. Zimmerman, 2006. "Estimates of the Deterrent Effect of Alternative Execution Methods in the United States: 1978–2000," American Journal of Economics and Sociology, Wiley Blackwell, vol. 65(4), pages 909-941, October.
    20. Philip A. Curry & Anindya Sen & George Orlov, 2016. "Crime, apprehension and clearance rates: Panel data evidence from Canadian provinces," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 49(2), pages 481-514, May.

    More about this item

    JEL classification:

    • K14 - Law and Economics - - Basic Areas of Law - - - Criminal Law
    • K42 - Law and Economics - - Legal Procedure, the Legal System, and Illegal Behavior - - - Illegal Behavior and the Enforcement of Law

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:11982. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.