IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/h6y5w.html

Reply to: Nix and Lozada (2020), “Do police killings of unarmed persons really have spillover effects? Reanalyzing Bor et al. (2018)”

Author

Listed:
  • Brr, Jacob
  • Venkataramani, Atheendar
  • Williams, David
  • Tsai, Alexander C.

Abstract

Nix and Lozada (2020) provide a critique of our 2018 paper, “Police killings and their spillover effects on the mental health of black Americans: a population-based, quasi-experimental study.” They take issue to our use of crowdsourced data from the Mapping Police Violence project database on whether or not a given victim was unarmed, our main exposure measure, and argue that 93 cases were miscoded as unarmed in these data. They then argue that recoding or dropping these 30% cases led to an attenuated and statistically non-significant estimate of the effect of these events on mental health outcomes among black American adults. In this reply, we argue that (1) our use of the Mapping Police Violence project data was carefully considered and scientifically valid both from a theoretical and analytic perspective, and (2) that the difference between our estimates and Nix and Lozada’s do not arise from “miscoding” as the authors claim, but rather a different definition of what constitutes an unarmed victim. To probe the robustness of our results, we estimate 128 regressions models representing all combinations of exclusions of the seven classes of events Nix and Lozada dispute as being unarmed. The estimates are uniformly positive (i.e., all indicative of a harmful relationship between exposure to these events at the state-level and mental health outcomes), and the range of estimates overlap substantially with the 95% confidence interval for our original point estimate.

Suggested Citation

  • Brr, Jacob & Venkataramani, Atheendar & Williams, David & Tsai, Alexander C., 2020. "Reply to: Nix and Lozada (2020), “Do police killings of unarmed persons really have spillover effects? Reanalyzing Bor et al. (2018)”," SocArXiv h6y5w, Center for Open Science.
  • Handle: RePEc:osf:socarx:h6y5w
    DOI: 10.31219/osf.io/h6y5w
    as

    Download full text from publisher

    File URL: https://osf.io/download/5e2af9f087a1d900e81ce0db/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/h6y5w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Klege, Rebecca A. & Amuakwa-Mensah, Franklin & Visser, Martine, 2022. "Tenancy and energy choices in Rwanda. A replication and extension study," World Development Perspectives, Elsevier, vol. 26(C).
    2. İbrahim Özmen & Mihai Mutascu, 2024. "Public Debt and Growth: New Insights," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 8706-8736, June.
    3. Luca Gerotto & Paolo Pellizzari, 2021. "A replication of Pindyck’s willingness to pay: on the efforts required to obtain results," SN Business & Economics, Springer, vol. 1(5), pages 1-25, May.
    4. Grolleau, Gilles & Ibanez, Lisette & Mzoughi, Naoufel, 2020. "Moral judgment of environmental harm caused by a single versus multiple wrongdoers: A survey experiment," Ecological Economics, Elsevier, vol. 170(C).
    5. Bensch, Gunther & Gotz, Gunnar & Peters, Jörg, 2020. "Effects of rural electrification on employment: A comment on Dinkelman (2011)," Ruhr Economic Papers 840, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    6. Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I. Ozkes, 2024. "Reproducibility in Management Science," Management Science, INFORMS, vol. 70(3), pages 1343-1356, March.
    7. Gay, Victor, 2023. "Culture: An Empirical Investigation of Beliefs, Work, and Fertility – A Verification and Reproduction of Fernández and Fogli (2009)," I4R Discussion Paper Series 91, The Institute for Replication (I4R).
    8. Chowdhury, Rosen & Cook, Steve & Watson, Duncan, 2023. "Reconsidering the relationship between health and income in the UK," Social Science & Medicine, Elsevier, vol. 332(C).
    9. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    10. Bart Penders & J. Britt Holbrook & Sarah de Rijcke, 2019. "Rinse and Repeat: Understanding the Value of Replication across Different Ways of Knowing," Publications, MDPI, vol. 7(3), pages 1-15, July.
    11. Christian Dippel & Michael Poyker, 2019. "How Common are Electoral Cycles in Criminal Sentencing?," NBER Working Papers 25716, National Bureau of Economic Research, Inc.
    12. Roy Chen & Yan Chen & Yohanes E. Riyanto, 2021. "Best practices in replication: a case study of common information in coordination games," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 2-30, March.
    13. Bruns, Stephan B. & König, Johannes & Stern, David I., 2019. "Replication and robustness analysis of ‘energy and economic growth in the USA: A multivariate approach’," Energy Economics, Elsevier, vol. 82(C), pages 100-113.
    14. Michael Clemens & Jennifer Hunt, 2017. "The Labor Market Effects of Refugee Waves: Reconciling Conflicting Results - Working Paper 455," Working Papers 455, Center for Global Development, revised 19 Jul 2017.
    15. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    16. Latré, Edwin & Perko, Tanja & Thijssen, Peter, 2017. "Public opinion change after the Fukushima nuclear accident: The role of national context revisited," Energy Policy, Elsevier, vol. 104(C), pages 124-133.
    17. Adesina, Adedoyin & Akogun, Oladele & Dillon, Andrew & Friedman, Jed & Njobdi, Sani & Serneels, Pieter, "undated". "Robustness and External Validity: What do we Learn from Repeated Study Designs over Time?," 2018 Allied Social Sciences Association (ASSA) Annual Meeting, January 5-7, 2018, Philadelphia, Pennsylvania 266292, Agricultural and Applied Economics Association.
    18. Emilie Caldeira & Alou Adessé Dama & Ali Compaoré & Mario Mansour & Grégoire Rota-Graziosi, 2020. "Tax effort in Sub-Saharan African countries : evidence from a new dataset," Working Papers hal-02543162, HAL.
    19. Isaiah Andrews & Maximilian Kasy, 2019. "Identification of and Correction for Publication Bias," American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
    20. Chin, Jason & Zeiler, Kathryn, 2021. "Replicability in Empirical Legal Research," LawArchive 2b5k4_v1, Center for Open Science.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:h6y5w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.